Update README.md

README.md

@@ -30,7 +30,10 @@ To know more about the model, read the [announcement blogpost](https://huggingfa
 
 # Usage
 
-**Initialize model and processor**
+<details>
+<summary>
+via HuggingFace Transformers
+</summary>
 
 ```python
 from transformers import AutoProcessor, Qwen2VLForConditionalGeneration
@@ -46,6 +49,7 @@ min_pixels = 1 * 28 * 28
 # Load the embedding model and processor
 model = Qwen2VLForConditionalGeneration.from_pretrained(
     'llamaindex/vdr-2b-multi-v1',
+    # These are the recommended kwargs for the model, but change them as needed
     attn_implementation="flash_attention_2",
     torch_dtype=torch.bfloat16,
     device_map="cuda:0"
@@ -105,6 +109,7 @@ def encode_queries(queries: list[str], dimension: int) -> torch.Tensor:
 ```
 
 **Encode documents**
+
 ```python
 def round_by_factor(number: float, factor: int) -> int:
     return round(number / factor) * factor
@@ -167,6 +172,59 @@ def encode_documents(documents: list[Image.Image], dimension: int):
     return torch.nn.functional.normalize(embeddings[:, :dimension], p=2, dim=-1)
 ```
 
+</details>
+
+<details>
+<summary>
+via LlamaIndex
+</summary>
+
+```bash
+pip install -U llama-index-embeddings-huggingface
+```
+
+```python
+from llama_index.embeddings.huggingface import HuggingFaceEmbedding
+
+model = HuggingFaceEmbedding(
+    model_name_or_path="llamaindex/vdr-2b-multi-v1",
+    device="mps",
+    trust_remote_code=True,
+)
+
+embeddings = model.get_image_embedding("image.png")
+```
+
+</details>
+
+
+<details>
+<summary>
+via SentenceTransformers
+</summary>
+
+```python
+from sentence_transformers import SentenceTransformer
+
+model = SentenceTransformer(
+    model_name_or_path="llamaindex/vdr-2b-multi-v1",
+    device="mps",
+    trust_remote_code=True,
+    # These are the recommended kwargs for the model, but change them as needed
+    model_kwargs={
+        "torch_dtype": torch.bfloat16, 
+        "device_map": "cuda:0", 
+        "attn_implementation": "flash_attention_2"
+    },
+)
+
+embeddings = model.encode("image.png")
+```
+
+</details>
+
+
+
 # Training
 
 The model is based on [MrLight/dse-qwen2-2b-mrl-v1](https://huggingface.co/MrLight/dse-qwen2-2b-mrl-v1) and it was trained on the new [vdr-multilingual-train](https://huggingface.co/datasets/llamaindex/vdr-multilingual-train) dataset that consinsists of 500k high quality, multilingual query image pairs. It was trained for 1 epoch using the [DSE approach](https://arxiv.org/abs/2406.11251), with a batch size of 128 and hard-mined negatives.