Sentence Similarity
PEFT
Safetensors
English
text-embedding
embeddings
information-retrieval
beir
text-classification
language-model
text-clustering
text-semantic-similarity
text-evaluation
text-reranking
feature-extraction
Sentence Similarity
natural_questions
ms_marco
fever
hotpot_qa
mteb
Eval Results (legacy)
Update README.md
#5
by
Mathux - opened
README.md
CHANGED
|
@@ -2540,7 +2540,7 @@ import torch
|
|
| 2540 |
from transformers import AutoTokenizer, AutoModel, AutoConfig
|
| 2541 |
from peft import PeftModel
|
| 2542 |
|
| 2543 |
-
# Loading base
|
| 2544 |
tokenizer = AutoTokenizer.from_pretrained(
|
| 2545 |
"McGill-NLP/LLM2Vec-Meta-Llama-3-8B-Instruct-mntp"
|
| 2546 |
)
|
|
|
|
| 2540 |
from transformers import AutoTokenizer, AutoModel, AutoConfig
|
| 2541 |
from peft import PeftModel
|
| 2542 |
|
| 2543 |
+
# Loading base Llama-3 model, along with custom code that enables bidirectional connections in decoder-only LLMs. MNTP LoRA weights are merged into the base model.
|
| 2544 |
tokenizer = AutoTokenizer.from_pretrained(
|
| 2545 |
"McGill-NLP/LLM2Vec-Meta-Llama-3-8B-Instruct-mntp"
|
| 2546 |
)
|