Update README.md
Browse files
README.md
CHANGED
|
@@ -18,15 +18,6 @@ We are excited to announce the release of a lightweight version from the Index s
|
|
| 18 |
- **Index-1.9B chat (this repository's model)** : A dialogue model aligned with SFT and DPO based on the Index-1.9B base. We found that due to the introduction of a lot of internet community corpus in our pre-training, the model has significantly more interesting chatting capabilities.
|
| 19 |
- Index-1.9B character : Introduces RAG on top of SFT and DPO to achieve few-shots role-playing customization.
|
| 20 |
|
| 21 |
-
## 模型介绍
|
| 22 |
-
|
| 23 |
-
我们很高兴首次发布Index系列模型中的轻量版本:Index-1.9B系列
|
| 24 |
-
本次开源的Index-1.9B 系列包含以下模型:
|
| 25 |
-
- Index-1.9B base : 基座模型,具有 19亿 非词嵌入参数量,在2.8T 中英文为主的语料上预训练,多个评测基准上与同级别模型比处于领先。
|
| 26 |
-
- Index-1.9B pure : 基座模型的对照组,与base具有相同的参数和训练策略,不同之处在于我们严格过滤了该版本语料中所有指令相关的数据,以此来验证指令对benchmark的影响。
|
| 27 |
-
- **Index-1.9B chat(本仓库模型)** : 基于index-1.9B base通过SFT和DPO对齐后的对话模型,我们发现由于预训练中引入了较多定向清洗的对话类语料,聊天的趣味性明显更强。
|
| 28 |
-
- Index-1.9B character : 在SFT和DPO的基础上引入了RAG来实现fewshots角色扮演定制。
|
| 29 |
-
|
| 30 |
Adapted to llamacpp and Ollama, see [Index-1.9B-Chat-GGUF](https://huggingface.co/IndexTeam/Index-1.9B-Chat-GGUF)
|
| 31 |
|
| 32 |
For more details, see our [GitHub](https://github.com/bilibili/Index-1.9B) and [Index-1.9B Technical Report](https://github.com/bilibili/Index-1.9B/blob/main/Index-1.9B%20%E6%8A%80%E6%9C%AF%E6%8A%A5%E5%91%8A.pdf)
|
|
@@ -39,7 +30,7 @@ You can load the Index-1.9B-Chat model for dialogue using the following code:
|
|
| 39 |
import argparse
|
| 40 |
from transformers import AutoTokenizer, pipeline
|
| 41 |
|
| 42 |
-
#
|
| 43 |
parser = argparse.ArgumentParser()
|
| 44 |
parser.add_argument('--model_path', default="IndexTeam/Index-1.9B-Chat", type=str, help="")
|
| 45 |
parser.add_argument('--device', default="cpu", type=str, help="") # also could be "cuda" or "mps" for Apple silicon
|
|
|
|
| 18 |
- **Index-1.9B chat (this repository's model)** : A dialogue model aligned with SFT and DPO based on the Index-1.9B base. We found that due to the introduction of a lot of internet community corpus in our pre-training, the model has significantly more interesting chatting capabilities.
|
| 19 |
- Index-1.9B character : Introduces RAG on top of SFT and DPO to achieve few-shots role-playing customization.
|
| 20 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 21 |
Adapted to llamacpp and Ollama, see [Index-1.9B-Chat-GGUF](https://huggingface.co/IndexTeam/Index-1.9B-Chat-GGUF)
|
| 22 |
|
| 23 |
For more details, see our [GitHub](https://github.com/bilibili/Index-1.9B) and [Index-1.9B Technical Report](https://github.com/bilibili/Index-1.9B/blob/main/Index-1.9B%20%E6%8A%80%E6%9C%AF%E6%8A%A5%E5%91%8A.pdf)
|
|
|
|
| 30 |
import argparse
|
| 31 |
from transformers import AutoTokenizer, pipeline
|
| 32 |
|
| 33 |
+
# Attention! The directory must not contain "." and can be replaced with "_".
|
| 34 |
parser = argparse.ArgumentParser()
|
| 35 |
parser.add_argument('--model_path', default="IndexTeam/Index-1.9B-Chat", type=str, help="")
|
| 36 |
parser.add_argument('--device', default="cpu", type=str, help="") # also could be "cuda" or "mps" for Apple silicon
|