Update README.md
Browse files
README.md
CHANGED
@@ -6,6 +6,15 @@ pipeline_tag: text-generation
|
|
6 |
inference: false
|
7 |
library_name: transformers
|
8 |
---
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
9 |
# OpenBuddy - Open Multilingual Chatbot based on LLaMA
|
10 |
|
11 |
GitHub and Usage Guide: [https://github.com/OpenBuddy/OpenBuddy](https://github.com/OpenBuddy/OpenBuddy)
|
@@ -22,20 +31,6 @@ Due to licensing restrictions from LLAMA, you need to have the original LLAMA-7B
|
|
22 |
python(3) decrypt.py [path-to-consolidated.00.pth] [path-to-our-model-folder]
|
23 |
```
|
24 |
|
25 |
-
## Usage
|
26 |
-
|
27 |
-
OpenBuddy is a model that uses `bf16` format. However, some libraries or frameworks may tend to default to fp16 format conversion and loading, which can cause unexpected results in the model.
|
28 |
-
|
29 |
-
If you are using the Transformers library, you can load the model in the following way:
|
30 |
-
|
31 |
-
```Python
|
32 |
-
MODEL_PATH = './openbuddy-7b-bf16-enc'
|
33 |
-
model = LlamaForCausalLM.from_pretrained(model_path, torch_dtype=torch.bfloat16)
|
34 |
-
tokenizer = LlamaTokenizer.from_pretrained(model_path)
|
35 |
-
```
|
36 |
-
|
37 |
-
Here, the torch_dtype argument is set to torch.bfloat16 to ensure that the model is loaded in bf16 format.
|
38 |
-
|
39 |
## Disclaimer
|
40 |
|
41 |
OpenBuddy is provided as-is without any warranty of any kind, either express or implied. The authors and contributors shall not be held liable for any damages resulting from the use or inability to use this software. By using OpenBuddy, you agree to these terms and conditions.
|
|
|
6 |
inference: false
|
7 |
library_name: transformers
|
8 |
---
|
9 |
+
# ⚠️ DEPRECATION WARNING ⚠️
|
10 |
+
|
11 |
+
This model is an outdated version and has been preserved specifically for evaluating differences between model versions.
|
12 |
+
|
13 |
+
We highly recommend visiting our GitHub repository to find and use the latest version of the model: https://github.com/OpenBuddy/OpenBuddy
|
14 |
+
|
15 |
+
|
16 |
+
|
17 |
+
|
18 |
# OpenBuddy - Open Multilingual Chatbot based on LLaMA
|
19 |
|
20 |
GitHub and Usage Guide: [https://github.com/OpenBuddy/OpenBuddy](https://github.com/OpenBuddy/OpenBuddy)
|
|
|
31 |
python(3) decrypt.py [path-to-consolidated.00.pth] [path-to-our-model-folder]
|
32 |
```
|
33 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
34 |
## Disclaimer
|
35 |
|
36 |
OpenBuddy is provided as-is without any warranty of any kind, either express or implied. The authors and contributors shall not be held liable for any damages resulting from the use or inability to use this software. By using OpenBuddy, you agree to these terms and conditions.
|