Update README.md
Browse files
README.md
CHANGED
|
@@ -12,6 +12,10 @@ tags:
|
|
| 12 |
|
| 13 |
Converted version of [Mixtral Instruct](https://huggingface.co/mistralai/Mixtral-8x7B-Instruct-v0.1) to 4-bit using bitsandbytes. For more information about the model, refer to the model's page.
|
| 14 |
|
|
|
|
|
|
|
|
|
|
|
|
|
| 15 |
### Prompt Pattern
|
| 16 |
Here is a reminder of the command pattern to interact with the model if the add_special_tokens option is disabled (otherwise, do not include the BOS symbol and space at the beginning of the sequence):
|
| 17 |
```verbatim
|
|
|
|
| 12 |
|
| 13 |
Converted version of [Mixtral Instruct](https://huggingface.co/mistralai/Mixtral-8x7B-Instruct-v0.1) to 4-bit using bitsandbytes. For more information about the model, refer to the model's page.
|
| 14 |
|
| 15 |
+
### Impact on performance
|
| 16 |
+
Impact de la quantification sur un ensemble de modèles. L'impact de la quantification est négligeable.
|
| 17 |
+
|
| 18 |
+
|
| 19 |
### Prompt Pattern
|
| 20 |
Here is a reminder of the command pattern to interact with the model if the add_special_tokens option is disabled (otherwise, do not include the BOS symbol and space at the beginning of the sequence):
|
| 21 |
```verbatim
|