Update README.md
Browse files
README.md
CHANGED
@@ -22,13 +22,7 @@ Finetuned from model: [Meta-Llama-3-8B-Instruct]
|
|
22 |
|
23 |
**The model is quantized version of the [defog/llama-3-sqlcoder-8b](https://huggingface.co/defog/llama-3-sqlcoder-8b) with int8_float16 quantization and can be used in [CTranslate2](https://github.com/OpenNMT/CTranslate2).**
|
24 |
|
25 |
-
## Conversion details
|
26 |
|
27 |
-
The original model was converted on 2024-06 with the following command:
|
28 |
-
```
|
29 |
-
ct2-transformers-converter --model Path\To\Local\meta-llama\Meta-Llama-3-8B-Instruct \
|
30 |
-
--quantization int8_float16 --output_dir Meta-Llama-3-8B-Instruct-ct2-int8_float16
|
31 |
-
```
|
32 |
|
33 |
## How to use
|
34 |
|
|
|
22 |
|
23 |
**The model is quantized version of the [defog/llama-3-sqlcoder-8b](https://huggingface.co/defog/llama-3-sqlcoder-8b) with int8_float16 quantization and can be used in [CTranslate2](https://github.com/OpenNMT/CTranslate2).**
|
24 |
|
|
|
25 |
|
|
|
|
|
|
|
|
|
|
|
26 |
|
27 |
## How to use
|
28 |
|