mike-ravkine commited on
Commit
a849977
·
verified ·
1 Parent(s): 90f117c

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +10 -1
README.md CHANGED
@@ -2,7 +2,15 @@
2
  license: llama3
3
  ---
4
 
5
- [ctranslate2](https://github.com/OpenNMT/CTranslate2) int8 conversion of [meta-llama/Meta-Llama-3-8B-Instruct](https://huggingface.co/meta-llama/Meta-Llama-3-8B-Instruct/tree/main)
 
 
 
 
 
 
 
 
6
 
7
  ct2 doesn't have hf-hub integration, so you'll need to manually download the model files:
8
 
@@ -10,6 +18,7 @@ ct2 doesn't have hf-hub integration, so you'll need to manually download the mod
10
  huggingface-cli download mike-ravkine/Meta-Llama-3-8B-Instruct-ct2-int8 --local-dir Meta-Llama-3-8B-Instruct-ct2-int8/
11
  ```
12
 
 
13
  Install dependencies:
14
 
15
  ```
 
2
  license: llama3
3
  ---
4
 
5
+ # Meta-Llama-3-8B-Instruct-ct2-int8
6
+
7
+ This is a [ctranslate2](https://github.com/OpenNMT/CTranslate2) v4.5.0 int8 conversion of [meta-llama/Meta-Llama-3-8B-Instruct](https://huggingface.co/meta-llama/Meta-Llama-3-8B-Instruct/tree/main) created with:
8
+
9
+ ```
10
+ ct2-transformers-converter --model meta-llama/Meta-Llama-3-8B-Instruct --output_dir Meta-Llama-3-8B-Instruct-ct2-int8 --quantization int8
11
+ ```
12
+
13
+ ## Downloading
14
 
15
  ct2 doesn't have hf-hub integration, so you'll need to manually download the model files:
16
 
 
18
  huggingface-cli download mike-ravkine/Meta-Llama-3-8B-Instruct-ct2-int8 --local-dir Meta-Llama-3-8B-Instruct-ct2-int8/
19
  ```
20
 
21
+ ## Using
22
  Install dependencies:
23
 
24
  ```