Hugging Face's logo

ibm-ai-platform
/
llama3-8b-accelerator

Transformers
Safetensors
mlp_speculator
Inference Endpoints
Model card Files Community
4
JRosenkranz commited on
Commit
6a039c0
·
verified ·
1 Parent(s): 122524e

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +0 -3
README.md CHANGED
@@ -118,7 +118,6 @@ pip install transformers==4.35.0 sentencepiece numpy
118
  ```bash
119
  MODEL_PATH=/path/to/llama3/hf/Meta-Llama-3-8B-Instruct
120
  python fms-extras/scripts/paged_speculative_inference.py \
121
- --architecture=llama3 \
122
  --variant=8b \
123
  --model_path=$MODEL_PATH \
124
  --model_source=hf \
@@ -136,7 +135,6 @@ python fms-extras/scripts/paged_speculative_inference.py \
136
  ```bash
137
  MODEL_PATH=/path/to/llama3/hf/Meta-Llama-3-8B-Instruct
138
  python fms-extras/scripts/paged_speculative_inference.py \
139
- --architecture=llama3 \
140
  --variant=8b \
141
  --model_path=$MODEL_PATH \
142
  --model_source=hf \
@@ -153,7 +151,6 @@ python fms-extras/scripts/paged_speculative_inference.py \
153
  ```bash
154
  MODEL_PATH=/path/to/llama3/hf/Meta-Llama-3-8B-Instruct
155
  python fms-extras/scripts/paged_speculative_inference.py \
156
- --architecture=llama3 \
157
  --variant=8b \
158
  --model_path=$MODEL_PATH \
159
  --model_source=hf \
 
118
  ```bash
119
  MODEL_PATH=/path/to/llama3/hf/Meta-Llama-3-8B-Instruct
120
  python fms-extras/scripts/paged_speculative_inference.py \
 
121
  --variant=8b \
122
  --model_path=$MODEL_PATH \
123
  --model_source=hf \
 
135
  ```bash
136
  MODEL_PATH=/path/to/llama3/hf/Meta-Llama-3-8B-Instruct
137
  python fms-extras/scripts/paged_speculative_inference.py \
 
138
  --variant=8b \
139
  --model_path=$MODEL_PATH \
140
  --model_source=hf \
 
151
  ```bash
152
  MODEL_PATH=/path/to/llama3/hf/Meta-Llama-3-8B-Instruct
153
  python fms-extras/scripts/paged_speculative_inference.py \
 
154
  --variant=8b \
155
  --model_path=$MODEL_PATH \
156
  --model_source=hf \