Hugging Face's logo

neuralmagic
/
Meta-Llama-3.1-70B-Instruct-quantized.w4a16

Text Generation
Transformers
Safetensors
llama
int4
vllm
conversational
text-generation-inference
Inference Endpoints
4-bit precision
gptq
Model card Files Community
abhinavnmagic commited on
Commit
dfb3652
·
verified ·
1 Parent(s): aae93a4

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +7 -7
README.md CHANGED
@@ -155,7 +155,7 @@ lm_eval \
155
  </td>
156
  <td>82.21
157
  </td>
158
- <td>xx.xx
159
  </td>
160
  <td>81.84
161
  </td>
@@ -167,7 +167,7 @@ lm_eval \
167
  </td>
168
  <td>70.65
169
  </td>
170
- <td>xx.xx
171
  </td>
172
  <td>70.05
173
  </td>
@@ -179,7 +179,7 @@ lm_eval \
179
  </td>
180
  <td>87.95
181
  </td>
182
- <td>xx.xx
183
  </td>
184
  <td>89.84
185
  </td>
@@ -191,7 +191,7 @@ lm_eval \
191
  </td>
192
  <td>86.33
193
  </td>
194
- <td>xx.xx
195
  </td>
196
  <td>86.24
197
  </td>
@@ -203,7 +203,7 @@ lm_eval \
203
  </td>
204
  <td>85.00
205
  </td>
206
- <td>xx.xx
207
  </td>
208
  <td>84.53
209
  </td>
@@ -215,7 +215,7 @@ lm_eval \
215
  </td>
216
  <td>59.90
217
  </td>
218
- <td>xx.xx
219
  </td>
220
  <td>58.74
221
  </td>
@@ -227,7 +227,7 @@ lm_eval \
227
  </td>
228
  <td><strong>78.67</strong>
229
  </td>
230
- <td><strong>xx.xx</strong>
231
  </td>
232
  <td><strong>78.54</strong>
233
  </td>
 
155
  </td>
156
  <td>82.21
157
  </td>
158
+ <td>81.42
159
  </td>
160
  <td>81.84
161
  </td>
 
167
  </td>
168
  <td>70.65
169
  </td>
170
+ <td>70.13
171
  </td>
172
  <td>70.05
173
  </td>
 
179
  </td>
180
  <td>87.95
181
  </td>
182
+ <td>90.59
183
  </td>
184
  <td>89.84
185
  </td>
 
191
  </td>
192
  <td>86.33
193
  </td>
194
+ <td>86.23
195
  </td>
196
  <td>86.24
197
  </td>
 
203
  </td>
204
  <td>85.00
205
  </td>
206
+ <td>84.53
207
  </td>
208
  <td>84.53
209
  </td>
 
215
  </td>
216
  <td>59.90
217
  </td>
218
+ <td>59.62
219
  </td>
220
  <td>58.74
221
  </td>
 
227
  </td>
228
  <td><strong>78.67</strong>
229
  </td>
230
+ <td><strong>78.75</strong>
231
  </td>
232
  <td><strong>78.54</strong>
233
  </td>