Deci
/

OferB commited on
Commit
2c0f707
·
1 Parent(s): 841df46

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +2 -3
README.md CHANGED
@@ -155,9 +155,8 @@ Below are DeciCoder's pass@1 on MultiPL HumanEval scores
155
  | HF Inference Endpoints | 1,364.2 | 9.03 | 3,244.4 | 8.8 |
156
  | Infery LLM | 3,889.3 | 3.075 | 11,676.8 | 1.729 |
157
 
158
- >**NOTE:**
159
- >- Latency - Total generation time of batch size 1 (prefill+generate)
160
- >- Throughput (tokens/sec) - Measured with optimal batchsize per hardware - A10 on BS 128, A100 on BS 512
161
 
162
  ## Documentation
163
 
 
155
  | HF Inference Endpoints | 1,364.2 | 9.03 | 3,244.4 | 8.8 |
156
  | Infery LLM | 3,889.3 | 3.075 | 11,676.8 | 1.729 |
157
 
158
+ - Latency - Total generation time of batch size 1 (prefill+generate)
159
+ - Throughput (tokens/sec) - Measured with optimal batchsize per hardware - A10 on BS 128, A100 on BS 512
 
160
 
161
  ## Documentation
162