Eldar Kurtic commited on
Commit
bc8ee38
·
1 Parent(s): ba1167e

add nm-vllm perf

Browse files
Files changed (2) hide show
  1. README.md +3 -0
  2. nm-vllm_Llama_vs_Mistral.png +0 -0
README.md CHANGED
@@ -17,3 +17,6 @@ license: apache-2.0
17
  | truthfulqa<br>0-shot | 59.65 | 57.48 |
18
  | **Average<br>Accuracy** | **65.21** | **65.05** |
19
  | **Recovery** | **100%** | **99.75%** |
 
 
 
 
17
  | truthfulqa<br>0-shot | 59.65 | 57.48 |
18
  | **Average<br>Accuracy** | **65.21** | **65.05** |
19
  | **Recovery** | **100%** | **99.75%** |
20
+
21
+ # nm-vllm inference performance
22
+ ![](nm-vllm_Llama_vs_Mistral.png)
nm-vllm_Llama_vs_Mistral.png ADDED