Update README.md
Browse files
README.md
CHANGED
@@ -61,12 +61,12 @@ To simplify the comparison, we chosed the Pass@1 metric for the Python language,
|
|
61 |
| Model | HumanEval python pass@1 |
|
62 |
| --- |----------------------------------------------------------------------------- |
|
63 |
| CodeLlama-7b-hf | 30.5%|
|
64 |
-
| opencsg-CodeLlama-7b-v0.1 | **43.9%** |
|
65 |
| CodeLlama-13b-hf | 36.0%|
|
66 |
-
| opencsg-CodeLlama-13b-v0.1| **51.2%** |
|
67 |
| CodeLlama-34b-hf | 48.2%|
|
68 |
-
| opencsg-CodeLlama-34b-v0.1
|
69 |
-
| opencsg-CodeLlama-34b-v0.2
|
70 |
| CodeLlama-70b-hf| 53.0% |
|
71 |
| CodeLlama-70b-Instruct-hf| **67.8%** |
|
72 |
|
@@ -190,12 +190,12 @@ HumanEval 是评估模型在代码生成方面性能的最常见的基准,尤
|
|
190 |
| 模型 | HumanEval python pass@1 |
|
191 |
| --- |----------------------------------------------------------------------------- |
|
192 |
| CodeLlama-7b-hf | 30.5%|
|
193 |
-
| opencsg-CodeLlama-7b-v0.1| **43.9%** |
|
194 |
| CodeLlama-13b-hf | 36.0%|
|
195 |
-
| opencsg-CodeLlama-13b-v0.1 | **51.2%** |
|
196 |
| CodeLlama-34b-hf | 48.2%|
|
197 |
-
| opencsg-CodeLlama-34b-v0.1
|
198 |
-
| opencsg-CodeLlama-34b-v0.2
|
199 |
| CodeLlama-70b-hf| 53.0% |
|
200 |
| CodeLlama-70b-Instruct-hf| **67.8%** |
|
201 |
|
|
|
61 |
| Model | HumanEval python pass@1 |
|
62 |
| --- |----------------------------------------------------------------------------- |
|
63 |
| CodeLlama-7b-hf | 30.5%|
|
64 |
+
| **opencsg-CodeLlama-7b-v0.1** | **43.9%** |
|
65 |
| CodeLlama-13b-hf | 36.0%|
|
66 |
+
| **opencsg-CodeLlama-13b-v0.1** | **51.2%** |
|
67 |
| CodeLlama-34b-hf | 48.2%|
|
68 |
+
| **opencsg-CodeLlama-34b-v0.1**| **56.1%** |
|
69 |
+
| **opencsg-CodeLlama-34b-v0.2**| **64.0%** |
|
70 |
| CodeLlama-70b-hf| 53.0% |
|
71 |
| CodeLlama-70b-Instruct-hf| **67.8%** |
|
72 |
|
|
|
190 |
| 模型 | HumanEval python pass@1 |
|
191 |
| --- |----------------------------------------------------------------------------- |
|
192 |
| CodeLlama-7b-hf | 30.5%|
|
193 |
+
| **opencsg-CodeLlama-7b-v0.1** | **43.9%** |
|
194 |
| CodeLlama-13b-hf | 36.0%|
|
195 |
+
| **opencsg-CodeLlama-13b-v0.1** | **51.2%** |
|
196 |
| CodeLlama-34b-hf | 48.2%|
|
197 |
+
| **opencsg-CodeLlama-34b-v0.1**| **56.1%** |
|
198 |
+
| **opencsg-CodeLlama-34b-v0.2**| **64.0%** |
|
199 |
| CodeLlama-70b-hf| 53.0% |
|
200 |
| CodeLlama-70b-Instruct-hf| **67.8%** |
|
201 |
|