TomPei commited on
Commit
36aacd2
·
verified ·
1 Parent(s): c6e349a

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +8 -8
README.md CHANGED
@@ -61,12 +61,12 @@ To simplify the comparison, we chosed the Pass@1 metric for the Python language,
61
  | Model | HumanEval python pass@1 |
62
  | --- |----------------------------------------------------------------------------- |
63
  | CodeLlama-7b-hf | 30.5%|
64
- | opencsg-CodeLlama-7b-v0.1 | **43.9%** |
65
  | CodeLlama-13b-hf | 36.0%|
66
- | opencsg-CodeLlama-13b-v0.1| **51.2%** |
67
  | CodeLlama-34b-hf | 48.2%|
68
- | opencsg-CodeLlama-34b-v0.1| **56.1%** |
69
- | opencsg-CodeLlama-34b-v0.2| **64.0%** |
70
  | CodeLlama-70b-hf| 53.0% |
71
  | CodeLlama-70b-Instruct-hf| **67.8%** |
72
 
@@ -190,12 +190,12 @@ HumanEval 是评估模型在代码生成方面性能的最常见的基准,尤
190
  | 模型 | HumanEval python pass@1 |
191
  | --- |----------------------------------------------------------------------------- |
192
  | CodeLlama-7b-hf | 30.5%|
193
- | opencsg-CodeLlama-7b-v0.1| **43.9%** |
194
  | CodeLlama-13b-hf | 36.0%|
195
- | opencsg-CodeLlama-13b-v0.1 | **51.2%** |
196
  | CodeLlama-34b-hf | 48.2%|
197
- | opencsg-CodeLlama-34b-v0.1| **56.1%** |
198
- | opencsg-CodeLlama-34b-v0.2| **64.0%** |
199
  | CodeLlama-70b-hf| 53.0% |
200
  | CodeLlama-70b-Instruct-hf| **67.8%** |
201
 
 
61
  | Model | HumanEval python pass@1 |
62
  | --- |----------------------------------------------------------------------------- |
63
  | CodeLlama-7b-hf | 30.5%|
64
+ | **opencsg-CodeLlama-7b-v0.1** | **43.9%** |
65
  | CodeLlama-13b-hf | 36.0%|
66
+ | **opencsg-CodeLlama-13b-v0.1** | **51.2%** |
67
  | CodeLlama-34b-hf | 48.2%|
68
+ | **opencsg-CodeLlama-34b-v0.1**| **56.1%** |
69
+ | **opencsg-CodeLlama-34b-v0.2**| **64.0%** |
70
  | CodeLlama-70b-hf| 53.0% |
71
  | CodeLlama-70b-Instruct-hf| **67.8%** |
72
 
 
190
  | 模型 | HumanEval python pass@1 |
191
  | --- |----------------------------------------------------------------------------- |
192
  | CodeLlama-7b-hf | 30.5%|
193
+ | **opencsg-CodeLlama-7b-v0.1** | **43.9%** |
194
  | CodeLlama-13b-hf | 36.0%|
195
+ | **opencsg-CodeLlama-13b-v0.1** | **51.2%** |
196
  | CodeLlama-34b-hf | 48.2%|
197
+ | **opencsg-CodeLlama-34b-v0.1**| **56.1%** |
198
+ | **opencsg-CodeLlama-34b-v0.2**| **64.0%** |
199
  | CodeLlama-70b-hf| 53.0% |
200
  | CodeLlama-70b-Instruct-hf| **67.8%** |
201