TomPei commited on
Commit
ff6ef77
·
verified ·
1 Parent(s): 8a44d9b

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -0
README.md CHANGED
@@ -54,6 +54,7 @@ Thus, OpenCSG strained our brains to provide a relatively fair method to compare
54
  To simplify the comparision, we chosed the Pass@1 metric on python language, but our finetuning dataset includes samples in multi language.
55
 
56
  **For fair, we evaluated the fine-tuned and origin codellama models only with the original cases' prompts, not including any other instruction else.**
 
57
 
58
  | Model | HumanEval python pass@1 |
59
  | --- |----------------------------------------------------------------------------- |
 
54
  To simplify the comparision, we chosed the Pass@1 metric on python language, but our finetuning dataset includes samples in multi language.
55
 
56
  **For fair, we evaluated the fine-tuned and origin codellama models only with the original cases' prompts, not including any other instruction else.**
57
+ **Otherwise,we use greedy decoding method for each model during the evaluation.**
58
 
59
  | Model | HumanEval python pass@1 |
60
  | --- |----------------------------------------------------------------------------- |