Update README.md
Browse files
README.md
CHANGED
@@ -32,7 +32,7 @@ The vision of OpenCSG is to empower every industry, every company, and every ind
|
|
32 |
## Model Description
|
33 |
|
34 |
CodeLlama is a collection of pretrained and fine-tuned generative text models from Llama2, which ranges in scale from 7 billion to 34 billion parameters.
|
35 |
-
Based on CodeLlama,
|
36 |
<br>
|
37 |
|
38 |
This is the repository for the base 7B version finetuned based on [CodeLlama-7b-hf](https://huggingface.co/codellama/CodeLlama-7b-hf).
|
@@ -50,8 +50,11 @@ This is the repository for the base 7B version finetuned based on [CodeLlama-7b-
|
|
50 |
| Model | HumanEval python pass@1 |
|
51 |
| --- |----------------------------------------------------------------------------- |
|
52 |
| CodeLlama-7b-hf | 30.5%|
|
53 |
-
| CodeLlama-
|
|
|
|
|
54 |
| CodeLlama-34b-hf | 48.2%|
|
|
|
55 |
|
56 |
```python
|
57 |
from transformers import AutoTokenizer
|
|
|
32 |
## Model Description
|
33 |
|
34 |
CodeLlama is a collection of pretrained and fine-tuned generative text models from Llama2, which ranges in scale from 7 billion to 34 billion parameters.
|
35 |
+
Based on CodeLlama, opencsg-CodeLlama-v0.1 is a series of fintuned models througth full-paramters fine-tuning method.
|
36 |
<br>
|
37 |
|
38 |
This is the repository for the base 7B version finetuned based on [CodeLlama-7b-hf](https://huggingface.co/codellama/CodeLlama-7b-hf).
|
|
|
50 |
| Model | HumanEval python pass@1 |
|
51 |
| --- |----------------------------------------------------------------------------- |
|
52 |
| CodeLlama-7b-hf | 30.5%|
|
53 |
+
| opencsg-CodeLlama-7b-v0.1(4k) | 42.7% |
|
54 |
+
| CodeLlama-13b-hf | 36.0%|
|
55 |
+
| opencsg-CodeLlama-13b-v0.1(4k) | 45.1% |
|
56 |
| CodeLlama-34b-hf | 48.2%|
|
57 |
+
| opencsg-CodeLlama-34b-v0.1(4k)| 48.8% |
|
58 |
|
59 |
```python
|
60 |
from transformers import AutoTokenizer
|