Update README.md
Browse files
README.md
CHANGED
|
@@ -65,12 +65,13 @@ To simplify the comparision, we chosed the Pass@1 metric on python language, but
|
|
| 65 |
| opencsg-CodeLlama-13b-v0.1(4k) | **45.1%** |
|
| 66 |
| CodeLlama-34b-hf | 48.2%|
|
| 67 |
| opencsg-CodeLlama-34b-v0.1(4k)| **48.8%** |
|
|
|
|
|
|
|
| 68 |
**TODO**
|
| 69 |
- we will provide much more benchmark scores on fine-tuned models in future.
|
| 70 |
- we will provide different practical problems to evaluate the performance of fine-tuned models in the field of software engineering.
|
| 71 |
|
| 72 |
|
| 73 |
-
|
| 74 |
# Model Usage
|
| 75 |
|
| 76 |
```python
|
|
|
|
| 65 |
| opencsg-CodeLlama-13b-v0.1(4k) | **45.1%** |
|
| 66 |
| CodeLlama-34b-hf | 48.2%|
|
| 67 |
| opencsg-CodeLlama-34b-v0.1(4k)| **48.8%** |
|
| 68 |
+
| --- |----------------------------------------------------------------------------- |
|
| 69 |
+
|
| 70 |
**TODO**
|
| 71 |
- we will provide much more benchmark scores on fine-tuned models in future.
|
| 72 |
- we will provide different practical problems to evaluate the performance of fine-tuned models in the field of software engineering.
|
| 73 |
|
| 74 |
|
|
|
|
| 75 |
# Model Usage
|
| 76 |
|
| 77 |
```python
|