TomPei commited on
Commit
7fb6686
·
verified ·
1 Parent(s): 903fe37

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +2 -2
README.md CHANGED
@@ -31,8 +31,8 @@ The vision of OpenCSG is to empower every industry, every company, and every ind
31
 
32
  ## Model Description
33
 
34
- opencsg-CodeLlama-7B is a 34B Code-LLM finetuned by QLoRA of multiple code tasks(600k instrunctions/answers) on the base model CodeLlama-34b-Python.
35
- The context length of finetuning is 4K while it is able to be finetuned by 16k context if necessary.
36
  <br>
37
 
38
 
 
31
 
32
  ## Model Description
33
 
34
+ CodeLlama is a collection of pretrained and fine-tuned generative text models from Llama2, which ranges in scale from 7 billion to 34 billion parameters.
35
+ Based on CodeLlama, Opencsg-CodeLlama is a series of fintuned models througth full-paramters fine-tuning method.
36
  <br>
37
 
38