Update README.md
Browse files
README.md
CHANGED
|
@@ -7,6 +7,13 @@ This is GreenBitAI's pretrained **2-bit** LLaMA model with extreme compression y
|
|
| 7 |
|
| 8 |
Please refer to our [Github page](https://github.com/GreenBitAI/low_bit_llama) for the code to run the model and more information.
|
| 9 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 10 |
## Zero-Shot Evaluation
|
| 11 |
| Task | Metric | LLaMA 3B q2g32 | LLaMA 3B q2g16 | LLaMA 3B q2g8 | LLaMA-1 7B q2g32 | LLaMA-2 7B q2g32 | LLaMA-2 7B q2g8 | LLaMA 3B FP16 | LLaMA-1 7B FP16 |
|
| 12 |
|---------------|----------|----------------|----------------|--------------|------------------|------------------|----------------|--------------|-----------------|
|
|
|
|
| 7 |
|
| 8 |
Please refer to our [Github page](https://github.com/GreenBitAI/low_bit_llama) for the code to run the model and more information.
|
| 9 |
|
| 10 |
+
## Model Description
|
| 11 |
+
|
| 12 |
+
- **Developed by:** [GreenBitAI](https://github.com/GreenBitAI)
|
| 13 |
+
- **Model type:** Causal (Llama 2)
|
| 14 |
+
- **Language(s) (NLP):** English
|
| 15 |
+
- **License:** [Apache 2.0](https://www.apache.org/licenses/LICENSE-2.0), [Llama 2 license agreement](https://ai.meta.com/resources/models-and-libraries/llama-downloads/)
|
| 16 |
+
|
| 17 |
## Zero-Shot Evaluation
|
| 18 |
| Task | Metric | LLaMA 3B q2g32 | LLaMA 3B q2g16 | LLaMA 3B q2g8 | LLaMA-1 7B q2g32 | LLaMA-2 7B q2g32 | LLaMA-2 7B q2g8 | LLaMA 3B FP16 | LLaMA-1 7B FP16 |
|
| 19 |
|---------------|----------|----------------|----------------|--------------|------------------|------------------|----------------|--------------|-----------------|
|