|
--- |
|
license: apache-2.0 |
|
--- |
|
|
|
# RedPajama-INCITE-7B-Chat GGML FILES |
|
|
|
These files are the model files in GGML format for the RedPajama-INCITE-7B chat model. |
|
|
|
The GGML Files can be used for CPU inference using redpajama.cpp |
|
|
|
## File Structure |
|
|
|
- [ggml-RedPajama-INCITE-7B-Chat-q4_0.bin](ggml-RedPajama-INCITE-7B-Chat-q4_0.bin) |
|
- [ggml-RedPajama-INCITE-7B-Chat-q4_1.bin](ggml-RedPajama-INCITE-7B-Chat-q4_1.bin) |
|
- [ggml-RedPajama-INCITE-7B-Chat-q4_2.bin](ggml-RedPajama-INCITE-7B-Chat-q4_2.bin) |
|
- [ggml-RedPajama-INCITE-7B-Chat-q5_0.bin](ggml-RedPajama-INCITE-7B-Chat-q5_0.bin) |
|
- [ggml-RedPajama-INCITE-7B-Chat-q5_1.bin](ggml-RedPajama-INCITE-7B-Chat-q5_1.bin) |
