Create README.md
Browse files
README.md
ADDED
|
@@ -0,0 +1,11 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
Quantization w/ imatrix of Replete-AI/Mistral-11b-v0.1
|
| 2 |
+
|
| 3 |
+
The 'groups_merged.txt' in the repo was used to generate the 'imatrix.dat'also in the repo w/ 350 importance matrix entries.
|
| 4 |
+
|
| 5 |
+
llama.cpp build info:
|
| 6 |
+
|
| 7 |
+
main: build = 2354 (e25fb4b1) SYCL, GGML_SYCL_F16: yes
|
| 8 |
+
main: built with Intel(R) oneAPI DPC++/C++ Compiler 2024.0.2 (2024.0.2.20231213) for x86_64-unknown-linux-gnu
|
| 9 |
+
|
| 10 |
+
2x Intel(R) Xeon(R) Platinum 8480+
|
| 11 |
+
4x Intel MAX 1100 GPU
|