Update README.md
Browse files
README.md
CHANGED
@@ -10,14 +10,14 @@ tags:
|
|
10 |
- gguf-connector
|
11 |
---
|
12 |
|
13 |
-
|
14 |
|
15 |
-
|
16 |
- bug fixed for: "ResponseError: llama runner process has terminated: GGML_ASSERT(hparams.n_swa > 0) failed"
|
17 |
- tq1_0 and tq2_0 are not usable; seems at least should start with q2_k
|
18 |
|
19 |
### how to run it
|
20 |
use any connector for interacting with gguf; i.e., [gguf-connector](https://pypi.org/project/gguf-connector/)
|
21 |
|
22 |
-
|
23 |
- base model: microsoft/[phi-4](https://huggingface.co/microsoft/phi-4)
|
|
|
10 |
- gguf-connector
|
11 |
---
|
12 |
|
13 |
+
## gguf quantized and bug fixed version of phi4
|
14 |
|
15 |
+
### review
|
16 |
- bug fixed for: "ResponseError: llama runner process has terminated: GGML_ASSERT(hparams.n_swa > 0) failed"
|
17 |
- tq1_0 and tq2_0 are not usable; seems at least should start with q2_k
|
18 |
|
19 |
### how to run it
|
20 |
use any connector for interacting with gguf; i.e., [gguf-connector](https://pypi.org/project/gguf-connector/)
|
21 |
|
22 |
+
### reference
|
23 |
- base model: microsoft/[phi-4](https://huggingface.co/microsoft/phi-4)
|