Update README.md
Browse files
README.md
CHANGED
|
@@ -16,7 +16,7 @@ tags:
|
|
| 16 |
- bug fixed for: "ResponseError: llama runner process has terminated: GGML_ASSERT(hparams.n_swa > 0) failed"
|
| 17 |
- tq1_0 and tq2_0 are not usable; seems at least should start with q2_k
|
| 18 |
|
| 19 |
-
###
|
| 20 |
use any connector for interacting with gguf file, i.e., [gguf-connector](https://pypi.org/project/gguf-connector/)
|
| 21 |
|
| 22 |
### reference
|
|
|
|
| 16 |
- bug fixed for: "ResponseError: llama runner process has terminated: GGML_ASSERT(hparams.n_swa > 0) failed"
|
| 17 |
- tq1_0 and tq2_0 are not usable; seems at least should start with q2_k
|
| 18 |
|
| 19 |
+
### run the model
|
| 20 |
use any connector for interacting with gguf file, i.e., [gguf-connector](https://pypi.org/project/gguf-connector/)
|
| 21 |
|
| 22 |
### reference
|