Update README.md
Browse files
README.md
CHANGED
|
@@ -15,7 +15,6 @@ tags:
|
|
| 15 |
### review
|
| 16 |
- bug fixed for: "ResponseError: llama runner process has terminated: GGML_ASSERT(hparams.n_swa > 0) failed"
|
| 17 |
- define the architecture (from none) to llama; all works right away
|
| 18 |
-
- tq1_0 and tq2_0 are not usable; seems at least should start with q2_k
|
| 19 |
|
| 20 |
### run the model
|
| 21 |
use any gguf connector to interact with gguf file(s), i.e., [connector](https://pypi.org/project/gguf-connector/)
|
|
|
|
| 15 |
### review
|
| 16 |
- bug fixed for: "ResponseError: llama runner process has terminated: GGML_ASSERT(hparams.n_swa > 0) failed"
|
| 17 |
- define the architecture (from none) to llama; all works right away
|
|
|
|
| 18 |
|
| 19 |
### run the model
|
| 20 |
use any gguf connector to interact with gguf file(s), i.e., [connector](https://pypi.org/project/gguf-connector/)
|