Update README.md
Browse files
README.md
CHANGED
@@ -39,7 +39,7 @@ In the `main` branch you will find `Guanaco-13B-GPTQ-4bit-128g.no-act-order.safe
|
|
39 |
|
40 |
This will work with all versions of GPTQ-for-LLaMa. It has maximum compatibility.
|
41 |
|
42 |
-
It was created
|
43 |
|
44 |
* `Guanaco-13B-GPTQ-4bit-128g.no-act-order.safetensors`
|
45 |
* Works with all versions of GPTQ-for-LLaMa code, both Triton and CUDA branches
|
|
|
39 |
|
40 |
This will work with all versions of GPTQ-for-LLaMa. It has maximum compatibility.
|
41 |
|
42 |
+
It was created with groupsize 128 to ensure higher quality inference, and without `--act-order` to maximise compatibility.
|
43 |
|
44 |
* `Guanaco-13B-GPTQ-4bit-128g.no-act-order.safetensors`
|
45 |
* Works with all versions of GPTQ-for-LLaMa code, both Triton and CUDA branches
|