rajabmondal commited on
Commit
684b781
·
verified ·
1 Parent(s): be008dc

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -109,7 +109,7 @@ Refer to the Provided Files table below to see what files use which methods, and
109
 
110
  | Name | Quant method | Bits | Size | Max RAM required | Use case |
111
  | ---- | ---- | ---- | ---- | ---- | ----- |
112
- | [NT-Java-1.1B_Q2_K.gguf](https://huggingface.co/TheBloke/Mixtral-8x7B-Instruct-v0.1-GGUF/blob/main/mixtral-8x7b-instruct-v0.1.Q2_K.gguf) | Q2_K | 2 | 15.64 GB| 18.14 GB | smallest, significant quality loss - not recommended for most purposes |
113
  | [NT-Java-1.1B_Q3_K_M.gguf](https://huggingface.co/infosys/NT-Java-1.1B-GGUF/blob/main/NT-Java-1.1B_Q3_K_M.gguf) | Q3_K_M | 3 | 20.36 GB| 22.86 GB | very small, high quality loss |
114
  | [NT-Java-1.1B_Q4_0.gguf](https://huggingface.co/infosys/NT-Java-1.1B-GGUF/blob/main/NT-Java-1.1B_Q4_0.gguf) | Q4_0 | 4 | 26.44 GB| 28.94 GB | legacy; small, very high quality loss - prefer using Q3_K_M |
115
  | [NT-Java-1.1B_Q4_K_M.gguf](https://huggingface.co/infosys/NT-Java-1.1B-GGUF/blob/main/NT-Java-1.1B_Q4_K_M.gguf) | Q4_K_M | 4 | 26.44 GB| 28.94 GB | medium, balanced quality - recommended |
 
109
 
110
  | Name | Quant method | Bits | Size | Max RAM required | Use case |
111
  | ---- | ---- | ---- | ---- | ---- | ----- |
112
+ | [NT-Java-1.1B_Q2_K.gguf](https://huggingface.co/infosys/NT-Java-1.1B-GGUF/blob/main/NT-Java-1.1B_Q2_K.gguf) | Q2_K | 2 | 15.64 GB| 18.14 GB | smallest, significant quality loss - not recommended for most purposes |
113
  | [NT-Java-1.1B_Q3_K_M.gguf](https://huggingface.co/infosys/NT-Java-1.1B-GGUF/blob/main/NT-Java-1.1B_Q3_K_M.gguf) | Q3_K_M | 3 | 20.36 GB| 22.86 GB | very small, high quality loss |
114
  | [NT-Java-1.1B_Q4_0.gguf](https://huggingface.co/infosys/NT-Java-1.1B-GGUF/blob/main/NT-Java-1.1B_Q4_0.gguf) | Q4_0 | 4 | 26.44 GB| 28.94 GB | legacy; small, very high quality loss - prefer using Q3_K_M |
115
  | [NT-Java-1.1B_Q4_K_M.gguf](https://huggingface.co/infosys/NT-Java-1.1B-GGUF/blob/main/NT-Java-1.1B_Q4_K_M.gguf) | Q4_K_M | 4 | 26.44 GB| 28.94 GB | medium, balanced quality - recommended |