flyfishstudio/yarn-llama-2-7b-128k-Q4_0_4_4.gguf
7B
•
Updated
•
4
Q4_0_4_4-GGUF
GGUF dedicated for ARM NEON devices
-
-
flyfishstudio/Qwen2.5-3B-Instruct-Q4_0_4_4.gguf
3B • Updated • 7 -
flyfishstudio/rocket-3b-Q4_0_4_4.gguf
3B • Updated • 8 -
flyfishstudio/Gemma-2-Ataraxy-9B-Q4_0_4_4.gguf
9B • Updated • 4 -
flyfishstudio/openhermes-2.5-mistral-7b-Q4_0_4_4.gguf
7B • Updated • 183 -
flyfishstudio/meta-llama-3.1-8b-instruct-Q4_0_4_4.gguf
8B • Updated • 7 -
flyfishstudio/orca_mini_v3_7b-Q4_0_4_4.gguf
7B • Updated • 6 -
flyfishstudio/SmolLM-1.7B-Instruct-v0.2-Q4_0_4_4.gguf
2B • Updated • 8 -
flyfishstudio/Qwen1.5-1.8B-layla-v4-Q4_0_4_4.gguf
2B • Updated • 4 -
flyfishstudio/Mistral-7B-Instruct-v0.3-Q4_0_4_4.gguf
7B • Updated • 44 -
flyfishstudio/meta-llama-3.1-8b-instruct-abliterated-Q4_0_4_4.gguf
8B • Updated • 8 -
flyfishstudio/tinyllama-1.1b-chat-v1.0-Q4_0_4_4.gguf
1B • Updated • 22 -
flyfishstudio/Hermes-3-Llama-3.1-8B-Q4_0_4_4.gguf
8B • Updated • 31 -
flyfishstudio/qwen2-0_5b-instruct-Q4_0_4_4.gguf
0.5B • Updated • 11 -
flyfishstudio/Phi-3.5-mini-instruct_Uncensored-Q4_0_4_4.gguf
4B • Updated • 82 • 2 -
flyfishstudio/Phi-3.5-mini-instruct-Q4_0_4_4.gguf
4B • Updated • 42 • 1 -
flyfishstudio/Phi-3.1-mini-4k-instruct-Q4_0_4_4.gguf
4B • Updated • 20 -
flyfishstudio/llama-2-7b-chat-Q4_0_4_4.gguf
7B • Updated • 11 -
flyfishstudio/gemma_2_2b_it_v2-Q4_0_4_4.gguf
3B • Updated • 4 -
flyfishstudio/gemma-2-9b-it-abliterated-Q4_0_4_4.gguf
9B • Updated • 5 -
TheDrummer/Gemmasutra-Mini-2B-v1-GGUF
3B • Updated • 37.8k • 59 -
adamo1139/magnum-v2-4b-gguf-lowctx
5B • Updated • 61 -
ThomasBaruzier/Llama-3.1-Minitron-4B-Width-Base-GGUF
5B • Updated • 88 • 3 -
flyfishstudio/gemma-2-2b-it-abliterated-Q4_0_4_4.gguf
3B • Updated • 6