Introduction to ggml
•
229
AI & ML interests
None defined yet.
Recent Activity
Articles
Voice Activity Detection (VAD) models for whisper.cpp.
Models that are used for presets in llama.cpp.
Recommended models for the llama.vim and llama.vscode plugins
-
ggml-org/Qwen2.5-Coder-0.5B-Q8_0-GGUF
Text Generation • 0.5B • Updated • 4.91k • 6 -
ggml-org/Qwen2.5-Coder-1.5B-Q8_0-GGUF
Text Generation • 2B • Updated • 4.49k • 9 -
ggml-org/Qwen2.5-Coder-3B-Q8_0-GGUF
Text Generation • 3B • Updated • 1.41k • 5 -
ggml-org/Qwen2.5-Coder-7B-Q8_0-GGUF
Text Generation • 8B • Updated • 1.87k • 5
Vision and audio models compatible with llama-server and llama-mtmd-cli
-
ggml-org/gemma-3-1b-it-GGUF
1.0B • Updated • 10.4k • 15 -
ggml-org/gemma-3-4b-it-GGUF
Image-Text-to-Text • 4B • Updated • 18.5k • 33 -
ggml-org/gemma-3-12b-it-GGUF
Image-Text-to-Text • 12B • Updated • 3.64k • 25 -
ggml-org/gemma-3-27b-it-GGUF
Image-Text-to-Text • 27B • Updated • 2.25k • 21
Adapters extracted from fine tuned models, using mergekit-extract-lora
-
ggml-org/LoRA-Llama-3-Instruct-abliteration-8B-F16-GGUF
0.1B • Updated • 27 -
ggml-org/LoRA-Qwen2.5-1.5B-Instruct-abliterated-F16-GGUF
0.1B • Updated • 19 • 2 -
ggml-org/LoRA-Qwen2.5-3B-Instruct-abliterated-F16-GGUF
0.1B • Updated • 20 • 1 -
ggml-org/LoRA-Qwen2.5-7B-Instruct-abliterated-v3-F16-GGUF
0.1B • Updated • 33 • 3
Vision and audio models compatible with llama-server and llama-mtmd-cli
Voice Activity Detection (VAD) models for whisper.cpp.
-
ggml-org/gemma-3-1b-it-GGUF
1.0B • Updated • 10.4k • 15 -
ggml-org/gemma-3-4b-it-GGUF
Image-Text-to-Text • 4B • Updated • 18.5k • 33 -
ggml-org/gemma-3-12b-it-GGUF
Image-Text-to-Text • 12B • Updated • 3.64k • 25 -
ggml-org/gemma-3-27b-it-GGUF
Image-Text-to-Text • 27B • Updated • 2.25k • 21
Models that are used for presets in llama.cpp.
Adapters extracted from fine tuned models, using mergekit-extract-lora
-
ggml-org/LoRA-Llama-3-Instruct-abliteration-8B-F16-GGUF
0.1B • Updated • 27 -
ggml-org/LoRA-Qwen2.5-1.5B-Instruct-abliterated-F16-GGUF
0.1B • Updated • 19 • 2 -
ggml-org/LoRA-Qwen2.5-3B-Instruct-abliterated-F16-GGUF
0.1B • Updated • 20 • 1 -
ggml-org/LoRA-Qwen2.5-7B-Instruct-abliterated-v3-F16-GGUF
0.1B • Updated • 33 • 3
Recommended models for the llama.vim and llama.vscode plugins
-
ggml-org/Qwen2.5-Coder-0.5B-Q8_0-GGUF
Text Generation • 0.5B • Updated • 4.91k • 6 -
ggml-org/Qwen2.5-Coder-1.5B-Q8_0-GGUF
Text Generation • 2B • Updated • 4.49k • 9 -
ggml-org/Qwen2.5-Coder-3B-Q8_0-GGUF
Text Generation • 3B • Updated • 1.41k • 5 -
ggml-org/Qwen2.5-Coder-7B-Q8_0-GGUF
Text Generation • 8B • Updated • 1.87k • 5