mlx-community/quantized-gemma-2b-it
Text Generation
•
Updated
•
582
•
10
Quantized MLX LLMs
-
-
mlx-community/Meta-Llama-3.1-8B-Instruct-4bit
Text Generation • Updated • 507k • 15 -
mlx-community/Mistral-Large-Instruct-2407-4bit
Updated • 83.7k • 1 -
mlx-community/Phi-3-mini-4k-instruct-4bit-no-q-embed
Text Generation • Updated • 204 • 3 -
mlx-community/Dolphin-2.9.3-Mistral-Nemo-12b-4bit
Updated • 20 -
mlx-community/dolphin-2.9.4-gemma2-2b-4bit
Updated • 7 • 2 -
mlx-community/zephyr-7b-beta-4bit
Text Generation • Updated • 14 • 1