Hugging Face's logo

AlejandroOlmedo
/
OpenThinker-7B-4bit-mlx

Text Generation
Transformers
Safetensors
MLX
qwen2
llama-factory
full
Generated from Trainer
conversational
text-generation-inference
4-bit precision
Model card Files Community
AlejandroOlmedo commited on
Commit
976ff2c
·
verified ·
1 Parent(s): c876735

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +6 -0
README.md CHANGED
@@ -28,6 +28,12 @@ model-index:
28
 
29
  I simply converted it to MLX format (using mlx-lm version **0.21.4**.) with a quantization of 4-bit for better performance on Apple Silicon Macs (M1,M2,M3,M4 Chips).
30
 
 
 
 
 
 
 
31
  # Alejandroolmedo/OpenThinker-7B-4bit-mlx
32
 
33
  The Model [Alejandroolmedo/OpenThinker-7B-4bit-mlx](https://huggingface.co/Alejandroolmedo/OpenThinker-7B-4bit-mlx) was
 
28
 
29
  I simply converted it to MLX format (using mlx-lm version **0.21.4**.) with a quantization of 4-bit for better performance on Apple Silicon Macs (M1,M2,M3,M4 Chips).
30
 
31
+ ## Other Types:
32
+ | Link | Type | Size| Notes |
33
+ |-------|-----------|-----------|-----------|
34
+ | [MLX] (https://huggingface.co/Alejandroolmedo/OpenThinker-7B-8bit-mlx) | 8-bit | 8.10 GB | **Best Quality** |
35
+ | [MLX] (https://huggingface.co/Alejandroolmedo/OpenThinker-7B-4bit-mlx) | 4-bit | 4.30 GB | Good Quality|
36
+
37
  # Alejandroolmedo/OpenThinker-7B-4bit-mlx
38
 
39
  The Model [Alejandroolmedo/OpenThinker-7B-4bit-mlx](https://huggingface.co/Alejandroolmedo/OpenThinker-7B-4bit-mlx) was