AlejandroOlmedo
/

OpenThinker-7B-4bit-mlx

Text Generation

Generated from Trainer

text-generation-inference

4-bit precision

Model card Files Files and versions Community

AlejandroOlmedo commited on Feb 15

Commit

fc0f65c

·

verified ·

1 Parent(s): 976ff2c

Update README.md

Files changed (1) hide show

README.md +5 -5

README.md CHANGED Viewed

@@ -31,12 +31,12 @@ I simply converted it to MLX format (using mlx-lm version **0.21.4**.) with a qu
 ## Other Types:
 | Link | Type | Size| Notes |
 |-------|-----------|-----------|-----------|
-| [MLX] (https://huggingface.co/Alejandroolmedo/OpenThinker-7B-8bit-mlx) | 8-bit | 8.10 GB | **Best Quality** |
-| [MLX] (https://huggingface.co/Alejandroolmedo/OpenThinker-7B-4bit-mlx) | 4-bit | 4.30 GB | Good Quality|
-# Alejandroolmedo/OpenThinker-7B-4bit-mlx
-The Model [Alejandroolmedo/OpenThinker-7B-4bit-mlx](https://huggingface.co/Alejandroolmedo/OpenThinker-7B-4bit-mlx) was
 converted to MLX format from [open-thoughts/OpenThinker-7B](https://huggingface.co/open-thoughts/OpenThinker-7B)
 using mlx-lm version **0.21.4**.
@@ -49,7 +49,7 @@ pip install mlx-lm
 ```python
 from mlx_lm import load, generate
-model, tokenizer = load("Alejandroolmedo/OpenThinker-7B-4bit-mlx")
 prompt = "hello"

 ## Other Types:
 | Link | Type | Size| Notes |
 |-------|-----------|-----------|-----------|
+| [MLX] (https://huggingface.co/AlejandroOlmedo/OpenThinker-7B-8bit-mlx) | 8-bit | 8.10 GB | **Best Quality** |
+| [MLX] (https://huggingface.co/AlejandroOlmedo/OpenThinker-7B-4bit-mlx) | 4-bit | 4.30 GB | Good Quality|
+# AlejandroOlmedo/OpenThinker-7B-4bit-mlx
+The Model [AlejandroOlmedo/OpenThinker-7B-4bit-mlx](https://huggingface.co/AlejandroOlmedo/OpenThinker-7B-4bit-mlx) was
 converted to MLX format from [open-thoughts/OpenThinker-7B](https://huggingface.co/open-thoughts/OpenThinker-7B)
 using mlx-lm version **0.21.4**.
 ```python
 from mlx_lm import load, generate
+model, tokenizer = load("AlejandroOlmedo/OpenThinker-7B-4bit-mlx")
 prompt = "hello"