sbnc commited on
Commit
c966d1c
·
verified ·
1 Parent(s): ae392bb

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +5 -0
README.md CHANGED
@@ -12,6 +12,11 @@ library_name: mlx
12
 
13
  # mlx-community/CodeLlama-34b-Instruct-hf-4bit-mlx
14
 
 
 
 
 
 
15
  This model [mlx-community/CodeLlama-34b-Instruct-hf-4bit-mlx](https://huggingface.co/mlx-community/CodeLlama-34b-Instruct-hf-4bit-mlx) was
16
  converted to MLX format from [codellama/CodeLlama-34b-Instruct-hf](https://huggingface.co/codellama/CodeLlama-34b-Instruct-hf)
17
  using mlx-lm version **0.23.2**.
 
12
 
13
  # mlx-community/CodeLlama-34b-Instruct-hf-4bit-mlx
14
 
15
+ As opposed to [mlx-community/CodeLlama-34b-Instruct-hf-4bit](https://huggingface.co/mlx-community/CodeLlama-34b-Instruct-hf-4bit), this
16
+ one is converted from the base model using a newer MLX-LM version which uses newer and improved quantization and generates model
17
+ in a more standard format. For context see [Issue#130](https://github.com/ml-explore/mlx-lm/issues/130) and [PR#114](https://github.com/ml-explore/mlx-lm/pull/114)
18
+ of the [MLX-LM](https://github.com/ml-explore/mlx-lm) repo.
19
+
20
  This model [mlx-community/CodeLlama-34b-Instruct-hf-4bit-mlx](https://huggingface.co/mlx-community/CodeLlama-34b-Instruct-hf-4bit-mlx) was
21
  converted to MLX format from [codellama/CodeLlama-34b-Instruct-hf](https://huggingface.co/codellama/CodeLlama-34b-Instruct-hf)
22
  using mlx-lm version **0.23.2**.