bobig commited on
Commit
aa16586
·
verified ·
1 Parent(s): f9e6678

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +47 -0
README.md ADDED
@@ -0,0 +1,47 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ library_name: transformers
3
+ tags:
4
+ - Cubed Reasoning
5
+ - QwQ-32B
6
+ - reasoning
7
+ - thinking
8
+ - r1
9
+ - cot
10
+ - deepseek
11
+ - Qwen2.5
12
+ - Hermes
13
+ - DeepHermes
14
+ - DeepSeek
15
+ - DeepSeek-R1-Distill
16
+ - 128k context
17
+ - merge
18
+ - mlx
19
+ - mlx-my-repo
20
+ base_model: DavidAU/Qwen2.5-QwQ-37B-Eureka-Triple-Cubed
21
+ ---
22
+
23
+ # bobig/Qwen2.5-QwQ-37B-Eureka-Triple-Cubed-mlx-4Bit
24
+
25
+ The Model [bobig/Qwen2.5-QwQ-37B-Eureka-Triple-Cubed-mlx-4Bit](https://huggingface.co/bobig/Qwen2.5-QwQ-37B-Eureka-Triple-Cubed-mlx-4Bit) was converted to MLX format from [DavidAU/Qwen2.5-QwQ-37B-Eureka-Triple-Cubed](https://huggingface.co/DavidAU/Qwen2.5-QwQ-37B-Eureka-Triple-Cubed) using mlx-lm version **0.21.5**.
26
+
27
+ ## Use with mlx
28
+
29
+ ```bash
30
+ pip install mlx-lm
31
+ ```
32
+
33
+ ```python
34
+ from mlx_lm import load, generate
35
+
36
+ model, tokenizer = load("bobig/Qwen2.5-QwQ-37B-Eureka-Triple-Cubed-mlx-4Bit")
37
+
38
+ prompt="hello"
39
+
40
+ if hasattr(tokenizer, "apply_chat_template") and tokenizer.chat_template is not None:
41
+ messages = [{"role": "user", "content": prompt}]
42
+ prompt = tokenizer.apply_chat_template(
43
+ messages, tokenize=False, add_generation_prompt=True
44
+ )
45
+
46
+ response = generate(model, tokenizer, prompt=prompt, verbose=True)
47
+ ```