Add files using upload-large-folder tool
Browse filesThis view is limited to 50 files because it contains too many changes.
See raw diff
- README.md +35 -0
- config.json +0 -0
- model-00001-of-00051.safetensors +3 -0
- model-00002-of-00051.safetensors +3 -0
- model-00003-of-00051.safetensors +3 -0
- model-00004-of-00051.safetensors +3 -0
- model-00005-of-00051.safetensors +3 -0
- model-00006-of-00051.safetensors +3 -0
- model-00007-of-00051.safetensors +3 -0
- model-00008-of-00051.safetensors +3 -0
- model-00009-of-00051.safetensors +3 -0
- model-00010-of-00051.safetensors +3 -0
- model-00011-of-00051.safetensors +3 -0
- model-00012-of-00051.safetensors +3 -0
- model-00013-of-00051.safetensors +3 -0
- model-00014-of-00051.safetensors +3 -0
- model-00015-of-00051.safetensors +3 -0
- model-00016-of-00051.safetensors +3 -0
- model-00017-of-00051.safetensors +3 -0
- model-00018-of-00051.safetensors +3 -0
- model-00019-of-00051.safetensors +3 -0
- model-00020-of-00051.safetensors +3 -0
- model-00021-of-00051.safetensors +3 -0
- model-00022-of-00051.safetensors +3 -0
- model-00023-of-00051.safetensors +3 -0
- model-00024-of-00051.safetensors +3 -0
- model-00025-of-00051.safetensors +3 -0
- model-00026-of-00051.safetensors +3 -0
- model-00027-of-00051.safetensors +3 -0
- model-00028-of-00051.safetensors +3 -0
- model-00029-of-00051.safetensors +3 -0
- model-00030-of-00051.safetensors +3 -0
- model-00031-of-00051.safetensors +3 -0
- model-00032-of-00051.safetensors +3 -0
- model-00033-of-00051.safetensors +3 -0
- model-00034-of-00051.safetensors +3 -0
- model-00035-of-00051.safetensors +3 -0
- model-00036-of-00051.safetensors +3 -0
- model-00037-of-00051.safetensors +3 -0
- model-00038-of-00051.safetensors +3 -0
- model-00039-of-00051.safetensors +3 -0
- model-00040-of-00051.safetensors +3 -0
- model-00041-of-00051.safetensors +3 -0
- model-00042-of-00051.safetensors +3 -0
- model-00043-of-00051.safetensors +3 -0
- model-00044-of-00051.safetensors +3 -0
- model-00045-of-00051.safetensors +3 -0
- model-00046-of-00051.safetensors +3 -0
- model-00047-of-00051.safetensors +3 -0
- model-00048-of-00051.safetensors +3 -0
README.md
ADDED
@@ -0,0 +1,35 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
---
|
2 |
+
license: mit
|
3 |
+
library_name: transformers
|
4 |
+
tags:
|
5 |
+
- mlx
|
6 |
+
base_model: deepseek-ai/DeepSeek-R1
|
7 |
+
---
|
8 |
+
|
9 |
+
# mlx-community/DeepSeek-R1-qm_4_2
|
10 |
+
|
11 |
+
The Model [mlx-community/DeepSeek-R1-qm_4_2](https://huggingface.co/mlx-community/DeepSeek-R1-qm_4_2) was
|
12 |
+
converted to MLX format from [deepseek-ai/DeepSeek-R1](https://huggingface.co/deepseek-ai/DeepSeek-R1)
|
13 |
+
using mlx-lm version **0.21.6**.
|
14 |
+
|
15 |
+
## Use with mlx
|
16 |
+
|
17 |
+
```bash
|
18 |
+
pip install mlx-lm
|
19 |
+
```
|
20 |
+
|
21 |
+
```python
|
22 |
+
from mlx_lm import load, generate
|
23 |
+
|
24 |
+
model, tokenizer = load("mlx-community/DeepSeek-R1-qm_4_2")
|
25 |
+
|
26 |
+
prompt = "hello"
|
27 |
+
|
28 |
+
if tokenizer.chat_template is not None:
|
29 |
+
messages = [{"role": "user", "content": prompt}]
|
30 |
+
prompt = tokenizer.apply_chat_template(
|
31 |
+
messages, add_generation_prompt=True
|
32 |
+
)
|
33 |
+
|
34 |
+
response = generate(model, tokenizer, prompt=prompt, verbose=True)
|
35 |
+
```
|
config.json
ADDED
The diff for this file is too large to render.
See raw diff
|
|
model-00001-of-00051.safetensors
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:7bb446e379beb6b45309967c45e23d0f396a4025b76ad7d9d4f89de07fe20201
|
3 |
+
size 5184111299
|
model-00002-of-00051.safetensors
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:28ffacb2fd213749e63a907c19249d7e4d897e477d7c701fa0a36e345b79cd34
|
3 |
+
size 4946789735
|
model-00003-of-00051.safetensors
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:9dc8b565136468113d42b2267c22131ef72be89b787d8461254a7938ff1106d3
|
3 |
+
size 5291967758
|
model-00004-of-00051.safetensors
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:9fabff48c148e022aaf2edc00f42eea58a62d7da1cc02e4ed949a292034d385f
|
3 |
+
size 4822205833
|
model-00005-of-00051.safetensors
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:163bc95cfe43006142adfff7b9ebd3f5f5a227192caa8582697dc70c5c8c3a45
|
3 |
+
size 5291967774
|
model-00006-of-00051.safetensors
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:8093f4633e8bc0b25c4c157befcc23f6777ea5430ebb2dd04f6c3d523957fd1e
|
3 |
+
size 4822205843
|
model-00007-of-00051.safetensors
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:dd3d0b70b197bd3853b8e9bf80f5d5756dd821623b67e871ac1b30ed60716153
|
3 |
+
size 5291967800
|
model-00008-of-00051.safetensors
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:f5f90f3914933be40ff67d1b4246e9407a740284a9f431a26ba5abe3cd986535
|
3 |
+
size 4946789812
|
model-00009-of-00051.safetensors
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:67edc19d8b9cda5678d3dc1ced8a0d6cb3796efd6e1f27a0c27b44b95122d425
|
3 |
+
size 5291967762
|
model-00010-of-00051.safetensors
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:36b301965e8a708c9331f5e6c0a9e834f16865deb3ecc15154b4bf7cf32d0f3b
|
3 |
+
size 4822205866
|
model-00011-of-00051.safetensors
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:83e0bf1245caa0c639c952a2d5ef1c1e10073b8e45f69a9c286d64090c9266ed
|
3 |
+
size 5291967782
|
model-00012-of-00051.safetensors
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:a22a191c0a9bd8fc85391b41040db1869c47459544844b1dc4001b495e96eb83
|
3 |
+
size 4822205890
|
model-00013-of-00051.safetensors
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:b175061e71dd09fdee5a93586fa20bb536c45e6e5e2c8892201f279b1c2c9224
|
3 |
+
size 5291967782
|
model-00014-of-00051.safetensors
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:dcdd7120ed045fdcb50f67856289104bef795562db2fc9c8aa38d1f6f0d27bc3
|
3 |
+
size 4946789810
|
model-00015-of-00051.safetensors
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:3649b9e3ed8df50313c758a599188e7fb21fb95c3c23c34b98f3f0a757e3c344
|
3 |
+
size 5291967814
|
model-00016-of-00051.safetensors
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:6cc1f598bed8e5db0c075cbc641300900b09c927b114a80bb2c29ad7cdc01ca8
|
3 |
+
size 4822205850
|
model-00017-of-00051.safetensors
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:0d8993aa8ba81f62372f3f3119be63a990ea9e1ff3d831e19b6cc4944fa5eb8f
|
3 |
+
size 5291967772
|
model-00018-of-00051.safetensors
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:4e2f9b92d23d415ada3df72dbb63342b06528eac20a75a7b852ca30bd79ca652
|
3 |
+
size 4822205892
|
model-00019-of-00051.safetensors
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:5fa028e51bdd9251dc3e0f52cea991cf1faa184399e533f672196d688afe48e3
|
3 |
+
size 5291967816
|
model-00020-of-00051.safetensors
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:ef332a7dd6dbe9a1ba0d49d7b81485751d681c5ecd16490f0f0c8ef3cede9aa9
|
3 |
+
size 4946789814
|
model-00021-of-00051.safetensors
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:3bc2ae2c846da83aae08bc161a4d2f0e0d9c254c6f659b6199c49b93de2ce56c
|
3 |
+
size 5291967814
|
model-00022-of-00051.safetensors
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:e110ebfea36e057728123f570435084512f63216a65454afba7eec1b6707cea3
|
3 |
+
size 4822205822
|
model-00023-of-00051.safetensors
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:8c0c4f484d92d099263f518a86e4488753d70cbe84868681d1939065c038c7ae
|
3 |
+
size 5291967806
|
model-00024-of-00051.safetensors
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:2cff99950d403baaabb40d1e6eb55477fb41c9d4427dfaf1565cba1da33a9232
|
3 |
+
size 4822205888
|
model-00025-of-00051.safetensors
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:ab376d9c7285490c0b50f2143c56cbe231ee54653eeb5787be157d142f8f243b
|
3 |
+
size 5291967816
|
model-00026-of-00051.safetensors
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:39afb6eb8fadab15f5689680e20773ca51c4563176a932dc8d166aa6fcf81642
|
3 |
+
size 4946789808
|
model-00027-of-00051.safetensors
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:5bbc74c0f56bfdf451fac49ce3b449b71344d74545b4e0d98383b129b66206d1
|
3 |
+
size 5291967750
|
model-00028-of-00051.safetensors
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:77e423b6625cc3932d6b9093d4db085b4e3edbf4fadabb4cd18de26326eb1372
|
3 |
+
size 4822205846
|
model-00029-of-00051.safetensors
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:e0b19d0ad9f31d109c88be000c4f7c352ccbb5596c6c4861a34c1423de836115
|
3 |
+
size 5291967812
|
model-00030-of-00051.safetensors
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:8230d652ce9260510fd9d59a5969cfdc55a97cd1ce4988153804bb743ebfbb63
|
3 |
+
size 4822205890
|
model-00031-of-00051.safetensors
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:18589e1d80b7d5373a5eb20663ee1a7b67948f445793695500eb1220db620e29
|
3 |
+
size 5291967814
|
model-00032-of-00051.safetensors
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:1939fe77dc56e029297373ba39254b376e84a680111def1baa9d466bcc861b59
|
3 |
+
size 4946789812
|
model-00033-of-00051.safetensors
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:01b3757f8f3700067622d0027e442bb6fc3ed72eb00a5fca0e2d214a6f0f59a0
|
3 |
+
size 5291967814
|
model-00034-of-00051.safetensors
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:321df695e52a8f2fbd76178a4c4ad576ab6dd9da83df1c0819641c3d0fde047b
|
3 |
+
size 4822205870
|
model-00035-of-00051.safetensors
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:544e3a537f2ed47325a817fd1154bb84340c600838e6e1eaf356fb11c547b0f1
|
3 |
+
size 5291967764
|
model-00036-of-00051.safetensors
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:da976237e56e115fba2fc88ff4d11e7afe0b53eccb291763a325ee8837921ec8
|
3 |
+
size 4822205890
|
model-00037-of-00051.safetensors
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:bebcfe0b012159356073c7af2a793770ea8f8d76b018eb96e9f3e43c9854333c
|
3 |
+
size 5291967814
|
model-00038-of-00051.safetensors
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:fbd01cfccaee1beea8f1f581435d34687c17496716c5fcfd89fd828facc8435e
|
3 |
+
size 4946789802
|
model-00039-of-00051.safetensors
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:2c28a646f8b4d24c3e615d32b6cce695e06d629f0d62c4abd8e0ad21d448133c
|
3 |
+
size 5291967720
|
model-00040-of-00051.safetensors
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:49d0769c976233219d60d8d3df36c761ea0f2f1f2db284387c4151f2f74d14a5
|
3 |
+
size 4822205896
|
model-00041-of-00051.safetensors
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:41a4d06374350c54c3dd638339c86724fd2c350bf91fda32fe5dee5a0f5dd561
|
3 |
+
size 5291967814
|
model-00042-of-00051.safetensors
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:806336dbd402568844894dbec9ea2a0198de6c25479b7625ef9ccf714fe6fb8a
|
3 |
+
size 4822205892
|
model-00043-of-00051.safetensors
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:edbc541edb0b7ddd1cb6f3e1c43a141fc11988c8f25a55ba14fb30633ce062f5
|
3 |
+
size 5291967816
|
model-00044-of-00051.safetensors
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:e120e3427c7c73ad3bbf1ed7b37405df9250140656075fddcf9accaac37c13fb
|
3 |
+
size 4946789796
|
model-00045-of-00051.safetensors
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:493a3ad74b6d5f86b227e59e21114079dde8dde8213041d1dbef921ba82c6165
|
3 |
+
size 5291967768
|
model-00046-of-00051.safetensors
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:d94e1d24b72945bc4b225caefaa1b5fbfc4df239127be36f01242f839758363d
|
3 |
+
size 4822205858
|
model-00047-of-00051.safetensors
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:5f4ac0c46123e9b0337dc8fea1a3be1f81d9ab07f7fdb609459ddd1931c0452a
|
3 |
+
size 5291967814
|
model-00048-of-00051.safetensors
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:062aa98c97c2af025c611ad597b8599bb1d5c712d04614e9cda5ff35c1f9a03c
|
3 |
+
size 4822205892
|