Hugging Face's logo

mlx-community
/
DeepSeek-R1-2bit

Text Generation
Transformers
Safetensors
MLX
deepseek_v3
conversational
custom_code
2-bit
Model card Files Community
awni commited on
Commit
88cc573
·
verified ·
1 Parent(s): 2cb88fb

Add files using upload-large-folder tool

Browse files
This view is limited to 50 files because it contains too many changes.   See raw diff
Files changed (50) hide show
  1. README.md +4 -2
  2. config.json +2 -2
  3. model-00001-of-00050.safetensors +3 -0
  4. model-00002-of-00050.safetensors +3 -0
  5. model-00003-of-00050.safetensors +3 -0
  6. model-00004-of-00050.safetensors +3 -0
  7. model-00005-of-00050.safetensors +3 -0
  8. model-00006-of-00050.safetensors +3 -0
  9. model-00007-of-00050.safetensors +3 -0
  10. model-00008-of-00050.safetensors +3 -0
  11. model-00009-of-00050.safetensors +3 -0
  12. model-00010-of-00050.safetensors +3 -0
  13. model-00011-of-00050.safetensors +3 -0
  14. model-00012-of-00050.safetensors +3 -0
  15. model-00013-of-00050.safetensors +3 -0
  16. model-00014-of-00050.safetensors +3 -0
  17. model-00015-of-00050.safetensors +3 -0
  18. model-00016-of-00050.safetensors +3 -0
  19. model-00017-of-00050.safetensors +3 -0
  20. model-00018-of-00050.safetensors +3 -0
  21. model-00019-of-00050.safetensors +3 -0
  22. model-00020-of-00050.safetensors +3 -0
  23. model-00021-of-00050.safetensors +3 -0
  24. model-00022-of-00050.safetensors +3 -0
  25. model-00023-of-00050.safetensors +3 -0
  26. model-00024-of-00050.safetensors +3 -0
  27. model-00025-of-00050.safetensors +3 -0
  28. model-00026-of-00050.safetensors +3 -0
  29. model-00027-of-00050.safetensors +3 -0
  30. model-00028-of-00050.safetensors +3 -0
  31. model-00029-of-00050.safetensors +3 -0
  32. model-00030-of-00050.safetensors +3 -0
  33. model-00031-of-00050.safetensors +3 -0
  34. model-00032-of-00050.safetensors +3 -0
  35. model-00033-of-00050.safetensors +3 -0
  36. model-00034-of-00050.safetensors +3 -0
  37. model-00035-of-00050.safetensors +3 -0
  38. model-00036-of-00050.safetensors +3 -0
  39. model-00037-of-00050.safetensors +3 -0
  40. model-00038-of-00050.safetensors +3 -0
  41. model-00039-of-00050.safetensors +3 -0
  42. model-00040-of-00050.safetensors +3 -0
  43. model-00041-of-00050.safetensors +3 -0
  44. model-00042-of-00050.safetensors +3 -0
  45. model-00043-of-00050.safetensors +3 -0
  46. model-00044-of-00050.safetensors +3 -0
  47. model-00045-of-00050.safetensors +3 -0
  48. model-00046-of-00050.safetensors +3 -0
  49. model-00047-of-00050.safetensors +3 -0
  50. model-00048-of-00050.safetensors +3 -0
README.md CHANGED
@@ -1,4 +1,6 @@
1
  ---
 
 
2
  base_model: deepseek-ai/DeepSeek-R1
3
  tags:
4
  - mlx
@@ -8,7 +10,7 @@ tags:
8
 
9
  The Model [mlx-community/DeepSeek-R1-2bit](https://huggingface.co/mlx-community/DeepSeek-R1-2bit) was
10
  converted to MLX format from [deepseek-ai/DeepSeek-R1](https://huggingface.co/deepseek-ai/DeepSeek-R1)
11
- using mlx-lm version **0.21.3**.
12
 
13
  ## Use with mlx
14
 
@@ -30,4 +32,4 @@ if tokenizer.chat_template is not None:
30
  )
31
 
32
  response = generate(model, tokenizer, prompt=prompt, verbose=True)
33
- ```
 
1
  ---
2
+ license: mit
3
+ library_name: transformers
4
  base_model: deepseek-ai/DeepSeek-R1
5
  tags:
6
  - mlx
 
10
 
11
  The Model [mlx-community/DeepSeek-R1-2bit](https://huggingface.co/mlx-community/DeepSeek-R1-2bit) was
12
  converted to MLX format from [deepseek-ai/DeepSeek-R1](https://huggingface.co/deepseek-ai/DeepSeek-R1)
13
+ using mlx-lm version **0.21.6**.
14
 
15
  ## Use with mlx
16
 
 
32
  )
33
 
34
  response = generate(model, tokenizer, prompt=prompt, verbose=True)
35
+ ```
config.json CHANGED
@@ -37,11 +37,11 @@
37
  "qk_nope_head_dim": 128,
38
  "qk_rope_head_dim": 64,
39
  "quantization": {
40
- "group_size": 64,
41
  "bits": 2
42
  },
43
  "quantization_config": {
44
- "group_size": 64,
45
  "bits": 2
46
  },
47
  "rms_norm_eps": 1e-06,
 
37
  "qk_nope_head_dim": 128,
38
  "qk_rope_head_dim": 64,
39
  "quantization": {
40
+ "group_size": 32,
41
  "bits": 2
42
  },
43
  "quantization_config": {
44
+ "group_size": 32,
45
  "bits": 2
46
  },
47
  "rms_norm_eps": 1e-06,
model-00001-of-00050.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:43e337c38b52393b78dcadda481da149bd127cbbccb18f56cbb5c44e866ec9c4
3
+ size 5348389439
model-00002-of-00050.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e7bf2e89c323378dec8fb179126fd51ce1a5eb5546e926dbe5d0c9ee9d079a41
3
+ size 5301810784
model-00003-of-00050.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7e9a5194c0a984e4bad2fe58b01d373ecaead62bba957fec6a2e7543d4667d41
3
+ size 4788008353
model-00004-of-00050.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7e69cd1b5870514e64a3e2ff5d5dc83c47c31e5a155013ba565fef2a772abe8d
3
+ size 5257770270
model-00005-of-00050.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d0baf97afbe7750f98b1cd8a08e215da82823e239d7b290054af57d7812daa4c
3
+ size 4788008349
model-00006-of-00050.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f6910aa40aefeccc1c4151f6a7754b747b6a4a652239e11a3fbddbb82a07514d
3
+ size 5257770274
model-00007-of-00050.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7c8ea924ed35e3729c1b97bb7822fc97bb1f198e6d113581687ffb500f23bfa8
3
+ size 4878394783
model-00008-of-00050.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:575b20f8a0156b97ec10c102ed6e64bb353c43d78bebc9f29332161228f025c6
3
+ size 5257770230
model-00009-of-00050.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8703e97c9d8f40905217c092cb161a244acc66d046c91c4e4e94e0c29cd2088f
3
+ size 4788008366
model-00010-of-00050.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0bcf7e0178a9d4173661af6c96c29be283856ecaf2c00c398ec9da8f0b5bfde4
3
+ size 5257770278
model-00011-of-00050.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:19d1848577227f7826d53145f2ff6bfcee37ebc212b6af3d9b2fed261d2bda39
3
+ size 4788008354
model-00012-of-00050.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f9a9ffe71003b9fd86f4fbc91af44cecc858b5f16b25b06533f25948d3abd566
3
+ size 5257770314
model-00013-of-00050.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3e26adf5f2e680c0b3e736ccd72976a935a7aafe5629eca735cfb7357d4a0e4a
3
+ size 4878394774
model-00014-of-00050.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:09ba84fc7c5d149e2348464f4ad3c7f2fb475bebcb829bbd97f88c038361d171
3
+ size 5257770282
model-00015-of-00050.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9dc8b118eab7a665b073b04ba97a25207a4f22c693a652a2eef90ff71f899566
3
+ size 4788008392
model-00016-of-00050.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b6a000a997178a0836cea90ad52364d227e7b5a585d2c20868a2a54b91144d2f
3
+ size 5257770240
model-00017-of-00050.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:da196a44b60a20555a0ab1dae4b0de7ac91c9dfc9d8ce8478437332fc983e2ce
3
+ size 4788008390
model-00018-of-00050.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7dd85c7c6d23e7ceb9d0041384485ce0640a2bcef82822304f0449e42b57fd3f
3
+ size 5257770314
model-00019-of-00050.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8463cd59497a0e65e448b0b6eb2b3cafd136b018f0bbe4d78a044e985d979074
3
+ size 4878394792
model-00020-of-00050.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ca608aaa2c8fb803975b1481c0ec089d2f587f70c6d7ec18d8f3a48cf6959c08
3
+ size 5257770230
model-00021-of-00050.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d071ce383e7e630dcbdc8a7a22c97f9eab887751034f2581e30523e8d126e88c
3
+ size 4788008394
model-00022-of-00050.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6b7bdf96e6d1003f70f1276d3669a752cb9e6af69eec80c3b9df54332720dca2
3
+ size 5257770268
model-00023-of-00050.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e79abe93e1a727eb1cce684001fd3dbeaa480de81227b7c101e124eaaa0369d6
3
+ size 4788008376
model-00024-of-00050.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:176d03c3a8a7a0eec20f869a2fa5fc9be4ba9c0e9c16a7749a423597e5df4cda
3
+ size 5257770310
model-00025-of-00050.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:956183344ba9e3a4a434ccaf453bbbda1941b2d0a1053ceb31e3bd0282519534
3
+ size 4878394780
model-00026-of-00050.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b07dd8e8ffb1321f5e4a6bb1d903c3fb2dcbfd8e734e0e93480bb02dd793a68f
3
+ size 5257770226
model-00027-of-00050.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c7c016935cbcd18d701f2559fb9a4773580600392f8c3bbec1962602750c373b
3
+ size 4788008354
model-00028-of-00050.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c90f1981a0452d647b418352c7eee50c0427a8dcaa9e237851c3fc69aa88c988
3
+ size 5257770300
model-00029-of-00050.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8f261947fc374b56b4d613612854b794f6ac2076434ea8c44bcd5489f52b512d
3
+ size 4788008388
model-00030-of-00050.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:748ac82f72a8fa816a20cf8ed8814de5b993810f700f2149fae01772e321651d
3
+ size 5257770312
model-00031-of-00050.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0b0564754498ba2fed7c9780b9cf318bf0d3eb4bdc62354bfaa9d552c7b20cb6
3
+ size 4878394754
model-00032-of-00050.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8b6e20785689cc4fb429afffc79ace249180145a869ff0b729edb47c6972b077
3
+ size 5257770268
model-00033-of-00050.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6e6d510fe945a8fb97444afaaa38befb36a2c4c1c7c41545b81a0e3a4f52574a
3
+ size 4788008394
model-00034-of-00050.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:63f8034c7572dc58cddd90182411b3bfaf59a583a8d828b17b15ed348ef6eda0
3
+ size 5257770312
model-00035-of-00050.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6dc05593644e99480cc40b01bba569eb41242d8828651c50a11630d5282053fa
3
+ size 4788008376
model-00036-of-00050.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:cd7fa83d6992caa41551a87eceee32195b648d906df92712e92c97742f6f99e7
3
+ size 5257770314
model-00037-of-00050.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f2d771f323a15f0b693105279ebc483cb8c6250cafb73f4107df78c34ff96d97
3
+ size 4878394790
model-00038-of-00050.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:71ca196aa3a68ee07102af3a3a29fad24a87f2321b159941dd5a853e928d4cb8
3
+ size 5257770284
model-00039-of-00050.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fb97c740278c0d595c2f248944c4020577623315be3334297c25953d9f92b8f7
3
+ size 4788008366
model-00040-of-00050.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:69bb74e112cd6be9fa48197d35dbd1ffa20298a6194a8671434fb31045475ff1
3
+ size 5257770312
model-00041-of-00050.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:cbcd7a1cf5abfb8f15e4527d98462e3888a1efea343ebf7add349d1fb5d0fb46
3
+ size 4788008390
model-00042-of-00050.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e19f0f901e53e0850bf9ecd0feea852b71c12931084b6ecf74dea693efeb9a01
3
+ size 5257770314
model-00043-of-00050.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:be358e8a10f4960a36c56ff8dc9ae405eb23468a42ad13a6b26419268a54fec0
3
+ size 4878394780
model-00044-of-00050.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:116cdfe97720780703b88520e3b777f6118f872819b4633df45ebfd7d591d3ea
3
+ size 5257770238
model-00045-of-00050.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a705cbc7739d69e97076415a17a7ebf2a844b9b3b18b6519b29eb67e70a06c87
3
+ size 4788008372
model-00046-of-00050.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:23d2b9e138639afc33450da79d49d04e1dcaf49a5dab8d1270e8af9de7b592d2
3
+ size 5257770274
model-00047-of-00050.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f46600d3c47fd71b6cd3c58307f389f6b19a5b41da201aafa8ceb4fc86e6a820
3
+ size 4788008388
model-00048-of-00050.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2803509d16740128406054670244ee546a5468014ac203ab5bc7e51afbe02141
3
+ size 5257770314