cgus
/

Text Generation
English
exllamav2
qwen2
conversational
4-bit precision
exl2
cgus commited on
Commit
8d052fd
·
verified ·
1 Parent(s): 459f06f

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +17 -3
README.md CHANGED
@@ -1,6 +1,6 @@
1
  ---
2
  license: mit
3
- library_name: transformers
4
  datasets:
5
  - PrimeIntellect/verifiable-coding-problems
6
  - likaixin/TACO-verified
@@ -8,10 +8,24 @@ datasets:
8
  language:
9
  - en
10
  base_model:
11
- - deepseek-ai/DeepSeek-R1-Distill-Qwen-1.5B
12
  pipeline_tag: text-generation
13
  ---
14
-
 
 
 
 
 
 
 
 
 
 
 
 
 
 
15
  <div align="center">
16
  <span style="font-family: default; font-size: 1.5em;">DeepCoder-1.5B-Preview</span>
17
  <div>
 
1
  ---
2
  license: mit
3
+ library_name: exllamav2
4
  datasets:
5
  - PrimeIntellect/verifiable-coding-problems
6
  - likaixin/TACO-verified
 
8
  language:
9
  - en
10
  base_model:
11
+ - agentica-org/DeepCoder-1.5B-Preview
12
  pipeline_tag: text-generation
13
  ---
14
+ # DeepCoder-1.5B-Preview-exl2
15
+ Original model: [DeepCoder-1.5B-Preview](https://huggingface.co/agentica-org/DeepCoder-1.5B-Preview) by [Agentica](https://huggingface.co/agentica-org)
16
+ Based on: [DeepSeek-R1-Distill-Qwen-1.5B](https://huggingface.co/deepseek-ai/DeepSeek-R1-Distill-Qwen-1.5B) by [DeepSeek](https://huggingface.co/deepseek-ai)
17
+ Foundation model: [Qwen2.5-1.5B](https://huggingface.co/Qwen/Qwen2.5-1.5B) by [Qwen](https://huggingface.co/Qwen)
18
+
19
+ ## Quants
20
+ [4bpw h6 (main)](https://huggingface.co/cgus/DeepCoder-1.5B-Preview-exl2/tree/main)
21
+ [4.5bpw h6](https://huggingface.co/cgus/DeepCoder-1.5B-Preview-exl2/tree/4.5bpw-h6)
22
+ [5bpw h6](https://huggingface.co/cgus/DeepCoder-1.5B-Preview-exl2/tree/5bpw-h6)
23
+ [6bpw h6](https://huggingface.co/cgus/DeepCoder-1.5B-Preview-exl2/tree/6bpw-h6)
24
+ [8bpw h8](https://huggingface.co/cgus/DeepCoder-1.5B-Preview-exl2/tree/8bpw-h8)
25
+ ## Quantization notes
26
+ Made with Exllamav2 0.2.8 with default dataset.
27
+ These quants can be used with TabbyAPI or Text-Generation-WebUI and require RTX GPU (Windows) or RTX/ROCm (Linux).
28
+ # Original model card
29
  <div align="center">
30
  <span style="font-family: default; font-size: 1.5em;">DeepCoder-1.5B-Preview</span>
31
  <div>