AXERA-TECH
/

DeepSeek-R1-Distill-Qwen-1.5B-GPTQ-Int4

DeepSeek-R1-Distill-Qwen-1.5B

DeepSeek-R1-Distill-Qwen-1.5B-GPTQ-Int4

Inference Endpoints

Model card Files Files and versions Community

qqc1989 commited on 2 days ago

Commit

496f830

·

verified ·

1 Parent(s): dd8dc18

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -68,7 +68,7 @@ pip install transformers==4.41.1
 #### Start the Tokenizer service
 ```
-root@ax650:/mnt/qtang/llm-test/deepseek-r1-1.5b# python3 deepseek-r1_tokenizer.py --port 12346
 151646 <｜begin▁of▁sentence｜> 151643 <｜end▁of▁sentence｜>
 <｜begin▁of▁sentence｜>You are DeepSeek-R1, You are a helpful assistant.<｜User｜>hello world<｜Assistant｜>
 [151646, 151646, 2610, 525, 18183, 39350, 10911, 16, 11, 1446, 525, 264, 10950, 17847, 13, 151644, 14990, 1879, 151645]

 #### Start the Tokenizer service
 ```
+root@ax650:/mnt/qtang/llm-test/deepseek-r1-1.5b# python3 deepseek-r1_tokenizer.py --port 12345
 151646 <｜begin▁of▁sentence｜> 151643 <｜end▁of▁sentence｜>
 <｜begin▁of▁sentence｜>You are DeepSeek-R1, You are a helpful assistant.<｜User｜>hello world<｜Assistant｜>
 [151646, 151646, 2610, 525, 18183, 39350, 10911, 16, 11, 1446, 525, 264, 10950, 17847, 13, 151644, 14990, 1879, 151645]