HandH1998's picture

13

HandH1998

HandH1998

·

HandH1998

AI & ML interests

None yet

Recent Activity

new activity 3 days ago

meituan/DeepSeek-R1-Channel-INT8:Update inference/bf16_cast_channel_int8.py

new activity 3 days ago

meituan/DeepSeek-R1-Channel-INT8:Update config.json

new activity 3 days ago

meituan/DeepSeek-R1-Block-INT8:After deploying with the latest sglang, I found that the responses when calling the interface were chaotic.

View all activity

Organizations

HandH1998's activity

New activity in meituan/DeepSeek-R1-Channel-INT8 3 days ago

Update inference/bf16_cast_channel_int8.py

#10 opened 3 days ago by

Update config.json

#9 opened 3 days ago by

New activity in meituan/DeepSeek-R1-Block-INT8 3 days ago

After deploying with the latest sglang, I found that the responses when calling the interface were chaotic.

#13 opened 12 days ago by

New activity in meituan/DeepSeek-R1-Block-INT8 8 days ago

是否有明确的sglang镜像版本推荐：）

#14 opened 8 days ago by

New activity in meituan/DeepSeek-R1-Channel-INT8 8 days ago

Add `quantization_config` in config.json?

#4 opened 10 days ago by

运行channel INT8后sglang报错OOM

#3 opened 12 days ago by

New activity in meituan/DeepSeek-R1-Block-INT8 12 days ago

量化类型

#11 opened 15 days ago by

New activity in meituan/DeepSeek-R1-Channel-INT8 16 days ago

Difference with Block-wise Int8?

#1 opened 17 days ago by

Update README.md

#2 opened 16 days ago by

New activity in meituan/DeepSeek-R1-Block-INT8 16 days ago

Why hasn't the model file size changed?

#9 opened 16 days ago by

New activity in meituan/DeepSeek-R1-Block-INT8 18 days ago

Update README.md

#8 opened 18 days ago by

Update inference/bf16_cast_block_int8.py

#7 opened 18 days ago by

New activity in cognitivecomputations/DeepSeek-V3-AWQ 23 days ago

What calibration dataset do you use when applying AWQ?

#5 opened 30 days ago by

New activity in cognitivecomputations/DeepSeek-V3-AWQ 30 days ago

What calibration dataset do you use when applying AWQ?

#5 opened 30 days ago by