x2ray/wheels
Updated
LagPixelLOL
v2ray
AI & ML interests
Looking for compute sponsors, please contact me through my email [email protected]!
Recent Activity
updated
a model
about 3 hours ago
x2ray/wheels
updated
a dataset
about 21 hours ago
v2ray/r-chatgpt-general-dump
new activity
1 day ago
cognitivecomputations/DeepSeek-R1-AWQ:About the group size
Organizations
v2ray's activity
updated
a
model
about 3 hours ago
updated
a
dataset
about 21 hours ago
About the group size
1
#26 opened 1 day ago
by
Skyeaee
How can I quantify my BF16 format model into AWQ?
1
#25 opened 8 days ago
by
AlipaySimon
Support for inference with MTP module?
1
#23 opened 10 days ago
by
yhh001
poor performance for DeepSeek-V3-AWQ
2
#9 opened 15 days ago
by
fridayl
The V3-AWQ model's response seems not as expected
12
#8 opened 17 days ago
by
juxing
updated
a
model
18 days ago
published
a
model
18 days ago
Can't get 48 TPS on 8x H800
1
#21 opened 19 days ago
by
Light4Bear
gpt-4chan Neo-J
1
#1 opened 19 days ago
by
gman402
Pipeline Parallellism
1
#20 opened 19 days ago
by
leo98xh
8*a100 OUT OF MEMORY
1
#19 opened 19 days ago
by
Jaren
requests get stuck when sending long prompts (already solved, but still don't know why?)
1
#18 opened 19 days ago
by
uv0xab
Significant Speed Drop with Increasing Input Length on H800 GPUs
2
#17 opened 20 days ago
by
wangkkk956
Docker start with vllm failed. Official vllm docker image 0.7.3
1
#7 opened 20 days ago
by
kuliev-vitaly
when i use vllm v0.7.2 to deploy r1 awq, i got empty content
13
#10 opened 28 days ago
by
bupalinyu
why "MLA is not supported with awq_marlin quantization. Disabling MLA." with 4090 * 32 (4 node / vllm 0.7.2)
3
#14 opened 21 days ago
by
FightLLM
when i run command ,it didnot work. ( via vllm 0.7.3)
2
#16 opened 20 days ago
by
xueshuai