宋小猫

SongXiaoMao's activity

• All
• Models
• Datasets
• Spaces
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes
• Articles

New activity in unsloth/DeepSeek-R1-GGUF about 14 hours ago

I tested dynamic 1.58bit and 2.22bit, All thoughts are empty?

7

#24 opened 4 days ago by

SongXiaoMao

New activity in unsloth/DeepSeek-R1-GGUF 4 days ago

No think tokens visible

5

#15 opened 15 days ago by

sudkamath

New activity in PowerInfer/SmallThinker-3B-Preview 29 days ago

How to Pair with Larger Models

4

#7 opened about 1 month ago by

windkkk

New activity in kosbu/QVQ-72B-Preview-AWQ about 2 months ago

Very easy to use

#2 opened about 2 months ago by

SongXiaoMao

New activity in Qwen/QwQ-32B-Preview about 2 months ago

multi GPU inferencing

2

#18 opened 3 months ago by

cjj2003

Use sample code to start error reporting

1

#45 opened 2 months ago by

SongXiaoMao

vllm reply garbled

3

#29 opened 3 months ago by

SongXiaoMao

vllm has problems running this model

3

#46 opened 2 months ago by

SongXiaoMao

Can you officially support VLLM?

1

#48 opened about 2 months ago by

SongXiaoMao

New activity in mistralai/Mistral-Nemo-Instruct-2407 6 months ago

Does vllm support this model yet?

#63 opened 6 months ago by

SongXiaoMao

New activity in TechxGenus/Mistral-Large-Instruct-2407-AWQ 7 months ago

The model can be started using vllm, but no dialogue is possible.

3

#2 opened 7 months ago by

SongXiaoMao

New activity in mistralai/Mistral-Nemo-Instruct-2407 7 months ago

How should vllm start it?

2

#24 opened 7 months ago by

SongXiaoMao

updated a model 7 months ago

SongXiaoMao/testYI

Updated Jul 13, 2024 • 18

New activity in CohereForAI/c4ai-command-r-plus-4bit 7 months ago

请问这个4bit模型支持vllm启动吗？

#11 opened 7 months ago by

SongXiaoMao

liked a model 9 months ago

deepseek-ai/DeepSeek-V2-Chat

Text Generation • Updated Jun 8, 2024 • 3.26k • 455

New activity in Thireus/Vicuna13B-v1.1-8bit-128g over 1 year ago

This model can be used normally using oobabooga

#5 opened over 1 year ago by

SongXiaoMao

New activity in samwit/vicuna-13b-8bit over 1 year ago

Running on a 3090 graphics card can actually cause flash memory?

#2 opened over 1 year ago by

SongXiaoMao