liudekai

ShadowWolf1999
·

AI & ML interests

None yet

Recent Activity

Organizations

None yet

ShadowWolf1999's activity

reacted to onekq's post with 🤗 15 days ago
view post
Post
2760
Necessity is mother of invention. To understand ⚡FlashMLA⚡ by
🐋DeepSeek 🐋, the first question to ask is why.

The keyword here is H800, a lower-end product tailored for export control. The purpose here is to squeeze out as much performance as possible.

But here is the most important takeaway: this invention benefits EVERYONE.
  • 2 replies
·
New activity in deepseek-ai/DeepSeek-R1 about 2 months ago

this is the killer

5
#1 opened about 2 months ago by
blackcat1402
reacted to mitkox's post with 🔥 2 months ago
view post
Post
2487
Can it run DeepSeek V3 671B is the new 'can it run Doom'.

How minimalistic can I go with on device AI with behemoth models - here I'm running DeepSeek V3 MoE on a single A6000 GPU.

Not great, not terrible, for this minimalistic setup. I love the Mixture of Experts architectures. Typically I'm running my core LLM distributed over the 4 GPUs.

Make sure you own your AI. AI in the cloud is not aligned with you; it's aligned with the company that owns it.
·