#DeepSeek pulled off a bold move while training DeepSeek-V3 on NVIDIA's H800 #GPU—they repurposed 20 out of the 132 Streaming Multiprocessors (SMs), which were originally meant for computation, and dedicated them solely to inter-server communication instead.
#DeepSeek #GPU