GPUWorks has open-sourced a 40MB inference platform that pools Nvidia, Huawei Ascend, T-Head PPU and Hygon DCU accelerat...

GPUWorks has open-sourced a 40MB inference platform that pools Nvidia, Huawei Ascend, T-Head PPU and Hygon DCU accelerators into one managed cluster with an OpenAI-compatible API. The team says one server managed 1,003 GPU servers and 500 replicas in four minutes, and waking a sleeping DeepSeek deployment took 3.6 seconds. https://pandaily.com/gpuworks-open-source-40mb-ai-inference-platform-ascend-t-head-ppu-hygon-dcu-nvidia-1003-servers #China #Tech #AI

Read Original

Related