Tencent’s WeChat AI team is fighting the GPU shortage with algorithmic cleverness, scaling its new WeLM model to a massi...

Tencent’s WeChat AI team is fighting the GPU shortage with algorithmic cleverness, scaling its new WeLM model to a massive 617 billion parameters while activating just 23 billion of them. Using a novel "Hidden Decoding" architecture, they are trading a 4x increase in training compute to bypass hardware constraints. It’s a blueprint for how Chinese tech can stay...#China #AsiaAI #ChinaTech #AIhttps://asiaai.fyi/?p=513#china-watch-wechat-ai-team-details-welm-models-scaling