Moonshot AI's Kimi K3 is a 2.8-trillion-parameter mixture-of-experts model with native vision and a one-million-token co...

Moonshot AI's Kimi K3 is a 2.8-trillion-parameter mixture-of-experts model with native vision and a one-million-token context window, and the weights are out. The announcement came July 16, the checkpoint on July 27, with a 47-page technical report. In the two weeks after, independent measurements filled in what the release documents left out: what a task actually costs, and what hardware the weights actually need.https://benjaminhan.net/posts/20260801-kimi-k3-open-frontier/?utm_source=mastodon&utm_medium=social#AI #LLMs #Multimodal #AgenticSystems

Read Original

Related