GitHub Trending repo Repositories Jul 28 2 views

pablo-reyes8/kimi-k3-pytorch: Build, train and experiment with a research-scale Kimi K3 in PyTorch — implementing KDA, Gated MLA, AttnRes, LatentMoE, multimodality, Muon, long-context training, KV-cache inference and ViT.

by pablo-reyes8

Build, train and experiment with a research-scale Kimi K3 in PyTorch — implementing KDA, Gated MLA, AttnRes, LatentMoE, multimodality, Muon, long-context training, KV-cache inference and ViT.

Read Original

Metadata

Stars
4
Language
Python
Watchers
4
Open Issues
3
License
MIT

Related