2.78 Trillion Parameters, 29GB RAM, Half a Token Per Second: Kimi K3 Actually Runs on a Laptop
WASTE, a pure-C inference engine, squeezes the 2.78-trillion-parameter Kimi K3 into a 64GB laptop: a 982GB …
#MoE
Seven Questions About Kimi K3: China's Quiet Fable 5 Contender
Moonshot AI teased K3 with a 36-second video, but the real story was already unfolding on Chatbot Arena — …
Cramming a 400B Model into 48GB: The Magic Behind LLM in a Flash
An Apple paper from 2023 made it possible to run a 400 billion parameter model on an ordinary MacBook. The …
Bring Kimi K2 Thinking Home with 247GB RAM: Dynamic 1-bit GGUF Field Notes
Step-by-step guide to running Unsloth's Dynamic 1-bit GGUF build of the 1T-parameter Kimi K2 Thinking model on …