WASTE on 梦兽编程https://rexai.top/en/tags/waste/Recent content in WASTE on 梦兽编程Hugo -- 0.163.3en梦兽编程Sat, 01 Aug 2026 09:30:00 +08002.78 Trillion Parameters, 29GB RAM, Half a Token Per Second: Kimi K3 Actually Runs on a Laptophttps://rexai.top/en/posts/2026-08-01-waste-kimi-k3/Sat, 01 Aug 2026 09:30:00 +0800https://rexai.top/en/posts/2026-08-01-waste-kimi-k3/WASTE, a pure-C inference engine, squeezes the 2.78-trillion-parameter Kimi K3 into a 64GB laptop: a 982GB container streams expert weights from disk on demand, measured at 0.5 tok/s. Half a token per second is absurdly slow — but it proves running trillion-scale models locally is an engineering problem, not a money problem.