2.78 Trillion Parameters, 29GB RAM, Half a Token Per Second: Kimi K3 Actually Runs on a Laptop
WASTE, a pure-C inference engine, squeezes the 2.78-trillion-parameter Kimi K3 into a 64GB laptop: a 982GB …
梦兽编程™AI_SUITE
梦兽编程™AI_SUITE
WASTE, a pure-C inference engine, squeezes the 2.78-trillion-parameter Kimi K3 into a 64GB laptop: a 982GB …
An Apple paper from 2023 made it possible to run a 400 billion parameter model on an ordinary MacBook. The …