Deltafin: Running Kimi K3 (2.78T MoE) on a Single Workstation
Disclosure: Some links below are affiliate links. If you sign up through them, I may earn a commission at no extra cost to you. Vultr — high-memory cloud GPU instances from $6/mo DigitalOcean — $200 credit for new users, great for GPU droplets So Kimi K3 dropped two days ago and instantly became the most exciting open-weight model release this month — 7,300+ stars, 2.78 trillion parameters in a Mixture-of-Experts architecture, multimodal. Problem: nobody has a cluster sitting around to serve it. Enter Deltafin, a research project that does exactly what its README says: “runs a Mixture-of-Experts model far larger than the machine it sits on.” I spent the evening digging through its codebase, and honestly? The ambition matches the execution. ...