sqliteai/waste
Run the full 2.78-trillion-parameter Kimi K3 model beyond available RAM by streaming activated weights directly from NVMe. A dependency-free, embeddable C inference engine.
Language: C
Stars: 728 Issues: 2 Forks: 70
https://github.com/sqliteai/waste
Post #13606
1.5K