#c_lang
This is a tiny C program that can run very large AI models on normal hardware by using disk, RAM, and VRAM together. It lets you use powerful models without renting a server, so you save money and can run them locally with more control and privacy.
https://github.com/JustVugg/colibri
Post #15997
674