#cplusplus

LiteRT-LM is Google's free, high-speed tool for running large language models like Gemma 4 on phones, computers, Raspberry Pi, and more, with GPU boosts, vision/audio support, and tool use for smart apps. It powers AI in Chrome, Pixel Watch, and Chromebook—try it fast via CLI command on Linux, macOS, Windows, or Pi without coding. You benefit by easily deploying fast, private on-device AI for apps, prototyping, or edge projects, saving time and cloud costs.

https://github.com/google-ai-edge/LiteRT-LM