#shell #bonsai #llamacpp #llm #mlx #prism_ml #small_models

You can run powerful Bonsai 27B AI models locally on your iPhone, Mac, or laptop without needing cloud servers. The 1-bit version fits in just 3.9 GB, allowing a 27-billion-parameter model (with vision and reasoning) to run on a phone like the iPhone 17 Pro, while the Ternary version offers higher quality at 5.9 GB. This gives you private, fast, and offline AI for chat, image analysis, and tool use, with up to 262K token context and 90–95% of full-precision performance.

https://github.com/PrismML-Eng/Bonsai-demo