Post #234094 1.32K Oct 17, 2026, 18:48 UTC Qwen3.8-27B on the iPhone 18 Neural Engine at 15–70 tok/s (1.5 bpw)Article, Comments X (formerly Twitter) Anemll (@anemll) on X Confirmed 24K context on iPhone with both K/V on int8. Delta net stays FP16. Decoding also peaks at 70 tok/s with easy to predict context. Apple Neural Engine on A20 is fast 🚀 🤯 19 🤬 1