StayLameBro/backburner
Your iPhone helps your Mac run a 27B model: faster prompt reading and more context over a USB-C cable
Language:Python
Total stars: 379
#python
#applesilicon, #ios, #iphone, #llamacpp, #llminference, #localllm, #macos, #metal, #qwen, #sme2, #speculativedecoding