📰 Someone squeezed a 28.9M LLM onto an ESP32-S3, and so can you

Ever since LLMs hit the public eye, people have tried to cram them into the smallest thing they can find. We've seen people use both Raspberry Pis and ESP32s to run an AI locally, with varying results. Now, someone has managed to squeeze a 28.9M LLM on an ESP32-S3, and it can tell a pretty good story.

🔗 Source:

#raspberry

👉@sysadminoff

https://www.xda-developers.com/someone-squeezed-a-289m-llm-onto-an-esp32-s3-and-so-can-you/