#rust #gguf #llm #localai #mlx #skill #unsloth
llmfit is a free terminal tool that automatically checks your computer’s RAM, CPU, and GPU to tell you exactly which large language models will run well on your machine, ranking them by fit, speed, quality, and context. It supports both an interactive visual interface and a command-line mode, works with multi-GPU setups, and suggests the best quantization levels so you never waste time or storage downloading models that won’t work. This saves you from guesswork, trial-and-error testing, and wasted bandwidth, giving you immediate, reliable recommendations for the best local AI models for your specific hardware.
https://github.com/AlexsJones/llmfit
Post #15865
613