#python #cli #consumer_gpu #dpo #fine_tuning #gguf #huggingface #llm #llmops #local_ai #local_llm #lora #low_vram #machine_learning #ollama #peft #python #pytorch #qlora #sft #transformers

Soup is a tool that helps you fine-tune and post-train large language models with one command, using one config file and little setup. It can work on a local GPU, even a 4 GB laptop GPU for an 8B model with layer streaming, so you can train without SSH or cloud hassle. This saves time, reduces setup pain, and makes model training easier to start and manage.

https://github.com/MakazhanAlpamys/Soup