Soup - One-command LLM fine-tuning on a 4 GB laptop GPU

Show HN: Fine-tune an 8B model on a 4 GB laptop GPU

Soup is a CLI tool that simplifies LLM fine-tuning and post-training into a single command, eliminating SSH and configuration hassles. It supports a wide range of tasks (SFT, DPO, ORPO, SimPO, KTO, etc.) and models, with automatic batch size, GPU detection, and quantization. A standout feature is layer streaming, which enables training an 8B model on a 4 GB GPU by keeping the base model out of VRAM. With one YAML config, you can train, chat, push, merge, and export models effortlessly, making advanced LLM customization accessible to everyone.