Tag
Everything tagged #training
2 articles, newest first.
Articles tagged #training
EngineeringSep 11, 2026 · 5 min read
Training for Real: GPUs, Mixed Precision, and Schedules
The five-line loop from Part 2 trains a toy. A real run adds a device, mixed precision for a near-free 2×, a learning-rate schedule, gradient clipping, and checkpoints you can actually resume from. Here's the whole thing.
5 min read
ExperimentsDec 18, 2024 · 3 min read
Fine-Tuning Large Language Models: PEFT, LoRA, and QLoRA in Practice
Full parameter training requires clusters of H100s. Parameter-Efficient Fine-Tuning (PEFT) with low-rank matrix decomposition brings specialized adaptation to a single GPU.
3 min read
