Skip to content
Tag

Everything tagged #gpu

2 articles, newest first.

Articles tagged #gpu

EngineeringSep 11, 2026 · 5 min read

Training for Real: GPUs, Mixed Precision, and Schedules

The five-line loop from Part 2 trains a toy. A real run adds a device, mixed precision for a near-free 2×, a learning-rate schedule, gradient clipping, and checkpoints you can actually resume from. Here's the whole thing.

5 min read
InferenceJan 30, 2025 · 3 min read

LPUs and What They Do That GPUs Do Not

Language Processing Units are purpose-built for language models rather than general compute. The specialization shows up in where the weights live.

133 min read