Opening the archive
Everything published here so far. Filter by topic, or sort by what gets read most.
Tokens, vectors, attention, and next-token prediction. What is actually happening underneath something that feels like a conversation.
Language Processing Units are purpose-built for language models rather than general compute. The specialization shows up in where the weights live.
ChatGPT did not cause the wildfires. The conversation that formed around the claim is still worth having.
There are not enough GPUs to go around, so the company behind ChatGPT is looking at making the hardware itself.
735 views
728 views
683 views
356 views
