Browse posts by tag
The sequential-prediction series is now an eight-episode animated playlist: what-comes-next as the foundation of the language-model era, traced from Solomonoff induction to the transformer.
An attention head is a learned content-addressable lookup: a query matches keys, retrieves a value, exactly like dereferencing a pointer. Depth is how many lookups you can compose.
The canonical NLP book, updated for the LLM era.
Modern DL explained cleanly without hype.
The evolution of neural sequence prediction, and how it connects to classical methods