January 15, 2025
CTW Experimental Results: Theory Meets Practice
Validating Context Tree Weighting through experiments, including a bug that changed everything.
Information Theory
Browse posts by category
June 15, 2024
Comparing Prediction Methods: CTW vs. N-grams vs. Neural LMs
The bias-data trade-off in sequential prediction: when to use CTW, n-grams, or neural language models.
November 10, 2015
Data Generating Processes for Sequential Prediction
Markov processes and tree sources: understanding where sequences come from
March 15, 2012
Solomonoff Induction: The Theoretical Ideal
The optimal predictor is incomputable. What we can learn from it anyway.
June 1, 2010
Introduction to Sequential Prediction
The problem of predicting what comes next, from compression to language models