Inference

Probabilistic Graphical Models: Principles and Techniques

Notes

The comprehensive reference on graphical models, inference, and learning.

Probabilistic Machine Learning: An Introduction

Notes

Comprehensive modern ML textbook with solid probabilistic foundations.

Fuzzy Inference: Teaching Machines to Think in Shades of Grey

An interactive introduction to fuzzy logic inference, from single facts to LLM-generated knowledge bases

All of Statistics

Bayesian Data Analysis

Notes

Applied Bayesian inference with computing methods. The standard Bayesian statistics reference.

Causality: Models, Reasoning, and Inference

Introduction to Probability and Mathematical Statistics

Notes

Rigorous graduate-level probability + statistics; useful for inference and ML foundations.

Probabilistic Graphical Models

Probability Theory: The Logic of Science

KL-Threshold Routing Between LLMs: What Speculative Decoding Already Solved

In 2023 I drafted a paper on routing between a large and small LLM via KL-divergence thresholds. Speculative decoding had already solved the problem more rigorously. Here is the post-mortem.

likelihood.model: Composable Likelihood Models in R

A generic R framework for composable likelihood models. Likelihoods are first-class objects that compose through independent contributions.

STAT 482 - Regression Analysis - SIUe - Fall 2021

This is a problem set for STAT 482 - Regression Analysis at SIUe. These problem sets were given by Dr. Andrew Neath, a professor in the Department of Mathematics and Statistics at Southern Illinois University Edwardsville (SIUe) during the Fall 2021 …

STAT 575 - Computational Statistics - SIUe - Summer 2021

This is a problem set for STAT 575 - Computational Statistics at SIUe. These problem sets were given by Dr. Qiang Beidi, a professor in the Department of Mathematics and Statistics at Southern Illinois University Edwardsville (SIUe) during the Summer …