Neural-Networks

The Architecture Is the Prior

Part 3 of What Your RL Algorithm Actually Assumes — the architecture decides what kind of features can be learned, and that decision is a Bayesian prior over value functions.

Deep Learning

Deep Learning with Python

Deep Learning: An Introduction for Applied Mathematicians

Notes

Perspective of deep learning from applied math. Bridges math with neural nets.

Dive into Deep Learning

Notes

Free open-source deep learning book with code and math integrated. Interactive deep learning resource with runnable code.

Learning Fuzzy Logic: Automatic Rule Discovery Through Differentiable Circuits

Learning fuzzy membership functions and inference rules automatically through gradient descent on soft circuits, instead of hand-crafting them.

Neural Language Models: From RNNs to Transformers

The evolution of neural sequence prediction, and how it connects to classical methods

Comparing Prediction Methods: CTW vs. N-grams vs. Neural LMs

The bias-data trade-off in sequential prediction: when to use CTW, n-grams, or neural language models.