Backpropagation

Browse posts by tag

January 17, 2023

Reverse-Mode Automatic Differentiation

Reverse-mode automatic differentiation is just the chain rule applied systematically. I built one in C++20 to understand what PyTorch and JAX are actually doing.

Computer Science Mathematics