June 9, 2026
Recurrence Is Weight Sharing Across Time, and It Costs You
A recurrent network reuses one cell at every timestep and carries a state. That buys time-translation equivariance and unbounded reach in principle, and bills you in vanishing gradients.