April 24, 2026
Scaling Laws for Neural Language Models
Notes
Power-law relationships between compute, data, parameters, and loss. Empirical scaling science.
Scaling Laws
Browse posts by tag
April 24, 2026
Training Compute-Optimal Large Language Models (Chinchilla)
Notes
Showed most LLMs were undertrained. Optimal ratio of data to parameters.