Backpropagation: The Algorithm That Underpins Neural Networks
Backpropagation enables practically all modern neural network architectures, from CNNs to LLMs, by enabling computationally efficient tuning on training data.
Yuzo Makitani