Matrix Multiplication Gradients

May 1, 2025

How it works

Follow how a change to one input or weight affects the loss through matrix multiplication. This visual guide connects worked examples to the scalar chain rule and explains why the gradient formulas transpose the other input.

Open the full-resolution PDF or download a copy.

Matrix multiplication gradients: a visual guide with worked examples, chain-rule derivations, and Jacobians.