Autograd — the chain rule

Green forward. Amber back. One hop per node.

play

forward green · backward amber · chain rule hops right → left

press backward — each hop multiplies by a local derivative

x w b t L — · ∂L/∂w —

Forward stores values. Backward multiplies local slopes.

Every framework is this graph, vectorized. micrograd: 154 lines.