P · Prerequisite — the vectors chapter · 5/38
Gradient descent
Click the map. Batch is smooth. SGD jitters. η is the game.
playL(w,b) · click to drop θ · batch is a smooth path · SGD jittersClick to drop θ. Batch is a smooth path. SGD jitters but still falls.
θ ← θ − η ∇_θ L
Same update at 2 parameters and at 1T.