P · Prerequisite — the vectors chapter · 1/38
Tensors are the vectors
Drag two arrows. The rest of the course is this, with a shape.
playdrag heads · green a · red b · dashed = projection · a·b = |a||b|cosθa·b —|a| —|b| —θ —cosθ —
Dot product is the primitive. Attention is this, many times.
a·b = |a||b|cosθ
Weights, activations, KV — all tensors. Rank and dtype are the units.