The lie

100% util, 3% of peak. GEMM vs decode.

play

nvidia-smi · utilization

—

the SMs it touches really are busy

achieved · % of peak FLOP/s

—

how much of the machine does real math

Utilization means a kernel was resident. Achieved is the fraction of peak FLOP/s.