Speculative decode / test-time compute

Quality from extra decode, not extra pretrain.

play

draft acceptance75%

draft · small model

target · big model verifies

idle

committed output

—tokens / target pass

—effective speedup

0target passes

A cheap draft proposes; the big model verifies. Extra decode, same weights.