4 · Fine-tune · 27/38
Format, then preference. Not more pretrain.
SFT teaches the template. DPO ranks two completions. Neither is pretrain.