P · Prerequisite — the vectors chapter · 8/38

Chat is a format, not an architecture

Roles are tokens. Break the tags and the voice leaks.

play
chat is a token stream · roles are markup · break them and the model continues the wrong voice
next —

Roles are tokens. Break the tags and the voice leaks.

Decoder-only models continue text. “Assistant” is markup.