7 · Product and future · 35/38

RAG

The GPU bill is the long context, not HNSW.

play

Retrieval is cheap. Prefill of the stuffed prompt is the bill.