7 · Product and future · 35/38
The GPU bill is the long context, not HNSW.
Retrieval is cheap. Prefill of the stuffed prompt is the bill.