Serve it from cache, send less, or send it somewhere cheaper

There are only three ways to spend less per unit of work, and they carry very different quality risk. Caching is nearly free and mostly a correctness problem, trimming context is the largest safe win, and routing to a cheaper model is the powerful one that requires per-segment evidence before you are allowed to use it.

18 MIN · PREMIUM