Inference-Time Compute

Inference-time compute trades extra computation at answer time, not training time, for higher accuracy: sample many solutions and pick the best, or search over reasoning steps guided by a reward model. It reshapes serving economics because cost now scales with how hard a query is, which is why FDE loops probe the accuracy-per-token trade-off and how you cap a token budget.