Agentic Evals: Grading the Trajectory, Not the Answer

Evaluating an agent on its final output misses most of what can go wrong, because an agent can reach a plausible answer through a path that cost twenty dollars, called a destructive tool, or got there by luck. Trajectory evaluation grades the path: which tools were called, in what order, with what arguments, and at what cost.