54Build an agent that reroutes shipments when a hub goes down, and design the eval suite that keeps it from overspending.▼hardNewPalantirOpenAIAnthropic2 replies◆ premiumEvery eval question in the prep canon is about answer quality. This agent does not produce answers, it moves freight. You cannot score a reroute for faithfulness, and the candidate who tries has not understood what they built.Open full answer →
55Your agent ran fine all week, then burned $2,000 overnight. Find where the tokens went and cut the bill without losing quality.▼hardNewOpenAIAnthropicSierra4 replies◆ premiumThe provider bill tells you the total and nothing else. This is a forensics question, and the answer is almost never a pricey model. It is that the transcript grows every turn, so a forty step run costs six times what everyone estimated.Open full answer →