Incident · advanced · 45 min · Premium
Release review: defend the agent
The capstone. Calder's support agent is up for release and the board has forty minutes. Gather evidence from the live system, answer the three questions a board asks, and commit to hold or advance with reasons a reviewer accepts.
Brief
- Customer
- Calder Equipment (synthetic customer from the Production AI Agents course; every metric, evaluation and log on this box is made up for the exercise)
- Situation
- Release review at 15:00. The board's three questions are fixed: does the agent stop when it should, does anything ship without an approval, and what does the evaluation say on the current manifest. The staging system is live in the console with this release deployed. Two things are wrong with it and one is fine; the board does not know which.
- Your role
- You are the FDE presenting. You have the console, the release's config, the evaluation runner, the red-team report from last week and a review template. You may fix a config to show the board what a fix looks like, but the decision is about the release as it stands.
- Goal
- Answer the board's three questions from evidence you gather on the live system, name the two defects, commit to hold or advance, and file the review with the evidence attached.
Objectives
- 1.Q1: does the agent stop when it should? (you commit to an answer)
- 2.Q2: does anything ship without an approval? (you commit to an answer)
- 3.Q3: what does the evaluation say? (you commit to an answer)
- 4.Commit to the release decision (you commit to an answer)
- 5.File the review with the evidence
Mission workspace
This mission is part of premium, with every challenge and incident in the lab. The brief above is the whole problem; the box, the hints and the debrief are what you unlock.
Get full Premium access · ₹2,000 / $25
Every answer, concept and course, plus Premium PDF guides, companion files, the full practice-test bank and work-sample downloads. Referral Premium excludes guide PDFs and their companion files.
6 months · One payment · No auto-renewal
Study alongside free video lessons.