52An AI assistant just produced code that's subtly wrong. Walk me through how you diagnose why, when the model is a black box.▼hardGoogleAnthropicOpenAI1 replies◆ premiumYou can't read the model's weights, so you debug the inputs you control. There's a four-bucket triage, prompt, context, model, or spec, that localizes the fault fast, and the real deliverable is feeding each diagnosis back so the same failure can't recur.Open full answer →
52Tell me about discovering data leakage or train/test contamination in a model you shipped.▼hardGoogleAmazonCapital One2 replies◆ premiumA model that's too good is a bug, not a win. The screen is whether your instinct on a suspiciously high number is to celebrate or to get suspicious, and whether you disclosed the leak instead of quietly fixing it.Open full answer →