02How is a jailbreak different from prompt injection? Give an example of each from a real application.▼easyAnthropicMicrosoftScale1 repliesunlockedCandidates use these terms interchangeably and security interviewers notice immediately. The distinction, whose policy is being violated, drives completely different defenses, and that's the actual question.Open full answer →
11Walk me through how you would red-team a customer-facing GenAI chatbot.▼mediumMicrosoftScaleOpenAI1 replies○ sign inA reported AI-security interview staple with a known grading rubric: recon, bypass, leakage, tool abuse, multi-turn drift. Candidates who free-associate attack ideas fail; candidates who run a structured campaign pass.Open full answer →
40Train a red-team LLM with RL to find jailbreaks in your safety-tuned model, then feed the discovered attacks back into safety training.▼expertAnthropicOpenAIScale AI1 replies◆ premiumA red-team model that learns over many episodes which attacks bypass your filters is only useful if it explores instead of farming one exploit, and only safe if every discovered attack becomes target training data.Open full answer →