← 🧠 Foundations of LLMs & GenAI
Core
Constitutional AI and RLAIF
Constitutional AI aligns a model against a written set of principles using AI-generated feedback instead of mostly human labels: the model critiques and revises its own outputs against the principles, then learns from an AI judge that picks which response follows them better. RLAIF scales where human labeling stalls, which is why FDE loops probe what the constitution actually encodes and whose biases the AI judge inherits.
a free account unlocks the core curriculum tier · no card
RELATED CONCEPTS
PRACTICE THIS IN REAL QUESTIONS
Machine Learning & Data ScienceA customer says 'we want the model to be accurate.' How do you turn that into the metric you'll optimize?→RAG & Agent System DesignA brand wants an agent that never gives financial advice, stays on-voice, and never mentions competitors. Design the guardrails.→AI Security, Privacy & GovernanceDesign an ongoing AI red-team program: team, harm categories, cadence, and what you'd automate with PyRIT first.→Behavioral & Customer ScenariosWhat are your views on AI safety and risk? What would you refuse to build for a customer?→System Design & Production EngineeringDesign the Claude chat service→AI Security, Privacy & GovernanceReproduce-from-paper: design a production-safe Constitutional-AI-style fine-tuning pipeline that aligns a chatbot to a set of rules→