← 📊 Evaluation & ML Foundations
Core
LLM-as-a-Judge
LLM-as-a-judge uses a strong model to grade outputs against an explicit rubric, so evaluation scales past the few hundred examples a human can read by hand. It only counts as evaluation once you have calibrated the judge against 50-100 human labels and reported how well it agrees, because an uncalibrated judge is just a confident opinion.
a free account unlocks the core curriculum tier · no card
RELATED CONCEPTS
LESSONS THAT TEACH THIS
PRACTICE THIS IN REAL QUESTIONS
RAG & Agent System DesignWalk me through a RAG pipeline end-to-end, and tell me where it usually breaks→RAG & Agent System DesignHow would you chunk documents for retrieval, and how do you know your chunking is good?→RAG & Agent System DesignKeyword search vs vector search: what does each actually buy you in a RAG system?→ML System Design (Product)Design an evaluation framework for an ads-ranking system.→LLM & GenAI FundamentalsWhat are embeddings, and how do they make semantic search work?→RAG & Agent System DesignHow would you evaluate a RAG system before letting a customer launch it?→