faithfulness
FDE interview questions tagged faithfulness, across every topic.
2 questions · 0 unlocked for you
Concepts behind "faithfulness"
The curriculum that explains the ideas these questions test.
Core
Evaluating RAG SystemsThe central rule of RAG evaluation is to score retrieval and generation separately, because they fail for different reasons and you cannot fix what you cannot isolate. Retrieval is graded against a golden set with recall@k, precision@k, MRR, and NDCG; generation is graded for faithfulness and answer relevance, usually with an LLM judge. Recall@k is the ceiling on everything downstream.📊 Evaluation & ML FoundationsSign in
Advanced
Faithfulness vs Answer RelevancyFaithfulness asks whether the answer is supported by the retrieved context. Answer relevancy asks whether it addresses the question. They are independent, and the dangerous quadrant is high relevancy with low faithfulness, which reads as a helpful, on-topic answer that the sources do not support.📊 Evaluation & ML Foundations🔒 Premium