← 🧠 Foundations of LLMs & GenAI
Advanced
Inference-Time Compute
Inference-time compute trades extra computation at answer time, not training time, for higher accuracy: sample many solutions and pick the best, or search over reasoning steps guided by a reward model. It reshapes serving economics because cost now scales with how hard a query is, which is why FDE loops probe the accuracy-per-token trade-off and how you cap a token budget.
Unlock the full curriculum — ₹2,000 / $25every concept + every answer · 6 months · no auto-renew
RELATED CONCEPTS
PRACTICE THIS IN REAL QUESTIONS
RAG & Agent System DesignKeyword search vs vector search: what does each actually buy you in a RAG system?→LLM & GenAI FundamentalsWhat are embeddings, and how do they make semantic search work?→RAG & Agent System DesignDesign a hybrid retrieval stack: BM25, vectors, and a reranker. What does each stage rescue?→LLM & GenAI FundamentalsWhy does vector search retrieve 'related but wrong' results, and how do you fix it?→Machine Learning & Data ScienceWhat does cosine similarity actually measure, and why is it the default for comparing embeddings?→ML System Design (Product)Design learning-to-rank for product/marketplace search.→