sampling
FDE interview questions tagged sampling, across every topic.
3 questions · 2 unlocked for you
Concepts behind "sampling"
The curriculum that explains the ideas these questions test.
Foundational
Temperature, Top-p and SamplingAt each step a model outputs a probability over every possible next token, and sampling settings like temperature, top-p, and top-k decide how that distribution is turned into an actual choice. FDE loops test this because it controls the determinism-versus-creativity dial: knowing when to set it low for extraction and high for brainstorming, and why the same prompt giving different answers is expected, not a bug.🧠 Foundations of LLMs & GenAI
Foundational
Autoregressive DecodingLLMs generate one token at a time: each step feeds the whole sequence back in to predict the next token, which is why generation is sequential and cannot be parallelized the way a forward pass over a known prompt can. This splits inference into a parallel prefill phase and a sequential, memory-bound decode phase, and it is why the KV cache exists and why long outputs cost what they cost.🧠 Foundations of LLMs & GenAI