context window
FDE interview questions tagged context window, across every topic.
3 questions · 1 unlocked for you
Concepts behind "context window"
The curriculum that explains the ideas these questions test.
Foundational
Tokenization & TokensA language model does not read characters or words. It reads tokens: sub-word chunks produced by a tokenizer, each mapped to an integer the model embeds. Tokens are the unit of the context window and of billing, and the way text splits into them explains a surprising number of model quirks, which is why almost every loop opens here.🧠 Foundations of LLMs & GenAI
Foundational
The Context WindowThe context window is the fixed number of tokens a language model can attend to at once, and input and output share that same budget. Understanding it is what separates engineers who can size a prompt, control cost and latency, and decide when to reach for RAG from those who just paste everything in and hope.🧠 Foundations of LLMs & GenAI
Foundational
Context Window Management for FDE AgentsManaging the context window is the discipline of deciding what an agent sees on every step, run against a customer's private data and their token bill. Forward Deployed Engineers treat the window as a budget to allocate with four moves, write, select, compress, and isolate, because a deployment that ignores it is either too expensive to run or too unreliable to trust.🤖 Retrieval & Agents