architecture
FDE interview questions tagged architecture, across every topic.
20 questions · 2 unlocked for you
Concepts behind "architecture"
The curriculum that explains the ideas these questions test.
Foundational
The Transformer, IntuitivelyThe transformer is the architecture behind every modern large language model, built on self-attention that lets each token look at every other token in parallel. FDE loops do not want the math; they want you to explain why attention beat RNNs, what decoder-only means, and why context length is expensive, in plain language an exec or a teammate can follow.🧠 Foundations of LLMs & GenAI
Advanced
Mixture of Experts (MoE)An MoE replaces the dense feed-forward block of a transformer with many parallel expert blocks plus a small router that activates only a few experts per token. This decouples total parameter count from per-token compute: the model can hold hundreds of billions of parameters while doing the work of a much smaller one on any given token. FDE loops probe it because the headline 'huge but cheap' hides a brutal serving cost, every expert must sit in memory even though most stay idle.🧠 Foundations of LLMs & GenAI🔒 Premium
Advanced
Agent vs Workflow vs a Single CallThree architectures sit under the word agent, and they differ by who decides what happens next. A workflow has its steps written in advance; an agent chooses its next action from what it just observed. Picking the wrong one is the most expensive early decision in an AI deployment, and picking the boring one is usually correct.🤖 Retrieval & Agents🔒 Premium
Advanced
The ReAct Loop (Reason, Act, Observe)ReAct is the default agent pattern: the model reasons about what to do, takes one action, observes the result, and repeats until it is done. Almost every agent framework is an implementation of this loop, so knowing where it breaks matters more than knowing the acronym.🤖 Retrieval & Agents🔒 Premium
Advanced
The Walking Skeleton (Thin Slice First)A walking skeleton is the thinnest end-to-end path through a system that actually runs: every component present, every boundary crossed, almost nothing done well. It is the correct first move in an enterprise deployment because the risk lives in the integrations, not in the logic, and only a running path proves the integrations exist.⚙️ System Design for AI in Production🔒 Premium
Advanced
Consistency, CAP and What Your Workflow Actually NeedsCAP says that when the network partitions you must choose availability or consistency, and it is quoted far more often than it is applied. The useful version for a deployment is narrower: decide per operation how stale a read may be, because most workflows tolerate seconds of staleness and a few tolerate none.⚙️ System Design for AI in Production🔒 Premium
