GO TO A SECTION

↑ ↓ to navigate · Enter to openExplore all sections →
FDEInterviews logo
← System Design & Production Engineering / 55
hardOpenAIAnthropicVercel

When a user closes the browser mid-inference, how do you propagate cancellation and actually stop the GPU work?

A 2-second inference and a user who closed the tab. Naive stacks keep the GPU burning to completion. Real cancellation means propagating disconnect all the way to the batch scheduler.

Updated Sep 2026 · Grounded in real Forward Deployed Engineer interview loops and written to a senior-engineer editorial bar.

A 2-second inference and a user who closed the tab. Naive stacks keep the GPU burning to completion. Real cancellation means propagating disconnect all the way to the batch scheduler.

20 answers per topic instead of 10, plus saved progress and bookmarks · no cardor unlock all 548 remaining answers · ₹2,000 / $25

Every answer, concept and course, every paper breakdown, all published video lessons, hands-on FDE Lab missions, Premium PDF guides and companion files, the full practice-test bank and work-sample downloads. Referral Premium excludes guide PDFs and their companion files.

6 months · One payment · No auto-renewal

Study alongside free video lessons.

Course lessons in this topic

Keep practising

Next in this trackDesign inference batching for a single GPU serving up to 100 inputs per batch while users wait synchronously. Maximize utilization.PremiumNext in this trackYour product calls an external LLM API and you are on a 99.9% uptime SLA. The provider goes dark for 4 hours. Design the failover.PremiumNext in this trackDistribute a 10GB file from one bandwidth-constrained source to thousands of interconnected hosts, minimizing time to completion.Premium
DISCUSSION · 0

No comments yet — be the first to share your approach.