← 💻 Coding & Engineering Craft
Core
Streaming and Backpressure
Streaming processes data one chunk at a time so memory stays flat no matter how big the input is. The moment a producer outruns its consumer, you need backpressure: a bounded buffer that makes the producer wait instead of piling unbounded work into memory. In Python this is generators and chunked reads for the streaming half, and a bounded queue (or a blocking put) for the backpressure half. Get it wrong and a 50 GB file or a fast upstream OOMs the box.
a free account unlocks the core curriculum tier · no card
RELATED CONCEPTS
LESSONS THAT TEACH THIS
PRACTICE THIS IN REAL QUESTIONS
System Design & Production EngineeringWhat's the difference between at-least-once and exactly-once delivery, and why should an FDE care?→Coding & DSADesign a class that returns the moving average of the last N values in a stream→System Design & Production EngineeringA Python service starts double-processing messages under load. Why does this happen, and how do you fix it?→RAG & Agent System DesignYour agent workflow takes 30 seconds. Design the streaming UX, including what happens when it fails mid-stream.→LLM & GenAI FundamentalsYou need guaranteed JSON from the model, but it keeps breaking the schema. What do you do?→MLOps & ML EngineeringDesign a feature store for a real-time fraud detection model.→