memory hierarchy

FDE interview questions tagged memory hierarchy, across every topic.

2 questions · 1 unlocked for you

Open full answer →

Open full answer →

Concepts behind "memory hierarchy"

The curriculum that explains the ideas these questions test.

🖥️ ML Infrastructure & ServingSign in

GPU Architecture and ExecutionA GPU is not a fast CPU. It runs thousands of threads in lockstep groups called warps across many streaming multiprocessors, under the SIMT model, and its real constraint is moving data through a memory hierarchy that spans fast on-chip registers and shared memory down to slow off-chip HBM. Understanding occupancy, coalesced memory access, and warp divergence is what separates a kernel that hits peak throughput from one that leaves 90% of the chip idle.

Explore the full curriculum →