FDEInterviews logo

memory hierarchy

FDE interview questions tagged memory hierarchy, across every topic.

2 questions · 1 unlocked for you
Open full answer →
Open full answer →

Concepts behind "memory hierarchy"

The curriculum that explains the ideas these questions test.

Core
🖥️ ML Infrastructure & ServingSign in
GPU Architecture and ExecutionA GPU is not a fast CPU. It runs thousands of threads in lockstep groups called warps across many streaming multiprocessors, under the SIMT model, and its real constraint is moving data through a memory hierarchy that spans fast on-chip registers and shared memory down to slow off-chip HBM. Understanding occupancy, coalesced memory access, and warp divergence is what separates a kernel that hits peak throughput from one that leaves 90% of the chip idle.
Explore the full curriculum →