05What is occupancy, and how do you balance it against register and shared-memory usage when choosing block size?▼mediumNVIDIAGoogleCoreWeave1 repliesunlockedEveryone says 'maximize occupancy.' The candidates who get hired at NVIDIA know when 25% occupancy beats 75%, and can explain the resource math that decides it.Open full answer →
06How do you determine whether a kernel is memory-bound or compute-bound?▼mediumNVIDIAGoogleTogether AI3 repliesunlockedThe roofline model in one ratio: FLOPs per byte against the hardware's ridge point. Get the H100 arithmetic right and you can classify any kernel, including why LLM decode will never be compute-bound at batch 1.Open full answer →
