12Pipeline parallelism, does it run over the scale-out network or stay inside the node? Map TP, PP, and DP onto the fabric.▼hardxAIOpenAINVIDIA1 replies○ sign inA real infra-loop question that candidates fumble by guessing. The correct map, TP on NVLink, PP and DP across the scale-out fabric, falls out of three traffic profiles, and the reasoning is the answer.Open full answer →
14InfiniBand vs RoCE for a GPU training cluster, how do you choose?▼mediumxAIMetaCoreWeave1 replies○ sign inBoth carry RDMA at 400Gb/s; the decision is about loss behavior, tuning burden, and who operates it. A defensible recommendation with the conditions that flip it, the format this question is scored on.Open full answer →
