↓Skip to main content

GPU Idle? PyTorch's Holistic Trace Analysis Knows Why

·40 words·1 min · Download pdf

PyTorch released Holistic Trace Analysis library last week that can tell you about:

  • Time in compute vs communication vs memory events

  • Find kernels with longest durations

  • Is there an overlap between compute and communication (why my GPU idle)?

https://pytorch.org/blog/trace-analysis-for-masses

https://pbs.twimg.com/media/Fm4MjyXaUAM0p6r.jpg

Discussion