Getting Started with CUDA Graphs and GTC talk Effortless CUDA Graphs.



    Figure 1. Benefits of using CUDA graphs

NCCL support for CUDA graphs
The previously mentioned benefits of reducing launch overheads also extend to NCCL kernel launches. NCCL enables GPU-based collective and P2P communications. With NCCL support for CUDA graphs, we can eliminate the NCCL kernel launch overhead.