CUDA graph trees

PyTorch Developer Podcast ›

20:50 | Mar 24th, 2024

CUDA graph trees are the internal implementation of CUDA graphs used in PT2 when you say mode="reduce-overhead". Their primary innovation is that they allow the reuse of memory across multiple CUDA gr...Show More