What are CUDA graphs? How are they implemented? What does it take to actually use them in PyTorch?Further reading.<ul><li>NVIDIA has docs on CUDA graphs <a href="https://developer.nvidia.com/blog/cuda-graphs/">https://developer.nvidia.com/blog/cuda-graphs/</a></li><li>Nuts and bolts implementation PRs from mcarilli: <a href="https://github.com/pytorch/pytorch/pull/51436">https://github.com/pytorch/pytorch/pull/51436</a> <a href="https://github.com/pytorch/pytorch/pull/46148">https://github.com/pytorch/pytorch/pull/46148</a></li></ul>

Functional modules

The PyTorch Developer Podcast is a place for the PyTorch dev team to do bite sized (10-20 min) topics about all sorts of internal development topics in PyTorch.