PyTorch Developer Podcast
PyTorch Developer Podcast
Edward Yang, Team PyTorch
Min-cut partitioner
15 minutes Posted Mar 17, 2024 at 7:00 am.
0:00
15:56
Download MP3
Show notes
The min-cut partitioner makes decisions about what to save for backwards when splitting the forward and backwards graph from the joint graph traced by AOTAutograd. Crucially, it doesn't actually do a "split"; instead, it is deciding how much of the joint graph should be used for backwards. I also talk about the backward retracing problem.