PyTorch Developer Podcast
PyTorch Developer Podcast
Edward Yang, Team PyTorch
Inductor - Define-by-run IR
12 minutes Posted Jan 24, 2024 at 8:00 am.
0:00
12:06
Download MP3
Show notes
Define-by-run IR is how Inductor defines the internal compute of a pointwise/reduction operation. It is characterized by a function that calls a number of functions in the 'ops' namespace, where these ops can be overridden by different handlers depending on what kind of semantic analysis you need to do. The ops Inductor supports include regular arithmetic operators, but also memory load/store, indirect indexing, masking and collective operations like reductions.