PyTorch Developer Podcast
PyTorch Developer Podcast
Edward Yang, Team PyTorch
Higher order operators
17 minutes Posted Apr 21, 2024 at 7:28 pm.
0:00
17:10
Download MP3
Show notes
Higher order operators are a special form of operators in torch.ops which have relaxed input argument requirements: in particular, they can accept any form of argument, including Python callables. Their name is based off of their most common use case, which is to represent higher order functions like control flow operators. However, they are also used to implement other variants of basic operators and can also be used to smuggle in Python data that is quite unusual. They are implemented using a Python dispatcher.