Generally Intelligent
Generally Intelligent
Kanjun Qiu
Hattie Zhou, Mila: Supermasks, iterative learning, and fortuitous forgetting
1 hour 47 minutes Posted Oct 14, 2022 at 5:34 pm.
0:00
1:47:28
Download MP3
Show notes

Hattie Zhou is a Ph.D. student at Mila working with Hugo Larochelle and Aaron Courville. Her research focuses on understanding how and why neural networks work, starting with deconstructing why lottery tickets work and most recently exploring how forgetting may be fundamental to learning. Prior to Mila, she was a data scientist at Uber and did research with Uber AI Labs. In this episode, we chat about supermasks and sparsity, coherent gradients, iterative learning, fortuitous forgetting, and much more.