Austrian Artificial Intelligence Podcast
Austrian Artificial Intelligence Podcast
Manuel Pasieka
14. Marco Mondelli - IST: Getting to the bottom of gradient descent methods
1 hour 2 minutes Posted Sep 27, 2021 at 7:20 pm.
Personal intro & career development
The Mondelli research group at the IST
Main research focus
Recent Publication on the connectivity of loss landscape
Future research interests
0:00
1:02:55
Download MP3
Show notes
# Intro
Marco Mondelli is a group leader at the IST Austrian, focusing on theoretical machine learning and in particular on properties and behaviour of gradient descent methods when used to train overparameterized deep neural networks.
In this interview Marco describes his reasons to start a theoretical machine learning research Group at the IST Austria and several aspects of the IST PhD program.
In the second part of the interview we discuss the research done in his groups and recent publications investigating the reasons behind the efficiency of gradient descent algorithms in optimising deep neural networks.
# References
Marco Mondelli - http://marcomondelli.com/
Mondelli group at IST: https://ist.ac.at/en/research/mondelli-group/
Mean-field particle methods: https://en.wikipedia.org/wiki/Mean-field_particle_methods
Landscape connectivity and dropout stability of SGD solutions for overparameterized neural networks : https://research-explorer.app.ist.ac.at/record/9198
# Interview Timings