Show notes
In this episode, our guest is Sean Meyn, Professor and Robert C. Pittman Eminent Scholar Chair in the Department of Electrical and Computer Engineering at the University of Florida. The episode features Sean’s adventures in the areas of Markov chains, networks and Reinforcement Learning (RL) as well as anecdotes and trivia about beekeeping and jazz.Outline00:00 - Intro00:22 - Sean’s early steps03:53 - Markov chains08:45 - Networks18:26 - Stochastic approximation25:00 - Reinforcement Learning38:57 - The intersection of Reinforcement Learning and Control42:37 - Favourite theorem44:05 - Beekeeping and jazz48:47 - OutroEpisode linksSean’s website: https://meyn.ece.ufl.edu/Sean’s books: shorturl.at/CFGRY (and T. Sargent's review: shorturl.at/hlGNR)G. Zames: shorturl.at/JPRWX (see also: shorturl.at/chiw5)State space model: shorturl.at/hST07 The life and work of A.A. Markov: shorturl.at/qsv35Fluid model: shorturl.at/HKN56M/M/1 queue: shorturl.at/dQW36Borkar-Meyn theorem: shorturl.at/eSTV4NCCR Automation Symposia: shorturl.at/csv03 (see also shorturl.at/ekpZ3)V. Konda’s PhD Thesis: shorturl.at/bdrv7Support the showPodcast infoPodcast website: https://www.incontrolpodcast.com/Apple Podcasts: https://tinyurl.com/5n84j85jSpotify: https://tinyurl.com/4rwztj3cRSS: https://tinyurl.com/yc2fcv4yYoutube: https://tinyurl.com/bdbvhsj6Facebook: https://tinyurl.com/3z24yr43Twitter: https://twitter.com/IncontrolPInstagram: https://tinyurl.com/35cu4kr4Acknowledgments and sponsorsThis episode was supported by the National Centre of Competence in Research on «Dependable, ubiquitous automation» and the IFAC Activity fund. The podcast benefits from the help of an incredibly talented and passionate team. Special thanks to L. Seward, E. Cahard, F. Banis, F. Dörfler, J. Lygeros, ETH studio and mirrorlake . Music was composed by A New Element.