Deep Neural Notebooks
Deep Neural Notebooks
Mukul Khanna
DNN 7: Reinforcement Learning | Research at Waymo, University of Oxford | Shimon Whiteson
1 hour 5 minutes Posted May 28, 2020 at 11:08 am.
Beginnings in Computer Science06:13 Beginnings in ML
PhD at UT Austin
Intersection of Neuroevolution and RL
Research directions since PhD
State of RL
Simulation for RL
Research at Waymo
Multi-agent RL
Recent projects at WhiRL
Teresa project and Telepresence Robots
Bottlenecks for RL and Robotics
End-goal for RL, Human-level Intelligence
What do you find most fascinating about your research?
RL & Philosophy
Keeping up with latest research
Advice for beginners
0:00
1:05:51
Download MP3
Show notes
In the seventh episode of Deep Neural Notebooks, I interview Shimon Whiteson.  
Shimon sir is a Computer Science Professor at the University of Oxford, where he leads the Whiteson Research Lab. He is also a Data Scientist at Waymo (formerly the Google Self Driving Car Project). His research specialises in Reinforcement Learning (RL), Cooperative Multi-Agent RL, to be precise.   
So this interview is all in the context of Reinforcement Learning. We talk about his journey  - how he started with Machine Learning & RL. I ask him about his thoughts on the state of RL - about how the field has progressed and changed since he started, about how it has become so popular in the last few years, and about the challenges being faced.  
We also talk about his research at Waymo, about recent projects from his lab, and about the scope and future of telepresence robots, one of which was developed under his guidance. We also talk about the infamous Reward Hypothesis in the context of RL and Philosophy. In the end, he also shares some advice for people starting out with RL.  
Links:  
- Shimon Whiteson: https://twitter.com/shimon8282 
- Whiteson Research Lab (WhiRL): http://whirl.cs.ox.ac.uk/ 
- Teresa Robot: https://whirl.cs.ox.ac.uk/teresa/ 
- RL workshop at Machine Learning Summer School, Moscow: https://www.youtube.com/watch?v=RAw0Chs7QKA 
- The Reward Hypothesis: http://incompleteideas.net/rlai.cs.ualberta.ca/RLAI/rewardhypothesis.html
Timestamps:
Podcast links :
Youtube: https://youtu.be/bbrYZDgPI9M
Apple Podcasts:  https://apple.co/2TLUZ0y
Google Podcasts: https://bit.ly/2TIyvh6
Spotify:  https://open.spotify.com/episode/3936aEvSwsIhfwQfURmDb9
Anchor: https://bit.ly/3gpMi65
Connect:  
Twitter: https://twitter.com/mkulkhanna 
Website: https://mukulkhanna.co 
LinkedIn: https://linkedin.com/in/mukulkhanna/