log in  |  register  |  feedback?  |  help  |  web accessibility
Logo
Diversity is All You Need: Learning Skills without a Reward Function
Ben Eysenbach and Julian Abhishek - Carnegie Mellon University / Google Brain
Remote
Wednesday, January 27, 2021, 1:00-2:15 pm Calendar
  • You are subscribed to this talk through .
  • You are watching this talk through .
  • You are subscribed to this talk. (unsubscribe, watch)
  • You are watching this talk. (unwatch, subscribe)
  • You are not subscribed to this talk. (watch, subscribe)
Abstract

Intelligent creatures can explore their environments and learn useful skills without supervision. In this talk, we will present a method, 'Diversity is All You Need' (DIAYN), for learning useful skills without a reward function. We show how pretrained skills can provide a good parameter initialization for downstream tasks, and can be composed hierarchically to solve complex, sparse reward tasks. We will then discuss a close connection between autonomous skill discovery and meta-learning. Whereas typical meta-reinforcement learning algorithms require a manually-designed family of reward functions, we show how to use DIAYN to propose tasks for meta-learning in an unsupervised manner, effectively resulting in an unsupervised meta-learning algorithm. While there has been considerable work in this area in the past few years, a number of algorithmic and theoretical questions remain open. We plan to highlight some of these challenges at the end.

https://arxiv.org/abs/1802.06070

https://umd.zoom.us/j/2920984437

Slides and recording will be available at: https://www.cs.umd.edu/talks/rlss

This talk is organized by Tom Hurst