meta reinforcement learning of structured exploration
play

Meta-Reinforcement Learning of Structured Exploration Strategies - PowerPoint PPT Presentation

May 28, 2023 •886 likes •1.2k views

Meta-Reinforcement Learning of Structured Exploration Strategies Abhishek Gupta , Russell Mendonca, YuXuan Liu, Pieter Abbeel, Sergey Levine Human Exploration vs Robot Exploration Human Exploration vs Robot Exploration Human Exploration vs Robot

  1. Meta-Reinforcement Learning of Structured Exploration Strategies Abhishek Gupta , Russell Mendonca, YuXuan Liu, Pieter Abbeel, Sergey Levine

  2. Human Exploration vs Robot Exploration

  3. Human Exploration vs Robot Exploration

  4. Human Exploration vs Robot Exploration

  5. Exploration Informed by Prior Experience

  6. Exploration Informed by Prior Experience

  7. Exploration Informed by Prior Experience Desired: § Effective exploration for sparse rewards § Quick adaptation for new tasks

  8. Key Insights in MAESN 1. Explore with random but structured behaviors (exploration)

  9. Key Insights in MAESN 1. Explore with random but structured behaviors (exploration) 2. Explicitly train for quick learning on new tasks (adaptation)

  10. Key Insights in MAESN 1. Explore with random but structured behaviors (exploration) 2. Explicitly train for quick learning on new tasks (adaptation)

  11. Key Insights in MAESN 1. Explore with random but structured behaviors (exploration) 2. Explicitly train for quick learning on new tasks (adaptation) Fast Learning Grasp red object

  12. Key Insights in MAESN 1. Explore with random but structured behaviors (exploration) 2. Explicitly train for quick learning on new tasks (adaptation) Fast Learning Grasp red object

  13. Using Structured Stochasticity Per-timestep Exploration Structured Exploration Structured exploration: pick an intention, execute for entire episode. Explore across different intentions

  14. <latexit sha1_base64="btQgEOcsFKLrPIvjacYwlzSy1n4=">AB/XicbVDLSsNAFJ3UV62v+Ni5GSxC3YREBF0W3bisYB/QhDCZTtqhM5M4MxHaUPwVNy4Ucet/uPNvnLZaOuBC4dz7uXe6KUaVd9sqrayurW+UNytb2zu7e/b+QUslmcSkiROWyE6EFGFUkKampFOKgniESPtaHgz9duPRCqaiHs9SknAUV/QmGKkjRTaR2PoK8rhQ5j7CSd9NKk5Z6FdR13BrhMvIJUQYFGaH/5vQRnAiNGVKq67mpDnIkNcWMTCp+pkiK8BD1SdQgThRQT67fgJPjdKDcSJNCQ1n6u+JHGlRjwynRzpgVr0puJ/XjfT8VWQU5Fmg8XxRnDOoETqOAPSoJ1mxkCMKSmlshHiCJsDaBVUwI3uLy6R17niu491dVOvXRxlcAxOQA14BLUwS1ogCbAYAyewSt4s56sF+vd+pi3lqxi5hD8gfX5A1p4lH4=</latexit><latexit sha1_base64="btQgEOcsFKLrPIvjacYwlzSy1n4=">AB/XicbVDLSsNAFJ3UV62v+Ni5GSxC3YREBF0W3bisYB/QhDCZTtqhM5M4MxHaUPwVNy4Ucet/uPNvnLZaOuBC4dz7uXe6KUaVd9sqrayurW+UNytb2zu7e/b+QUslmcSkiROWyE6EFGFUkKampFOKgniESPtaHgz9duPRCqaiHs9SknAUV/QmGKkjRTaR2PoK8rhQ5j7CSd9NKk5Z6FdR13BrhMvIJUQYFGaH/5vQRnAiNGVKq67mpDnIkNcWMTCp+pkiK8BD1SdQgThRQT67fgJPjdKDcSJNCQ1n6u+JHGlRjwynRzpgVr0puJ/XjfT8VWQU5Fmg8XxRnDOoETqOAPSoJ1mxkCMKSmlshHiCJsDaBVUwI3uLy6R17niu491dVOvXRxlcAxOQA14BLUwS1ogCbAYAyewSt4s56sF+vd+pi3lqxi5hD8gfX5A1p4lH4=</latexit><latexit sha1_base64="btQgEOcsFKLrPIvjacYwlzSy1n4=">AB/XicbVDLSsNAFJ3UV62v+Ni5GSxC3YREBF0W3bisYB/QhDCZTtqhM5M4MxHaUPwVNy4Ucet/uPNvnLZaOuBC4dz7uXe6KUaVd9sqrayurW+UNytb2zu7e/b+QUslmcSkiROWyE6EFGFUkKampFOKgniESPtaHgz9duPRCqaiHs9SknAUV/QmGKkjRTaR2PoK8rhQ5j7CSd9NKk5Z6FdR13BrhMvIJUQYFGaH/5vQRnAiNGVKq67mpDnIkNcWMTCp+pkiK8BD1SdQgThRQT67fgJPjdKDcSJNCQ1n6u+JHGlRjwynRzpgVr0puJ/XjfT8VWQU5Fmg8XxRnDOoETqOAPSoJ1mxkCMKSmlshHiCJsDaBVUwI3uLy6R17niu491dVOvXRxlcAxOQA14BLUwS1ogCbAYAyewSt4s56sF+vd+pi3lqxi5hD8gfX5A1p4lH4=</latexit> <latexit sha1_base64="cg9eTEqUtCZqkwCW5khYw4me7mE=">AB6nicbVBNS8NAEJ3Ur1q/oh69LBbBU0lE0GPRi8eK9gPaUDbTbt0swm7E6GE/gQvHhTx6i/y5r9x2+agrQ8GHu/NMDMvTKUw6HnfTmltfWNzq7xd2dnd2z9wD49aJsk0402WyER3Qmq4FIo3UaDknVRzGoeSt8Px7cxvP3FtRKIecZLyIKZDJSLBKFrpgfax71a9mjcHWSV+QapQoNF3v3qDhGUxV8gkNabreykGOdUomOTSi8zPKVsTIe8a6miMTdBPj91Ss6sMiBRom0pJHP190ROY2MmcWg7Y4ojs+zNxP+8bobRdZALlWbIFVsijJMCGzv8lAaM5QTiyhTAt7K2EjqilDm07FhuAv7xKWhc136v595fV+k0RxlO4BTOwYcrqMdNKAJDIbwDK/w5kjnxXl3PhatJaeYOY/cD5/AE4yjcw=</latexit><latexit sha1_base64="cg9eTEqUtCZqkwCW5khYw4me7mE=">AB6nicbVBNS8NAEJ3Ur1q/oh69LBbBU0lE0GPRi8eK9gPaUDbTbt0swm7E6GE/gQvHhTx6i/y5r9x2+agrQ8GHu/NMDMvTKUw6HnfTmltfWNzq7xd2dnd2z9wD49aJsk0402WyER3Qmq4FIo3UaDknVRzGoeSt8Px7cxvP3FtRKIecZLyIKZDJSLBKFrpgfax71a9mjcHWSV+QapQoNF3v3qDhGUxV8gkNabreykGOdUomOTSi8zPKVsTIe8a6miMTdBPj91Ss6sMiBRom0pJHP190ROY2MmcWg7Y4ojs+zNxP+8bobRdZALlWbIFVsijJMCGzv8lAaM5QTiyhTAt7K2EjqilDm07FhuAv7xKWhc136v595fV+k0RxlO4BTOwYcrqMdNKAJDIbwDK/w5kjnxXl3PhatJaeYOY/cD5/AE4yjcw=</latexit><latexit sha1_base64="cg9eTEqUtCZqkwCW5khYw4me7mE=">AB6nicbVBNS8NAEJ3Ur1q/oh69LBbBU0lE0GPRi8eK9gPaUDbTbt0swm7E6GE/gQvHhTx6i/y5r9x2+agrQ8GHu/NMDMvTKUw6HnfTmltfWNzq7xd2dnd2z9wD49aJsk0402WyER3Qmq4FIo3UaDknVRzGoeSt8Px7cxvP3FtRKIecZLyIKZDJSLBKFrpgfax71a9mjcHWSV+QapQoNF3v3qDhGUxV8gkNabreykGOdUomOTSi8zPKVsTIe8a6miMTdBPj91Ss6sMiBRom0pJHP190ROY2MmcWg7Y4ojs+zNxP+8bobRdZALlWbIFVsijJMCGzv8lAaM5QTiyhTAt7K2EjqilDm07FhuAv7xKWhc136v595fV+k0RxlO4BTOwYcrqMdNKAJDIbwDK/w5kjnxXl3PhatJaeYOY/cD5/AE4yjcw=</latexit> <latexit sha1_base64="NO/AVq0yYsPdpG3K5Q5U13QK4s=">AB6nicbVBNS8NAEJ3Ur1q/oh69LBbBU0lE0GPRi8eK9gPaUDbTbt0swm7E6GE/gQvHhTx6i/y5r9x2+agrQ8GHu/NMDMvTKUw6HnfTmltfWNzq7xd2dnd2z9wD49aJsk0402WyER3Qmq4FIo3UaDknVRzGoeSt8Px7cxvP3FtRKIecZLyIKZDJSLBKFrpwfSx71a9mjcHWSV+QapQoNF3v3qDhGUxV8gkNabreykGOdUomOTSi8zPKVsTIe8a6miMTdBPj91Ss6sMiBRom0pJHP190ROY2MmcWg7Y4ojs+zNxP+8bobRdZALlWbIFVsijJMCGzv8lAaM5QTiyhTAt7K2EjqilDm07FhuAv7xKWhc136v595fV+k0RxlO4BTOwYcrqMdNKAJDIbwDK/w5kjnxXl3PhatJaeYOY/cD5/AGmejd4=</latexit><latexit sha1_base64="NO/AVq0yYsPdpG3K5Q5U13QK4s=">AB6nicbVBNS8NAEJ3Ur1q/oh69LBbBU0lE0GPRi8eK9gPaUDbTbt0swm7E6GE/gQvHhTx6i/y5r9x2+agrQ8GHu/NMDMvTKUw6HnfTmltfWNzq7xd2dnd2z9wD49aJsk0402WyER3Qmq4FIo3UaDknVRzGoeSt8Px7cxvP3FtRKIecZLyIKZDJSLBKFrpwfSx71a9mjcHWSV+QapQoNF3v3qDhGUxV8gkNabreykGOdUomOTSi8zPKVsTIe8a6miMTdBPj91Ss6sMiBRom0pJHP190ROY2MmcWg7Y4ojs+zNxP+8bobRdZALlWbIFVsijJMCGzv8lAaM5QTiyhTAt7K2EjqilDm07FhuAv7xKWhc136v595fV+k0RxlO4BTOwYcrqMdNKAJDIbwDK/w5kjnxXl3PhatJaeYOY/cD5/AGmejd4=</latexit><latexit sha1_base64="NO/AVq0yYsPdpG3K5Q5U13QK4s=">AB6nicbVBNS8NAEJ3Ur1q/oh69LBbBU0lE0GPRi8eK9gPaUDbTbt0swm7E6GE/gQvHhTx6i/y5r9x2+agrQ8GHu/NMDMvTKUw6HnfTmltfWNzq7xd2dnd2z9wD49aJsk0402WyER3Qmq4FIo3UaDknVRzGoeSt8Px7cxvP3FtRKIecZLyIKZDJSLBKFrpwfSx71a9mjcHWSV+QapQoNF3v3qDhGUxV8gkNabreykGOdUomOTSi8zPKVsTIe8a6miMTdBPj91Ss6sMiBRom0pJHP190ROY2MmcWg7Y4ojs+zNxP+8bobRdZALlWbIFVsijJMCGzv8lAaM5QTiyhTAt7K2EjqilDm07FhuAv7xKWhc136v595fV+k0RxlO4BTOwYcrqMdNKAJDIbwDK/w5kjnxXl3PhatJaeYOY/cD5/AGmejd4=</latexit> Latent Conditioned Policies Structured stochasticity introduced through latent conditioned policy s t a t z ∼ q ω ( . ) Train latent space to capture prior task distribution Latent Space

  15. Meta-Training Latent Spaces Beyond capturing task distribution, train for quick adaptation via meta-learning Latent Space

  16. Meta-Training Latent Spaces Beyond capturing task distribution, train for quick adaptation via meta-learning Latent Space 1 step of RL Grasp red object

  17. Meta-Training Latent Spaces Beyond capturing task distribution, train for quick adaptation via meta-learning Latent Space Latent Space 1 step of RL Grasp red object

  18. Meta-Training Latent Spaces Beyond capturing task distribution, train for quick adaptation via meta-learning 1 step of RL 1 step of RL 1 step of RL Meta-train latent space, policy

  19. Meta-Training Latent Spaces Beyond capturing task distribution, train for quick adaptation via meta-learning 1 step of RL 1 step of RL 1 step of RL Meta-train latent space, policy Train with algorithm based on Model Agnostic Meta-Learning [1] Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networks, Finn et al ICML 2017

  20. Experiments: Robotic Manipulation Random Exploration

  21. Experiments: Robotic Manipulation Random Exploration MAESN exploration

  22. Experiments: Robotic Manipulation Random Exploration MAESN exploration

  23. Experiments: Legged Locomotion Random Exploration

  24. Experiments: Legged Locomotion Random Exploration MAESN exploration

  25. Experiments: Legged Locomotion Random Exploration MAESN exploration

  26. Quick Learning of New Tasks § Learns very quickly § Higher asymptotic reward than prior methods § Better exploration

  27. Quick Learning of New Tasks § Learns very quickly § Higher asymptotic reward than prior methods § Better exploration

  28. Quick Learning of New Tasks § Learns very quickly § Higher asymptotic reward than prior methods § Better exploration

  29. Quick Learning of New Tasks § Learns very quickly § Higher asymptotic reward than prior methods § Better exploration

  30. Thank You! YuXuan Liu Russell Mendonca Pieter Abbeel Sergey Levine Please come visit our poster at Room 210 and 230, AB #134 Find code and paper online at https://sites.google.com/view/meta-explore/

Recommend

Meta Reinforcement Learning as Task Inference Jan Humplik, Alexandre Galashov, Leonard

Meta Reinforcement Learning as Task Inference Jan Humplik, Alexandre Galashov, Leonard

Meta Reinforcement Learning as Task Inference Jan Humplik, Alexandre Galashov, Leonard Hasenclever, Pedro A.Ortega, Yee Whye Teh, Nicholas Heess Topic: Bayesian RL Presenter: Ram Ananth Why meta Reinforcement Learning? First Wave of Deep

912 views • 63 slides
Meta-Learning of Structured Representation by Proximal Mapping Mao Li, Yingyi Ma, Xinhua

Meta-Learning of Structured Representation by Proximal Mapping Mao Li, Yingyi Ma, Xinhua

Meta-Learning of Structured Representation by Proximal Mapping Mao Li, Yingyi Ma, Xinhua Zhang University of Illinois at Chicago Motivation Goal of meta-learning: Extract prior structures from a set of tasks that allows efficient learning of

748 views • 15 slides
Meta Reinforcement Learning Kate Rakelly 11/13/19 Questions we seek to answer Motivation : What

Meta Reinforcement Learning Kate Rakelly 11/13/19 Questions we seek to answer Motivation : What

Meta Reinforcement Learning Kate Rakelly 11/13/19 Questions we seek to answer Motivation : What problem is meta-RL trying to solve? Context : What is the connection to other problems in RL? Solutions : What are solution methods for meta-RL and

787 views • 52 slides
Prefrontal cortex as a meta-reinforcement learning system Wang et al. CS330 Student

Prefrontal cortex as a meta-reinforcement learning system Wang et al. CS330 Student

Prefrontal cortex as a meta-reinforcement learning system Wang et al. CS330 Student Presentation Motivation Computational Neuro: AI &lt;&gt; Neurobio Feedback Loop Convolutions and the eye, SNNs and Learning Rules, etc. Meta

283 views • 16 slides
Reinforcement Learning by the People and for the People: With a Focus on Lifelong / Meta /

Reinforcement Learning by the People and for the People: With a Focus on Lifelong / Meta /

Reinforcement Learning by the People and for the People: With a Focus on Lifelong / Meta / Transfer Learning Emma Brunskill Stanford CS234 Winter 2018 Quiz Information Monday, in class See piazza for room information (Released by

942 views • 81 slides
SOLAR: Deep Structured Representations for Model-Based Reinforcement Learning Marvin Zhang*,

SOLAR: Deep Structured Representations for Model-Based Reinforcement Learning Marvin Zhang*,

SOLAR: Deep Structured Representations for Model-Based Reinforcement Learning Marvin Zhang*, Sharad Vikram*, Laura Smith, Pieter Abbeel, Matthew J Johnson, Sergey Levine UC Berkeley, UC San Diego, Google Efficient reinforcement learning from

212 views • 20 slides
Neural Map: Structured Memory for Deep Reinforcement Learning Emilio Parisotto and Ruslan

Neural Map: Structured Memory for Deep Reinforcement Learning Emilio Parisotto and Ruslan

CS 885 Reinforcement Learning Neural Map: Structured Memory for Deep Reinforcement Learning Emilio Parisotto and Ruslan Salakhutdinov, ICLR 2018 Presented by Andreas Stckel July 6, 2018 motivation: navigating partially observable

1.49k views • 53 slides
Learning a Prior over Intent via Meta-Inverse Reinforcement Learning Kelvin Xu, Ellis Ratner, Anca

Learning a Prior over Intent via Meta-Inverse Reinforcement Learning Kelvin Xu, Ellis Ratner, Anca

Learning a Prior over Intent via Meta-Inverse Reinforcement Learning Kelvin Xu, Ellis Ratner, Anca Dragan, Sergey Levine, Chelsea Finn University of California, Berkeley Motivation : a well specified reward function remains an important

924 views • 42 slides
Distributed Meta Optimization of Reinforcement Learning Agents Greg Heinrich, Iuri Frosio - GTC

Distributed Meta Optimization of Reinforcement Learning Agents Greg Heinrich, Iuri Frosio - GTC

Distributed Meta Optimization of Reinforcement Learning Agents Greg Heinrich, Iuri Frosio - GTC San Jose, March 2019 Contents Introduction to Reinforcement Learning Introduction to Metaoptimization (on distributed systems) / Maglev

596 views • 45 slides
Todays Outline Reinforcement Learning Dan Weld Reinforcement Learning Q-value

Todays Outline Reinforcement Learning Dan Weld Reinforcement Learning Q-value

5/7/2012 CSE 473: Artificial Intelligence Todays Outline Reinforcement Learning Dan Weld Reinforcement Learning Q-value iteration Q-learning Exploration / exploitation Linear function approximation Linear function

159 views • 12 slides
Efficient Off-Policy Meta- Reinforcement Learning via Probabilistic Context Variables Rakelly,

Efficient Off-Policy Meta- Reinforcement Learning via Probabilistic Context Variables Rakelly,

Efficient Off-Policy Meta- Reinforcement Learning via Probabilistic Context Variables Rakelly, K., Zhou, A., Quillen, D., Finn, C., &amp; Levine, S ICML, 2019 Presented by: Egill Ian Gudmundsson Some Terminology On-policy learning: Only one

427 views • 16 slides
Class Structure Last time: Midterm! This time: Exploration and Exploitation Next time: Batch RL

Class Structure Last time: Midterm! This time: Exploration and Exploitation Next time: Batch RL

Lecture 11: Fast Reinforcement Learning 2 Emma Brunskill CS234 Reinforcement Learning. Winter 2018 2 With many slides from or derived from David Silver Lecture 11: Fast Reinforcement Learning 3 Emma Brunskill (CS234 Reinforcement Learning. )

887 views • 66 slides
1 Video of Demo Q-Learning Auto Cliff Grid Exploration vs. Exploitation How to Explore? Video

1 Video of Demo Q-Learning Auto Cliff Grid Exploration vs. Exploitation How to Explore? Video

Reinforcement Learning Reinforcement Learning II We still assume an MDP: A set of states s S A set of actions (per state) A A model T(s,a,s) A reward function R(s,a,s) Still looking for a policy (s) New

358 views • 6 slides
Structured Computation and Representation in Deep Reinforcement Learning Jessica B. Hamrick

Structured Computation and Representation in Deep Reinforcement Learning Jessica B. Hamrick

Structured Computation and Representation in Deep Reinforcement Learning Jessica B. Hamrick AAMAS/ICML/IJCAI Workshop on Prediction and Generative Modeling in RL Stockholm, Sweden July 15, 2018 Understanding the World in Terms of Objects and

1.71k views • 159 slides
PEARL Efficient Off-Policy Meta-Reinforcement Learning via Probabilistic Context Variables Kate

PEARL Efficient Off-Policy Meta-Reinforcement Learning via Probabilistic Context Variables Kate

PEARL Efficient Off-Policy Meta-Reinforcement Learning via Probabilistic Context Variables Kate Rakelly*, Aurick Zhou*, Deirdre Quillen, Chelsea Finn, Sergey Levine Hula Beach, Never grow up, The Sled - by artist Matt Spangler,

603 views • 12 slides
Unsupervised Meta-Learning for Reinforcement Learning LAMDA, Nanjing University . .

Unsupervised Meta-Learning for Reinforcement Learning LAMDA, Nanjing University . .

. . . . . . . . . . . . . . . . . Unsupervised Meta-Learning for Reinforcement Learning LAMDA, Nanjing University . . . . . . . . . . . . . . . . . . . . . . . November 9, 2020 . . . . . .

664 views • 47 slides
Offline Reinforcement Learning CS 285 Instructor: Aviral Kumar UC Berkeley What have we

Offline Reinforcement Learning CS 285 Instructor: Aviral Kumar UC Berkeley What have we

Offline Reinforcement Learning CS 285 Instructor: Aviral Kumar UC Berkeley What have we covered so far? Exploration: - Strategies to discover high-reward states, diverse skills, etc. - How hard is exploration? Super Large

802 views • 43 slides
Exploration: Part 2 CS 294-112: Deep Reinforcement Learning Sergey Levine Class Notes 1.

Exploration: Part 2 CS 294-112: Deep Reinforcement Learning Sergey Levine Class Notes 1.

Exploration: Part 2 CS 294-112: Deep Reinforcement Learning Sergey Levine Class Notes 1. Homework 4 due next Wednesday! Recap: whats the problem? this is easy (mostly) this is impossible Why? Recap: classes of exploration methods in deep

693 views • 42 slides
Causal Reasoning from Meta-reinforcement Learning Dasgupta et al. (2018) CS330 Student

Causal Reasoning from Meta-reinforcement Learning Dasgupta et al. (2018) CS330 Student

Causal Reasoning from Meta-reinforcement Learning Dasgupta et al. (2018) CS330 Student Presentation Background: Why Causal Reasoning? There is only so much of the world we can understand via observation. Cancer (correlates to) Smoking

297 views • 19 slides
Meta Reinforcement Learning Chelsea Finn Why are humans so good at RL? People have prior

Meta Reinforcement Learning Chelsea Finn Why are humans so good at RL? People have prior

Meta Reinforcement Learning Chelsea Finn Why are humans so good at RL? People have prior experience. People have an existing representation of the world. Can we learn a representation under which RL is fast? Key idea : Explicitly optimize for

1.04k views • 41 slides
Gaussian Processes for Sample Efficient Reinforcement Learning with RMAX-like Exploration Tobias

Gaussian Processes for Sample Efficient Reinforcement Learning with RMAX-like Exploration Tobias

Gaussian Processes for Sample Efficient Reinforcement Learning with RMAX-like Exploration Tobias Jung and Peter Stone Department of Computer Science University of Texas at Austin { tjung,pstone } @cs.utexas.edu Outline: 1. Motivation &amp;

349 views • 18 slides
Structured Losses Zero-Shot Task Generalization with Multi-Task Deep Reinforcement Learning

Structured Losses Zero-Shot Task Generalization with Multi-Task Deep Reinforcement Learning

Structured Losses Zero-Shot Task Generalization with Multi-Task Deep Reinforcement Learning Junhyuk Oh, Satinder Singh, Honglak Lee, Pushmeet Kohli Oh et al. 2017 https://arxiv.org/abs/1706.05064 Presented by Beln Saldas belen@mit.edu

820 views • 51 slides
Hierarchically Structured Meta-learning Huaxiu Yao 1,2 , Ying Wei 2 , Junzhou Huang 1 , Zhenhui Li

Hierarchically Structured Meta-learning Huaxiu Yao 1,2 , Ying Wei 2 , Junzhou Huang 1 , Zhenhui Li

Hierarchically Structured Meta-learning Huaxiu Yao 1,2 , Ying Wei 2 , Junzhou Huang 1 , Zhenhui Li 2 1 Pennsylvania State University 2 Tencent AI Lab Oral: Thu Jun 13th 09:35 -- 09:40 AM @ Room 103 Poster: Thu Jun 13th 06:30 -- 09:00 PM @ Pacific

1.04k views • 15 slides
Distributional Reinforcement Learning for Efficient Exploration Hengshuai Yao Huawei Hi-Silicon

Distributional Reinforcement Learning for Efficient Exploration Hengshuai Yao Huawei Hi-Silicon

Distributional Reinforcement Learning for Efficient Exploration Hengshuai Yao Huawei Hi-Silicon June, 2019 Hengshuai Yao (Huawei Hi-Silicon) June, 2019 1/10 The exploration problem Exploration is a long standing problem in Reinforcement

346 views • 10 slides

More recommend