conqur mitigating delusional bias in deep q learning
play

ConQUR: Mitigating Delusional Bias in Deep Q-Learning DiJia (Andy) - PowerPoint PPT Presentation

Dec 05, 2023 •515 likes •856 views

ConQUR: Mitigating Delusional Bias in Deep Q-Learning DiJia (Andy) Su (Princeton) Jayden Ooi (Google) Tyler Lu (Google) Dale Schuurmans (Google) Craig Boutilier (Google) - Search:

  1. ConQUR: Mitigating Delusional Bias in Deep Q-Learning DiJia (Andy) Su (Princeton) Jayden Ooi (Google) Tyler Lu (Google) Dale Schuurmans (Google) Craig Boutilier (Google)

  2. -

  3. •

  4. ●

  10. • • • •

  11. • •

  12. • •

  13. Search: Q-Regressors P 13 Proprietary & Confidential

  14. Batch #1 - - - ……………………………………….. - ……………………………………….. P 14 Proprietary & Confidential

  15. Batch #1 Batch #1 - - Generate & fit G e n e - - r a Q Q-labels t e - l a & b - ……………………………………….. - ……………………………………….. fi e t l s - ……………………………………….. - ……………………………………….. P 15 Proprietary & Confidential

  16. Batch #1 Batch #1 - - Generate & fit G e n e - - r a Q Q-labels t e - l a & b - ……………………………………….. - ……………………………………….. fi e t l s - ……………………………………….. - ……………………………………….. P 16 Proprietary & Confidential

  17. Batch #1 Batch #1 - - Generate & fit G e n e - - r a Q Q-labels t e - l a & b - ……………………………………….. - ……………………………………….. fi e t l s - ……………………………………….. - ……………………………………….. P 17 Proprietary & Confidential

  18. Batch #1 Batch #1 G - - Generate & fit e n e r a - - Q t Q-labels e - l a & b fi e - ……………………………………….. - ……………………………………….. l t s - ……………………………………….. - ……………………………………….. Q-Label Set Q-Label Set #1 #2 P 18 Proprietary & Confidential

  19. Batch #1 Batch #1 - - - - - ……………………………………….. - ……………………………………….. - ……………………………………….. - ……………………………………….. Q-Label Set Q-Label Set #1 #2 P 19 Proprietary & Confidential

  20. Batch #1 Batch #1 - - - - - ……………………………………….. - ……………………………………….. - ……………………………………….. - ……………………………………….. Batch #2 - - - ……………………………………….. - ……………………………………….. P 20 Proprietary & Confidential

  21. Batch #1 Batch #1 - - - - - ……………………………………….. - ……………………………………….. - ……………………………………….. - ……………………………………….. Batch #2 - - - ……………………………………….. - ……………………………………….. P 21 Proprietary & Confidential

  22. Batch #1 Batch #1 - - - - - ……………………………………….. - ……………………………………….. - ……………………………………….. - ……………………………………….. Batch #2 - - - ……………………………………….. - ……………………………………….. P 22 Proprietary & Confidential

  23. ……… P 23 Proprietary & Confidential

  24. - - - -

  25. 1)

  26. λ

  27. λ

  28. • • • • -

  29. •

  30. •

  32. • • • •

Recommend

Estimating and Mitigating Gender Bias in Deep Image Representations Tianlu Wang University of

Estimating and Mitigating Gender Bias in Deep Image Representations Tianlu Wang University of

Balance ced Datasets Are Not Enough: Estimating and Mitigating Gender Bias in Deep Image Representations Tianlu Wang University of Virginia Tianlu Wang-Gender Bias in Deep Image Representation Gender Bias in Visual Recognition Systems Deep

487 views • 36 slides
CS7015 (Deep Learning) : Lecture 8 Regularization: Bias Variance Tradeoff, l2 regularization,

CS7015 (Deep Learning) : Lecture 8 Regularization: Bias Variance Tradeoff, l2 regularization,

CS7015 (Deep Learning) : Lecture 8 Regularization: Bias Variance Tradeoff, l2 regularization, Early stopping, Dataset augmentation, Parameter sharing and tying, Injecting noise at input, Ensemble methods, Dropout Mitesh M. Khapra Department of

1.06k views • 86 slides
A short overview on Reducing model bias in a deep learning classifier using domain adversarial

A short overview on Reducing model bias in a deep learning classifier using domain adversarial

A short overview on Reducing model bias in a deep learning classifier using domain adversarial neural networks in the MINERA experiment Anushree Ghosh, UTFSM, Chile Fermilab Date: 2018-11-07 1 Outline MINERvA detector and the

369 views • 25 slides
Mitigating Gender Bias Amplification in Distribution by Posterior Regularization Shengyu Jia *

Mitigating Gender Bias Amplification in Distribution by Posterior Regularization Shengyu Jia *

Mitigating Gender Bias Amplification in Distribution by Posterior Regularization Shengyu Jia * , Tao Meng * , Jieyu Zhao , Kai-Wei Chang Tsinghua University University of California, Los Angeles Credit to Mark Yatskar Credit

162 views • 13 slides
Bias Also Matters: Bias Attribution for Deep Neural Network Explanation Shengjie Wang*, Tianyi

Bias Also Matters: Bias Attribution for Deep Neural Network Explanation Shengjie Wang*, Tianyi

Bias Also Matters: Bias Attribution for Deep Neural Network Explanation Shengjie Wang*, Tianyi Zhou*, Jeff A. Bilmes University of Washington, Seattle Explain DNNs as a linear model per data point DNN with piecewise linear activations like

250 views • 9 slides
Hao Su July 6, 2017 Outline Overview of 3D deep learning 3D deep learning algorithms

Hao Su July 6, 2017 Outline Overview of 3D deep learning 3D deep learning algorithms

Deep 3D Representation Learning for Visual Computing Hao Su July 6, 2017 Outline Overview of 3D deep learning 3D deep learning algorithms Conclusion 2 Outline Overview of 3D deep learning Background 3D deep learning tasks 3D deep

1.66k views • 122 slides
ACCELERATE DEEP LEARNING WITH NVIDIA'S DEEP LEARNING PLATFORM | STEPHEN JONES | GTC16 DEEP

ACCELERATE DEEP LEARNING WITH NVIDIA'S DEEP LEARNING PLATFORM | STEPHEN JONES | GTC16 DEEP

ACCELERATE DEEP LEARNING WITH NVIDIA'S DEEP LEARNING PLATFORM | STEPHEN JONES | GTC16 DEEP LEARNING EVERYWHERE INTERNET & CLOUD MEDICINE & BIOLOGY MEDIA & ENTERTAINMENT SECURITY & DEFENSE AUTONOMOUS MACHINES Image

308 views • 26 slides
Mitigating Information Leakage in Image Representations: A Maximum Entropy Approach Proteek Roy

Mitigating Information Leakage in Image Representations: A Maximum Entropy Approach Proteek Roy

Mitigating Information Leakage in Image Representations: A Maximum Entropy Approach Proteek Roy and Vishnu Boddeti Michigan State University CVPR 2019 [~]$ [1/13] >>> Representation Learning: The Bright Side * Deep Embeddings: E (

674 views • 39 slides
BIAS What Is Bias? Bias can be defined as favoring one side, position, or belief being

BIAS What Is Bias? Bias can be defined as favoring one side, position, or belief being

BIAS What Is Bias? Bias can be defined as favoring one side, position, or belief being partial or prejudiced Where have you seen bias? Bias vs. Propaganda Bias is prejudice; a preconceived judgment or an opinion formed

717 views • 29 slides
Bias-Variance Tradeoff Machine Learning 1 Bias and variance Every learning algorithm requires

Bias-Variance Tradeoff Machine Learning 1 Bias and variance Every learning algorithm requires

Bias-Variance Tradeoff Machine Learning 1 Bias and variance Every learning algorithm requires assumptions about the hypothesis space. Eg: My hypothesis space is linear decision trees with 5 nodes a three layer

189 views • 17 slides
Deep Learning on GPUs March 2016 What is Deep Learning? GPUs and DL AGENDA DL in practice

Deep Learning on GPUs March 2016 What is Deep Learning? GPUs and DL AGENDA DL in practice

Deep Learning on GPUs March 2016 What is Deep Learning? GPUs and DL AGENDA DL in practice Scaling up DL 2 What is Deep Learning? 3 DEEP LEARNING EVERYWHERE INTERNET & CLOUD MEDICINE & BIOLOGY SECURITY & DEFENSE MEDIA &

1.45k views • 39 slides
Reproducibility and Replicability in Deep Reinforcement Learning (and Other Deep Learning

Reproducibility and Replicability in Deep Reinforcement Learning (and Other Deep Learning

Reproducibility and Replicability in Deep Reinforcement Learning (and Other Deep Learning Methods) Peter Henderson Statistical Society of Canada Annual Meeting 2018 Contributors Riashat Islam Phil Bachman Doina Precup David Meger Joelle

850 views • 37 slides
Invertible Generative Models for Inverse Problems Mitigating Representation Error and Dataset Bias

Invertible Generative Models for Inverse Problems Mitigating Representation Error and Dataset Bias

Invertible Generative Models for Inverse Problems Mitigating Representation Error and Dataset Bias M. Asim, M. Daniels, O. Leong, P . Hand, A. Ahmed Inverse Problems with Generative Models as Image Priors Inverse Problems with Generative Models

369 views • 22 slides
The Bugs That Won't Go Away Your role in delusional infestation The webinar will begin promptly

The Bugs That Won't Go Away Your role in delusional infestation The webinar will begin promptly

The Bugs That Won't Go Away Your role in delusional infestation The webinar will begin promptly at 11am EDT (GMT -04:00). Please make sure your computer speakers are on. There is no call in number. Use the chat box (to everyone) for any

580 views • 25 slides
Bias Busting Across the Center: A Model to Interrupt Bias and Promote Inclusion Modeled on

Bias Busting Across the Center: A Model to Interrupt Bias and Promote Inclusion Modeled on

Bias Busting Across the Center: A Model to Interrupt Bias and Promote Inclusion Modeled on Googles BiasBusting@Work and Carnegie Mellons Bias Busters @ CMU Learning Outcomes Understand the role that biases play, positively &

637 views • 34 slides
Image Classification with DIGITS NVIDIA Deep Learning Institute 1 DEEP LEARNING INSTITUTE DLI

Image Classification with DIGITS NVIDIA Deep Learning Institute 1 DEEP LEARNING INSTITUTE DLI

Image Classification with DIGITS NVIDIA Deep Learning Institute 1 DEEP LEARNING INSTITUTE DLI Mission Helping people solve challenging problems using AI and deep learning. Developers, data scientists and engineers Self-driving cars,

1.44k views • 72 slides
Shallow-Deep Networks: Understanding and Mitigating Network Overthinking Yiitcan Kaya , Sanghyun

Shallow-Deep Networks: Understanding and Mitigating Network Overthinking Yiitcan Kaya , Sanghyun

Shallow-Deep Networks: Understanding and Mitigating Network Overthinking Yiitcan Kaya , Sanghyun Hong, Tudor Dumitra University of Maryland, College Park ICML 2019 - Long Beach, CA What is overthinking? We, especially grad students , often

408 views • 24 slides
Deep Neural Networks and Deep Reinforcement Learning Deep Learning, Goodfellow, Bengio and

Deep Neural Networks and Deep Reinforcement Learning Deep Learning, Goodfellow, Bengio and

Deep Neural Networks and Deep Reinforcement Learning Deep Neural Networks and Deep Reinforcement Learning Deep Learning, Goodfellow, Bengio and Courville [chapt. 6,7,8]; AIMA [sect. 21.1-21.3]; Sutton and Barto, Reinforcement Learning: an

527 views • 35 slides
Natural Language Processing with Deep Learning CS224N The Future of Deep Learning + NLP Kevin

Natural Language Processing with Deep Learning CS224N The Future of Deep Learning + NLP Kevin

Natural Language Processing with Deep Learning CS224N The Future of Deep Learning + NLP Kevin Clark Deep Learning for NLP 5 years ago No Seq2Seq No Attention No large-scale QA/reading comprehension datasets No TensorFlow or

1.41k views • 92 slides
An Overview of Deep Residual Learning Semih Yagcioglu 01.03.2016 Deep Residual Learning

An Overview of Deep Residual Learning Semih Yagcioglu 01.03.2016 Deep Residual Learning

An Overview of Deep Residual Learning Semih Yagcioglu 01.03.2016 Deep Residual Learning Microsoft Research Asia (MSRA) Kaiming He, Xiangyu Zhang, Shaoqing Ren, & Jian Sun. Deep Residual Learning for Image Recognition. arXiv

1.32k views • 54 slides
Deep Reinforcement Learning [Mastering the Game of Go with Deep Reinforcement Learning and Tree

Deep Reinforcement Learning [Mastering the Game of Go with Deep Reinforcement Learning and Tree

Deep Reinforcement Learning [Mastering the Game of Go with Deep Reinforcement Learning and Tree Search, Nature 2016] CS 486/686 University of Waterloo Lecture 21: July 12, 2017 Outline AlphaGo Supervised Learning of Policy Networks

541 views • 15 slides
Mocha.jl Deep Learning in Julia Chiyuan Zhang (@pluskid) CSAIL, MIT Deep Learning Learning

Mocha.jl Deep Learning in Julia Chiyuan Zhang (@pluskid) CSAIL, MIT Deep Learning Learning

Mocha.jl Deep Learning in Julia Chiyuan Zhang (@pluskid) CSAIL, MIT Deep Learning Learning with multi-layer (3~30) neural networks, on a huge training set. State-of-the-art on many AI tasks Computer Vision : Image Classification,

1.53k views • 23 slides
Minjie Wang Deep Learning Deep Learning trend in the past 10 years Caffe State-of-art DL

Minjie Wang Deep Learning Deep Learning trend in the past 10 years Caffe State-of-art DL

Tofu: Parallelizing Deep Learning Systems with Automatic Tiling Minjie Wang Deep Learning Deep Learning trend in the past 10 years Caffe State-of-art DL system is based on dataflow GPU#0 w1 w2 data g1 g2 Forward propagation

405 views • 38 slides
Deep Learning: Theory and Practice Deep Learning - Practical 02-04-2020 Considerations

Deep Learning: Theory and Practice Deep Learning - Practical 02-04-2020 Considerations

Deep Learning: Theory and Practice Deep Learning - Practical 02-04-2020 Considerations deeplearning.cce2020@gmail.com Deep Networks Intuition Neural networks with multiple hidden layers - Deep networks [Hinton, 2006] Deep Networks Intuition

1.33k views • 28 slides

More recommend