preference based bayesian optimization in high dimensions
play

Preference-Based Bayesian Optimization in High Dimensions with Human - PowerPoint PPT Presentation

Feb 06, 2024 •40 likes •70 views

Preference-Based Bayesian Optimization in High Dimensions with Human Feedback Myra Cheng, Ellen Novoseller, Maegan Tucker, Richard Cheng, Joel Burdick, Yisong Yue California Institute of Technology At every iteration: LineCoSpar Algorithm

  1. Preference-Based Bayesian Optimization in High Dimensions with Human Feedback Myra Cheng, Ellen Novoseller, Maegan Tucker, Richard Cheng, Joel Burdick, Yisong Yue California Institute of Technology

  2. At every iteration: LineCoSpar Algorithm Pairwise preferences and coactive feedback ● Gaussian process-based model of the underlying utilities Human user Iteratively update the ● posterior from preference feedback Bayesian Preference ● Learn in high dimensions Model of utilities via 1-D subspaces over 1-D subspace and visited actions Actions selected via posterior sampling

  3. Validated in User Studies Cartpole Simulation (4-D) Wearable Exoskeleton (6-D)

Recommend

Scaling Bayesian Optimization in High Dimensions Stefanie Jegelka, MIT BayesOpt Workshop 2017

Scaling Bayesian Optimization in High Dimensions Stefanie Jegelka, MIT BayesOpt Workshop 2017

Scaling Bayesian Optimization in High Dimensions Stefanie Jegelka, MIT BayesOpt Workshop 2017 joint work with Zi Wang , Chengtao Li, Clement Gehring (MIT) and Pushmeet Kohli (DeepMind) Bayesian Optimization with GPs f ( x )

421 views • 23 slides
Outline Intro to RL and Bayesian Learning History of Bayesian RL Model-based Bayesian

Outline Intro to RL and Bayesian Learning History of Bayesian RL Model-based Bayesian

Outline Intro to RL and Bayesian Learning History of Bayesian RL Model-based Bayesian RL Prior knowledge, policy optimization, discussion, Bayesian approaches for other RL variants Model-free Bayesian RL Gaussian

1.23k views • 63 slides
Stochastic optimization and sparse statistical recovery: An optimal algorithm for high dimensions

Stochastic optimization and sparse statistical recovery: An optimal algorithm for high dimensions

Stochastic optimization and sparse statistical recovery: An optimal algorithm for high dimensions Alekh Agarwal Microsoft Research Joint work with Sahand Negahban and Martin Wainwright Workshop on Optimization and Statistical Learning 2013, Les

695 views • 42 slides
Zeroth-order Optimization Yining Wang in High Dimensions Carnegie Mellon University Joint work

Zeroth-order Optimization Yining Wang in High Dimensions Carnegie Mellon University Joint work

AISTATS 2018, Playa Blanca, Lanzarote, Spain Zeroth-order Optimization Yining Wang in High Dimensions Carnegie Mellon University Joint work with Simon Du, Sivaraman Balakrishnan and Aarti Singh B ACKGROUND Optimization: min x X f ( x )

253 views • 23 slides
Hessian-based sampling in high dimensions for goal-oriented model order reduction Peng Chen Omar

Hessian-based sampling in high dimensions for goal-oriented model order reduction Peng Chen Omar

Hessian-based sampling in high dimensions for goal-oriented model order reduction Peng Chen Omar Ghattas Center for Computational Geosciences and Optimization The Institute for Computational Engineering and Sciences The University of Texas at

795 views • 60 slides
R2-B2: Recursive Reasoning-Based Bayesian Optimization for No-Regret Learning in Games Zhongxiang

R2-B2: Recursive Reasoning-Based Bayesian Optimization for No-Regret Learning in Games Zhongxiang

R2-B2: Recursive Reasoning-Based Bayesian Optimization for No-Regret Learning in Games Zhongxiang Dai 1 Yizhou Chen 1 Bryan Kian Hsiang Low 1 Patrick Jaillet 2 Teck-Hua Ho 3 1 Department of Computer Science, National University of Singapore 2

534 views • 18 slides
Bayesian optimization and Information-based Approaches Jos e Miguel Hern andez-Lobato

Bayesian optimization and Information-based Approaches Jos e Miguel Hern andez-Lobato

Bayesian optimization and Information-based Approaches Jos e Miguel Hern andez-Lobato joint work with Michael A. Gelbart, Matt W. Hoffman, Ryan P. Adams and Zoubin Ghahramani April 31, 2015 (50% of these slides have been made by Matt)

723 views • 28 slides
A Novel Layer Sharing-based Incremental Learning via Bayesian Optimization Bomi Kim, Taehyeon

A Novel Layer Sharing-based Incremental Learning via Bayesian Optimization Bomi Kim, Taehyeon

1 st International Electronic Conference on Applied Sciences A Novel Layer Sharing-based Incremental Learning via Bayesian Optimization Bomi Kim, Taehyeon Kim and Yoonsik Choe Department of Electrical and Electronic Engineering, Yonsei

635 views • 20 slides
3. Preference Learning Techniques a. Learning Utility Functions b. Learning Preference

3. Preference Learning Techniques a. Learning Utility Functions b. Learning Preference

AGENDA 1. Preference Learning Tasks 2. Performance Assessment and Loss Functions 3. Preference Learning Techniques a. Learning Utility Functions b. Learning Preference Relations c. Structured Output Prediction d. Model-Based Preference

583 views • 39 slides
Preference Elicitation for Interface Optimization Krzysztof Gajos and Daniel S. Weld University

Preference Elicitation for Interface Optimization Krzysztof Gajos and Daniel S. Weld University

Preference Elicitation for Interface Optimization Krzysztof Gajos and Daniel S. Weld University of Washington, Seattle Krzysztof Gajos Motivation: Supple Model-Based Interface Renderer Func. Custom Device User + + Interface Interface

809 views • 52 slides
Bayesian Optimization CSC2541 - Topics in Machine Learning Scalable and Flexible Models of

Bayesian Optimization CSC2541 - Topics in Machine Learning Scalable and Flexible Models of

Bayesian Optimization CSC2541 - Topics in Machine Learning Scalable and Flexible Models of Uncertainty University of Toronto - Fall 2017 Overview 1. Bayesian Optimization of Machine Learning Algorithms 2. Gaussian Process Optimization in the

1.53k views • 94 slides
Preference Litigation ASK LLP What is a preference? A preference is a payment made by an

Preference Litigation ASK LLP What is a preference? A preference is a payment made by an

Preference Litigation ASK LLP What is a preference? A preference is a payment made by an insolvent debtor that favors certain creditors over others. The causes of action to avoid and recover preferential payments are codified in 11

853 views • 39 slides
Safe Bayesian Optimization for Optimal Control Schillinger, M., Hartmann, B., Skalecki, P.,

Safe Bayesian Optimization for Optimal Control Schillinger, M., Hartmann, B., Skalecki, P.,

Safe Bayesian Optimization for Optimal Control Schillinger, M., Hartmann, B., Skalecki, P., Meister, M., Nguyen-Tuong, D., & Nelles, O. (2017). Safe Active Learning and Safe Bayesian Optimization for Tuning a PI-Controller. IFAC-PapersOnLine ,

203 views • 6 slides
Knowing The What, But Not The Where in Bayesian Optimization Vu Nguyen & Michael A. Osborne

Knowing The What, But Not The Where in Bayesian Optimization Vu Nguyen & Michael A. Osborne

Knowing The What, But Not The Where in Bayesian Optimization Vu Nguyen & Michael A. Osborne University of Oxford Vu Nguyen Bayesian Optimization 1 Black-box Optimization The relationship from to is through the black-box. Output

259 views • 24 slides
My research over Bayesian Optimization and Gaussian Processes Eduardo C. GarridoMerch an

My research over Bayesian Optimization and Gaussian Processes Eduardo C. GarridoMerch an

My research over Bayesian Optimization and Gaussian Processes Eduardo C. GarridoMerch an PhD student. Teacher Assistant. Universidad Aut onoma de Madrid 1/13 Index Introduction: Bayesian Optimization and Gaussian Processes. 2/13

923 views • 70 slides
A Theoretical Analysis of Curvature Based Preference Models Pradyumn Shukla 1 Michael Emmerich 2

A Theoretical Analysis of Curvature Based Preference Models Pradyumn Shukla 1 Michael Emmerich 2

A Theoretical Analysis of Curvature Based Preference Models Pradyumn Shukla 1 Michael Emmerich 2 Andr Deutz 2 1 Karlsruhe Institute of Technology Institute AIFB 2 Leiden University LIACS Multi-objective Optimization Problem Given m , n

339 views • 13 slides
Projected Stein variational Newton: A fast and scalable Bayesian inference method in high

Projected Stein variational Newton: A fast and scalable Bayesian inference method in high

Projected Stein variational Newton: A fast and scalable Bayesian inference method in high dimensions Peng Chen Keyi Wu, Joshua Chen, Thomas OLeary-Roseberry, Omar Ghattas Oden Institute for Computational Engineering and Sciences The University

1.16k views • 75 slides
New Langevin based algorithms for MCMC in high dimensions Alain Durmus Joint work with Gareth O.

New Langevin based algorithms for MCMC in high dimensions Alain Durmus Joint work with Gareth O.

New Langevin based algorithms for MCMC in high dimensions Alain Durmus Joint work with Gareth O. Roberts, Gilles Vilmart and Konstantinos Zygalakis. Dpartement TSI, Telecom ParisTech Siximes rencontres des jeunes statisticiens Main themes

426 views • 41 slides
Scalable Global Optimization via Local Bayesian Optimization David Eriksson Uber AI

Scalable Global Optimization via Local Bayesian Optimization David Eriksson Uber AI

Scalable Global Optimization via Local Bayesian Optimization David Eriksson Uber AI eriksson@uber.com Matthias Poloczek Michael Pearce Jake Gardner Ryan Turner Global Optimization Find such that

436 views • 11 slides
An Alternative Preference Relation to Deal with Many-Objective Optimization Problems Antonio

An Alternative Preference Relation to Deal with Many-Objective Optimization Problems Antonio

An Alternative Preference Relation to Deal with Many-Objective Optimization Problems Antonio Lpez-Jaimes Japan Aerospace Exploration Agency Institute of Space and Astronautical Science December 17th, 2012 Outline of the Presentation

445 views • 41 slides
Regret bounds for meta Bayesian optimization with an unknown Gaussian process prior Zi Wang*

Regret bounds for meta Bayesian optimization with an unknown Gaussian process prior Zi Wang*

Regret bounds for meta Bayesian optimization with an unknown Gaussian process prior Zi Wang* Beomjoon Kim* Leslie Pack Kaelbling Dec 5 @ NeurIPS 18 Poster #22 Bayesian optimization x * = argmax Goal: f ( x ) x

346 views • 20 slides
Bayesian Optimization for Likelihood-Free Inference Michael Gutmann

Bayesian Optimization for Likelihood-Free Inference Michael Gutmann

Bayesian Optimization for Likelihood-Free Inference Michael Gutmann https://sites.google.com/site/michaelgutmann University of Edinburgh 14th September 2016 Reference For further information: M.U. Gutmann and J. Corander Bayesian

984 views • 24 slides
Utility Preference Robust Optimization: Piecewise Linear Approximation and Statistical Robustness

Utility Preference Robust Optimization: Piecewise Linear Approximation and Statistical Robustness

Utility Preference Robust Optimization: Piecewise Linear Approximation and Statistical Robustness Huifu Xu School of Mathematical Sciences, University of Southampton, UK. (Joint work with Shaoyan Guo) Presented at CMS & MMEI Chemnitz 29

981 views • 96 slides
CSC321 Lecture 21: Bayesian Hyperparameter Optimization Roger Grosse Roger Grosse CSC321

CSC321 Lecture 21: Bayesian Hyperparameter Optimization Roger Grosse Roger Grosse CSC321

CSC321 Lecture 21: Bayesian Hyperparameter Optimization Roger Grosse Roger Grosse CSC321 Lecture 21: Bayesian Hyperparameter Optimization 1 / 25 Overview Todays lecture: a neat application of Bayesian parameter estimation to automatically

745 views • 25 slides

More recommend