robust nonlinear optimization
play

Robust nonlinear Optimization Maren Mahsereci Workshop on - PowerPoint PPT Presentation

Oct 22, 2023 •322 likes •889 views

Robust nonlinear Optimization Maren Mahsereci Workshop on Uncertainty Quantification 09 / 15 / 2016, Sheffield Emmy Noether Group on Probabilistic Numerics Department of Empirical Inference Max Planck Institute for Intelligent Systems

  1. Robust nonlinear Optimization Maren Mahsereci Workshop on Uncertainty Quantification 09 / 15 / 2016, Sheffield Emmy Noether Group on Probabilistic Numerics Department of Empirical Inference Max Planck Institute for Intelligent Systems Tübingen, Germany

  2. Robust optimization . . . outline ▸ basics about greedy optimizers ▸ GD and SGD : (stochastic) gradient descent ▸ robust stochastic optimization ▸ example: step size adaptation ▸ extending line searches ▸ robust search directions 1 ,

  3. Typical scheme . . . greedy and gradient based optimizer x ∗ = arg min L( x ) x x i + 1 ← x i − α i s i 1. s i – which direction? → model objective function locally 2. α i – how far? → prevent blow ups and stagnation 3. repeat ▸ needs to work for many different L( x ) 2 ,

  4. Typical scheme . . . greedy and gradient based optimizer x ∗ = arg min L( x ) x x i + 1 ← x i − α i s i 1. s i – which direction? → model objective function locally 2. α i – how far? → prevent blow ups and stagnation 3. repeat ▸ needs to work for many different L( x ) 2 ,

  5. The steepest way downhill . . . gradient descend finds local minimum x ∗ = arg min L( x ) x x i + 1 ← x i − α ∇L( x i ) , α = const. 3 ,

  6. The steepest way downhill . . . gradient descend finds local minimum x ∗ = arg min L( x ) x x i + 1 ← x i − α ∇L( x i ) , α = const. 3 ,

  7. The steepest way downhill . . . gradient descend finds local minimum x ∗ = arg min L( x ) x x i + 1 ← x i − α ∇L( x i ) , α = const. 3 ,

  8. The steepest way downhill . . . gradient descend finds local minimum x ∗ = arg min L( x ) x x i + 1 ← x i − α ∇L( x i ) , α = const. 3 ,

  9. The steepest way downhill . . . gradient descend finds local minimum x ∗ = arg min L( x ) x x i + 1 ← x i − α ∇L( x i ) , α = const. 3 ,

  10. The steepest way downhill . . . gradient descend finds local minimum x ∗ = arg min L( x ) x x i + 1 ← x i − α ∇L( x i ) , α = const. 3 ,

  11. The steepest way downhill . . . gradient descend finds local minimum x ∗ = arg min L( x ) x x i + 1 ← x i − α ∇L( x i ) , α = const. 3 ,

  12. The steepest way downhill . . . gradient descend finds local minimum x ∗ = arg min L( x ) x x i + 1 ← x i − α ∇L( x i ) , α = const. 3 ,

  13. The steepest way downhill . . . gradient descend finds local minimum x ∗ = arg min L( x ) x x i + 1 ← x i − α ∇L( x i ) , α = const. 3 ,

  14. The steepest way downhill . . . gradient descend finds local minimum x ∗ = arg min L( x ) x x i + 1 ← x i − α ∇L( x i ) , α = const. 3 ,

  15. Additional difficulty x ∗ = arg min x L( x ) .. noisy functions by mini-batching sometimes we do not know −∇L( x i ) precisely! 4 ,

  16. Additional difficulty x ∗ = arg min x L( x ) .. noisy functions by mini-batching M m L( x ) ∶ = 1 ℓ ( x,y i ) ≈ 1 ℓ ( x,y j ) = ∶ ˆ L( x ) , m ≪ M ∑ ∑ M m i = 1 j = 1 ▸ compute only smaller sum over m L( x ) approximates L( x ) well ▸ hope that ˆ ▸ smaller m means higher noise on ∇ L( x ) 5 ,

  17. Additional difficulty x ∗ = arg min x L( x ) .. noisy functions by mini-batching M m L( x ) ∶ = 1 ℓ ( x,y i ) ≈ 1 ℓ ( x,y j ) = ∶ ˆ L( x ) , m ≪ M ∑ ∑ M m i = 1 j = 1 ▸ compute only smaller sum over m L( x ) approximates L( x ) well ▸ hope that ˆ ▸ smaller m means higher noise on ∇ L( x ) for iid. mini-batches, noise is approximately Gaussian L( x ) = ˆ L( x ) + ǫ, ǫ ∼ N ( 0 , O ( M − m )) m L( x ) ˆ ∼ 5 ,

  18. The steepest way downhill . . . in expectation: SGD finds local minimum, too. x ∗ = arg min L( x ) x x i + 1 ← x i − α ˆ ∇L( x i ) , α = const. 15 10 5 0 − 4 − 2 0 2 4 6 8 10 6 ,

  19. The steepest way downhill . . . in expectation: SGD finds local minimum, too. x ∗ = arg min L( x ) x x i + 1 ← x i − α ˆ ∇L( x i ) , α = const. 15 10 5 0 − 4 − 2 0 2 4 6 8 10 6 ,

  20. Step size adaptation ... by line searches x i + 1 ← x i − α i s i so far α was constant and hand-chosen! ▸ line searches automatically choose step sizes 7 ,

  21. Line searches x ∗ = arg min x L( x ) automated learning rate adaptation x i + 1 ← x i − α i ∇L( x i ) set scalar step size α i given direction −∇L( x i ) 15 small step size 10 5 0 − 4 − 2 0 2 4 6 8 10 8 ,

  22. Line searches x ∗ = arg min x L( x ) automated learning rate adaptation x i + 1 ← x i − α i ∇L( x i ) set scalar step size α i given direction −∇L( x i ) 15 small step size large step size 10 5 0 − 4 − 2 0 2 4 6 8 10 8 ,

  23. Line searches x ∗ = arg min x L( x ) automated learning rate adaptation x i + 1 ← x i − α i ∇L( x i ) set scalar step size α i given direction −∇L( x i ) 15 small step size large step size line search 10 5 0 − 4 − 2 0 2 4 6 8 10 8 ,

  24. Line searches x ∗ = arg min x L( x ) automated learning rate adaptation x i + 1 ← x i − α i ∇L( x i ) set scalar step size α i given noisy direction −∇ ˆ L( x i ) 15 small step size large step size line search 10 5 0 − 4 − 2 0 2 4 6 8 10 Line searches break in stochastic setting! 8 ,

  25. Step size adaptation ... by line searches x i + 1 ← x i − α i s i ▸ line searches automatically choose step sizes ▸ very fast subroutines called in each optimization step ▸ control blow up or stagnation ▸ they do not work in stochastic optimization problems! 9 ,

  26. Step size adaptation ... by line searches x i + 1 ← x i − α i s i ▸ line searches automatically choose step sizes ▸ very fast subroutines called in each optimization step ▸ control blow up or stagnation ▸ they do not work in stochastic optimization problems! small outline ▸ introduce classic (noise free) line searches ▸ translate concept to language of probability ▸ get a new algorithm robust to noise 9 ,

  27. Classic line searches x ∗ = arg min x f ( x ) , Initial evaluation ≡ current position of optimizer x i + 1 ← x i − ts i + 1 6 . 5 f ( t ) 6 5 . 5 4 2 d f ( t ) 0 − 2 0 0 . 2 0 . 4 0 . 6 0 . 8 1 1 . 2 1 . 4 1 . 6 distance t in line search direction Wolfe conditions: accept when [Wolfe, SIAM Review, 1969] f ( t ) ≤ f ( 0 ) + c 1 tf ′ ( 0 ) f ′ ( t ) ≥ c 2 f ′ ( 0 ) (W-I) (W-IIa) ∣ f ′ ( t )∣ ≤ c 2 ∣ f ′ ( 0 )∣ (W-IIb) 10 ,

  28. Classic line searches x ∗ = arg min x f ( x ) , Search: candidate # 1 x i + 1 ← x i − ts i + 1 6 . 5 f ( t ) 6 5 . 5 4 2 ← initial candidate d f ( t ) 0 − 2 0 0 . 2 0 . 4 0 . 6 0 . 8 1 1 . 2 1 . 4 1 . 6 distance t in line search direction Wolfe conditions: accept when [Wolfe, SIAM Review, 1969] f ( t ) ≤ f ( 0 ) + c 1 tf ′ ( 0 ) f ′ ( t ) ≥ c 2 f ′ ( 0 ) (W-I) (W-IIa) ∣ f ′ ( t )∣ ≤ c 2 ∣ f ′ ( 0 )∣ (W-IIb) 10 ,

  29. Classic line searches x ∗ = arg min x f ( x ) , Collapse search space x i + 1 ← x i − ts i + 1 6 . 5 f ( t ) 6 5 . 5 4 2 d f ( t ) 0 − 2 0 0 . 2 0 . 4 0 . 6 0 . 8 1 1 . 2 1 . 4 1 . 6 distance t in line search direction Wolfe conditions: accept when [Wolfe, SIAM Review, 1969] f ( t ) ≤ f ( 0 ) + c 1 tf ′ ( 0 ) f ′ ( t ) ≥ c 2 f ′ ( 0 ) (W-I) (W-IIa) ∣ f ′ ( t )∣ ≤ c 2 ∣ f ′ ( 0 )∣ (W-IIb) 10 ,

  30. Classic line searches x ∗ = arg min x f ( x ) , Search: candidate # 2 x i + 1 ← x i − ts i + 1 6 . 5 f ( t ) 6 5 . 5 4 extrapolation → 2 d f ( t ) 0 − 2 0 0 . 2 0 . 4 0 . 6 0 . 8 1 1 . 2 1 . 4 1 . 6 distance t in line search direction Wolfe conditions: accept when [Wolfe, SIAM Review, 1969] f ( t ) ≤ f ( 0 ) + c 1 tf ′ ( 0 ) f ′ ( t ) ≥ c 2 f ′ ( 0 ) (W-I) (W-IIa) ∣ f ′ ( t )∣ ≤ c 2 ∣ f ′ ( 0 )∣ (W-IIb) 10 ,

  31. Classic line searches x ∗ = arg min x f ( x ) , Collapse search space x i + 1 ← x i − ts i + 1 6 . 5 f ( t ) 6 5 . 5 4 2 d f ( t ) 0 − 2 0 0 . 2 0 . 4 0 . 6 0 . 8 1 1 . 2 1 . 4 1 . 6 distance t in line search direction Wolfe conditions: accept when [Wolfe, SIAM Review, 1969] f ( t ) ≤ f ( 0 ) + c 1 tf ′ ( 0 ) f ′ ( t ) ≥ c 2 f ′ ( 0 ) (W-I) (W-IIa) ∣ f ′ ( t )∣ ≤ c 2 ∣ f ′ ( 0 )∣ (W-IIb) 10 ,

  32. Classic line searches x ∗ = arg min x f ( x ) , Search: candidate # 3 x i + 1 ← x i − ts i + 1 6 . 5 f ( t ) 6 5 . 5 4 interpolation → 2 d f ( t ) (local minimum) 0 − 2 0 0 . 2 0 . 4 0 . 6 0 . 8 1 1 . 2 1 . 4 1 . 6 distance t in line search direction Wolfe conditions: accept when [Wolfe, SIAM Review, 1969] f ( t ) ≤ f ( 0 ) + c 1 tf ′ ( 0 ) f ′ ( t ) ≥ c 2 f ′ ( 0 ) (W-I) (W-IIa) ∣ f ′ ( t )∣ ≤ c 2 ∣ f ′ ( 0 )∣ (W-IIb) 10 ,

  33. Classic line searches x ∗ = arg min x f ( x ) , Accept: datapoint # 3 fulfills Wolfe conditions x i + 1 ← x i − ts i + 1 6 . 5 f ( t ) 6 5 . 5 4 accepted → 2 d f ( t ) 0 − 2 0 0 . 2 0 . 4 0 . 6 0 . 8 1 1 . 2 1 . 4 1 . 6 distance t in line search direction Wolfe conditions: accept when [Wolfe, SIAM Review, 1969] f ( t ) ≤ f ( 0 ) + c 1 tf ′ ( 0 ) f ′ ( t ) ≥ c 2 f ′ ( 0 ) (W-I) (W-IIa) ∣ f ′ ( t )∣ ≤ c 2 ∣ f ′ ( 0 )∣ (W-IIb) 10 ,

  34. Classic line searches Choosing meaningful step-sizes, at very low overhead many classic line searches 1. model the 1D objective with cubic spline 2. search candidate points by collapsing search space 3. accept if Wolfe conditions fulfilled 11 ,

Recommend

Robust Optimal Control for Nonlinear Dynamic Systems Moritz Diehl, Professor for Optimization in

Robust Optimal Control for Nonlinear Dynamic Systems Moritz Diehl, Professor for Optimization in

Robust Optimal Control for Nonlinear Dynamic Systems Moritz Diehl, Professor for Optimization in Engineering, Electrical Engineering Department (ESAT) K.U. Leuven, Belgium Joint work with Peter Kuehl, Boris Houska, Andreas Ilzhoefer

507 views • 48 slides
Short Course in Supervised Learning Robust Optimization and Machine Learning Robust Supervised

Short Course in Supervised Learning Robust Optimization and Machine Learning Robust Supervised

Robust Optimization & Machine Learning 6. Robust Optimization Short Course in Supervised Learning Robust Optimization and Machine Learning Robust Supervised Learning Motivations Examples Thresholding and robustness Boolean data

724 views • 48 slides
Nonlinear Equations and Optimization Motivation: Nonlinear Equations So far we have mostly

Nonlinear Equations and Optimization Motivation: Nonlinear Equations So far we have mostly

Nonlinear Equations and Optimization Motivation: Nonlinear Equations So far we have mostly focused on linear phenomena Interpolation leads to a linear system Vb = y (monomials) or I b = y (Lagrange polynomials) Linear least-squares leads

1.77k views • 149 slides
The Scenario Approach: Robust Optimization and Application to Control M.C. Campi University of

The Scenario Approach: Robust Optimization and Application to Control M.C. Campi University of

The Scenario Approach: Robust Optimization and Application to Control M.C. Campi University of Brescia E-Mail: campi@ing.unibs.it A general fact: convex optimization is easy but robust convex optimization is hard min c T x subject to:

580 views • 29 slides
A Nonlinear Trust Region Framework for PDE-Constrained Optimization Using

A Nonlinear Trust Region Framework for PDE-Constrained Optimization Using

Motivation PDE-Constrained Optimization ROM-Constrained Optimization Numerical Experiments Conclusion References A Nonlinear Trust Region Framework for PDE-Constrained Optimization Using Progressively-Constructed Reduced-Order Models

458 views • 34 slides
Computational Optimization Advance Topics NonSmooth Optimization Reference: Nonlinear

Computational Optimization Advance Topics NonSmooth Optimization Reference: Nonlinear

Computational Optimization Advance Topics NonSmooth Optimization Reference: Nonlinear Optimization, Ruszynski,2006 Best Linear Separator: Supporting Plane Method Maximize distance Between two para supporting planes Distance = x

1.24k views • 26 slides
Adversarially Robust Optimization with Gaussian Processes Ilija Bogunovic, Jonathan Scarlett,

Adversarially Robust Optimization with Gaussian Processes Ilija Bogunovic, Jonathan Scarlett,

Adversarially Robust Optimization with Gaussian Processes Ilija Bogunovic, Jonathan Scarlett, Stefanie Jegelka, Volkan Cevher Conference on Neural Information Processing Systems (Dec 2018) Gaussian Process Optimization Optimum Non-robust

393 views • 12 slides
An introduction to Optimization under Uncertainty 0-1 Multiband Robust Optimization* with special

An introduction to Optimization under Uncertainty 0-1 Multiband Robust Optimization* with special

An introduction to Optimization under Uncertainty 0-1 Multiband Robust Optimization* with special focus on Robust Optimization Fabio DAndreagiovanni (email: d.andreagiovanni@hds.utc.fr) 1,2,3,4 Fabio DAndreagiovanni Fabio

500 views • 49 slides
Robust Solution Approaches for Optimization under Uncertainty: Applications to Air Traffic

Robust Solution Approaches for Optimization under Uncertainty: Applications to Air Traffic

Robust Solution Approaches for Optimization under Uncertainty: Applications to Air Traffic Management Problems Frauke Liers - FAU Erlangen-Nrnberg Konstanz, 15.11.2016 Relevance of Uncertainties in Optimization + x 2 max 0 , 7 x 1 + 1 x 2

895 views • 70 slides
Nonlinear Optimization for Optimal Control Part 2 Pieter Abbeel UC Berkeley EECS Outline n

Nonlinear Optimization for Optimal Control Part 2 Pieter Abbeel UC Berkeley EECS Outline n

Nonlinear Optimization for Optimal Control Part 2 Pieter Abbeel UC Berkeley EECS Outline n From linear to nonlinear n Model-predictive control (MPC) From Linear to Nonlinear We know how to solve (assuming g t , U t , X t convex): n (1)

750 views • 13 slides
Nonlinear Control Lecture # 28 Robust State Feedback Stabilization Nonlinear Control Lecture # 28

Nonlinear Control Lecture # 28 Robust State Feedback Stabilization Nonlinear Control Lecture # 28

Nonlinear Control Lecture # 28 Robust State Feedback Stabilization Nonlinear Control Lecture # 28 Robust State Feedback Stabilization Sliding Mode Control x = f ( x ) + B ( x )[ G ( x ) u + ( t, x, u )] x R n , u R m , f and B are

211 views • 17 slides
Bellmans curse of dimensionality n n-dimensional state space n Number of states grows

Bellmans curse of dimensionality n n-dimensional state space n Number of states grows

Nonlinear Optimization for Optimal Control Pieter Abbeel UC Berkeley EECS [optional] Boyd and Vandenberghe, Convex Optimization, Chapters 9 11 [optional] Betts, Practical Methods for Optimal Control Using Nonlinear Programming Bellmans

174 views • 16 slides
A Nonlinear Trust-Region Framework for PDE-Constrained Optimization Using Adaptive Model

A Nonlinear Trust-Region Framework for PDE-Constrained Optimization Using Adaptive Model

Introduction Optimization via Adaptive Model Reduction Large-Scale, Constrained Optimization Conclusion A Nonlinear Trust-Region Framework for PDE-Constrained Optimization Using Adaptive Model Reduction Matthew J. Zahr Institute for

336 views • 33 slides
Deterministic Global Optimization Algorithm and Nonlinear Dynamics C. S. Adjiman and I.

Deterministic Global Optimization Algorithm and Nonlinear Dynamics C. S. Adjiman and I.

Deterministic Global Optimization Algorithm and Nonlinear Dynamics C. S. Adjiman and I. Papamichail Centre for Process Systems Engineering Department of Chemical Engineering and Chemical Technology Imperial College London Global Optimization

693 views • 41 slides
Response Surface Methods in Optimization A nonlinear Response Surface R(x) is a continuous

Response Surface Methods in Optimization A nonlinear Response Surface R(x) is a continuous

Response Surface Methods in Optimization A nonlinear Response Surface R(x) is a continuous nonlinear multivariate approximation to f(x). R(x) has also been called a response surface or a surrogate model. Response surfaces

331 views • 30 slides
Notes Solving Nonlinear Systems Most thoroughly explored in the context of optimization

Notes Solving Nonlinear Systems Most thoroughly explored in the context of optimization

Notes Solving Nonlinear Systems Most thoroughly explored in the context of optimization For systems arising in implicit time integration of stiff problems: Must be more efficient than taking k substeps of an explicit method ruling

73 views • 4 slides
Nonlinear Expectations and Stochastic Calculus under Uncertainty with Robust Central Limit

Nonlinear Expectations and Stochastic Calculus under Uncertainty with Robust Central Limit

Nonlinear Expectations and Stochastic Calculus under Uncertainty with Robust Central Limit Theorem and G-Brownian Motion Shige Peng Shandong University Presented at Spring School of Roscoff Shandong University Presented at

1.18k views • 65 slides
Optimization based on Mixed Integer Dealing with nonconvexities Global Nonlinear Programming

Optimization based on Mixed Integer Dealing with nonconvexities Global Nonlinear Programming

Claudia DAmbrosio What is MP? What is a MINLP? Subclasses of MINLP Optimization based on Mixed Integer Dealing with nonconvexities Global Nonlinear Programming methods Optimization methods Spatial Branch-and-Bound Expression trees

1.71k views • 144 slides
Pros and Cons IIT Bombay In each case, we get highly nonlinear optimization problem

Pros and Cons IIT Bombay In each case, we get highly nonlinear optimization problem

Automation Lab Pros and Cons IIT Bombay In each case, we get highly nonlinear optimization problem Important to give good initial guess to obtain reliable model parameters: not an easy task It is assumed that structure of the

1.11k views • 87 slides
Halo Orbit Stationkeeping using Nonlinear Outline Introduction MPC and Polynomial Optimization

Halo Orbit Stationkeeping using Nonlinear Outline Introduction MPC and Polynomial Optimization

Rutgers, The State University of New Jersey tugraz Halo Orbit Stationkeeping using Nonlinear Outline Introduction MPC and Polynomial Optimization Circular Restricted Three Body Problem Gaurav Misra, Hao Peng, and Xiaoli Bai Global

986 views • 54 slides
Discontinuous Feedback in Nonlinear Control: Stabilization Under Disturbances and Optimization

Discontinuous Feedback in Nonlinear Control: Stabilization Under Disturbances and Optimization

Discontinuous Feedback in Nonlinear Control: Stabilization Under Disturbances and Optimization Yuri S. Ledyaev Western Michigan University ledyaev@wmich.edu +1-(269)-387-4557 DIMACS Workshop on Perspectives and Future Directions in

1.22k views • 119 slides
A FEASIBLE POINT ALGORITHM FOR NONLINEAR CONSTRAINED OPTIMIZATION with Applications to Parameter

A FEASIBLE POINT ALGORITHM FOR NONLINEAR CONSTRAINED OPTIMIZATION with Applications to Parameter

A FEASIBLE POINT ALGORITHM FOR NONLINEAR CONSTRAINED OPTIMIZATION with Applications to Parameter Identification in Structural Mechanics Jos Herskovits 1 1 COPPE - Federal University of Rio de Janeiro, Mechanical Engineering Department Rio de

691 views • 38 slides
Distributionally Robust Optimization with Decision-Dependent Ambiguity Set Nilay Noyan Sabanc

Distributionally Robust Optimization with Decision-Dependent Ambiguity Set Nilay Noyan Sabanc

Distributionally Robust Optimization with Decision-Dependent Ambiguity Set Nilay Noyan Sabanc University, Istanbul, Turkey Joint work with G. Rudolf, Ko University M. Lejeune, George Washington University Uncertainty in optimization

622 views • 40 slides
Metti 5 Optimization for nonlinear parameter estimation and function estimation Lecture 7

Metti 5 Optimization for nonlinear parameter estimation and function estimation Lecture 7

Metti 5 Optimization for nonlinear parameter estimation and function estimation Lecture 7 Roscoff, June 13-18, 2011 Objectives Direct problem input BC Model State solution IC Parameters

869 views • 69 slides

More recommend