towards verified stochastic variational inference for
play

Towards Verified Stochastic Variational Inference for Probabilistic - PowerPoint PPT Presentation

Sep 26, 2023 •96 likes •774 views

Towards Verified Stochastic Variational Inference for Probabilistic Programs Wonyeol Lee 1 Hangyeol Yu 1 Xavier Rival 2 Hongseok Yang 1 1 KAIST, South Korea 2 INRIA/ENS/CNRS, France POPL 2020 Probabilistic c Programming Example 1: def p():

  1. Towards Verified Stochastic Variational Inference for Probabilistic Programs Wonyeol Lee 1 Hangyeol Yu 1 Xavier Rival 2 Hongseok Yang 1 1 KAIST, South Korea 2 INRIA/ENS/CNRS, France POPL 2020

  2. Probabilistic c Programming • Example 1: def p(): # model_eg1 z = pyro.sample(“z”, Normal(0., 5.)) if (z > 0): pyro.sample(“x”, Normal( 1., 1.), obs=0.) else: pyro.sample(“x”, Normal(-2., 1.), obs=0.) 2

  3. Probabilistic c Programming • Example 1: def p(): # model_eg1 z = pyro.sample ( “z” , Normal(0., 5.) ) if (z > 0): pyro.sample(“x”, Normal( 1., 1.), obs=0.) else: pyro.sample(“x”, Normal(-2., 1.), obs=0.) 3

  4. Probabilistic c Programming • Example 1: def p(): # model_eg1 z = pyro.sample(“z”, Normal(0., 5.)) if (z > 0): pyro.sample ( “x” , Normal( 1., 1.), obs=0. ) else: pyro.sample ( “x” , Normal(-2., 1.), obs=0. ) 4

  5. Probabilistic c Programming • Example 1: def p(): # model_eg1 z = pyro.sample(“z”, Normal(0., 5.)) if (z > 0): pyro.sample(“x”, Normal( 1., 1.) , obs=0.) else: pyro.sample(“x”, Normal(-2., 1.) , obs=0.) 5

  6. Probabilistic c Programming • Example 1: def p(): # model_eg1 z = pyro.sample(“z”, Normal(0., 5.)) if (z > 0): pyro.sample(“x”, Normal( 1., 1.), obs=0.) else: pyro.sample(“x”, Normal(-2., 1.), obs=0.) density prior " ! posterior " ! # ! 6

  7. Probabilistic c Programming • Example 1: def p(): # model_eg1 z = pyro.sample(“z”, Normal(0., 5.)) if (z > 0): pyro.sample(“x”, Normal( 1., 1.), obs=0.) else: pyro.sample(“x”, Normal(-2., 1.), obs=0.) density prior " ! posterior # $ % ! 7

  8. Stoch chastic c Va Variational Inference ce • Example 1: def p(): # model_eg1 z = pyro.sample(“z”, Normal(0., 5.)) if (z > 0): pyro.sample(“x”, Normal( 1., 1.), obs=0.) else: pyro.sample(“x”, Normal(-2., 1.), obs=0.) ≈ density def q θ (): # guide_eg1 θ = pyro.param ( “θ” , 0.) z = pyro.sample(“z”, Normal(θ, 1.)) prior " ! posterior " ! # ! 8

  9. Stoch chastic c Va Variational Inference ce • Example 1: def p(): # model_eg1 z = pyro.sample(“z”, Normal(0., 5.)) if (z > 0): pyro.sample(“x”, Normal( 1., 1.), obs=0.) else: pyro.sample(“x”, Normal(-2., 1.), obs=0.) ≈ density def q θ (): # guide_eg1 θ = pyro.param(“θ”, 0.) z = pyro.sample (“z”, Normal(θ, 1.) ) prior " ! posterior " ! # ! 9

  10. Stoch chastic c Va Variational Inference ce • Example 1: def p(): # model_eg1 z = pyro.sample(“z”, Normal(0., 5.)) if (z > 0): pyro.sample(“x”, Normal( 1., 1.), obs=0.) else: pyro.sample(“x”, Normal(-2., 1.), obs=0.) ≈ density def q θ (): # guide_eg1 θ = pyro.param( “θ” , 0.) z = pyro.sample(“z”, Normal(θ, 1.)) prior " ! posterior " ! # ! 10

  11. Stoch chastic c Va Variational Inference ce • Example 1: def p(): # model_eg1 z = pyro.sample(“z”, Normal(0., 5.)) if (z > 0): pyro.sample(“x”, Normal( 1., 1.), obs=0.) else: pyro.sample(“x”, Normal(-2., 1.), obs=0.) ≈ density def q θ (): # guide_eg1 θ = pyro.param(“θ”, 0.) z = pyro.sample(“z”, Normal(θ, 1.)) prior ' $ posterior ' $ ( guide ! " ($) with optimal & $ 11

  12. Stoch chastic c Va Variational Inference ce • Typical optimization objective: argmin ' KL * ' + || - + . . 1 2 3 ≜ 0 1 2 3 log 6 3|7 12

  13. Stoch chastic c Va Variational Inference ce • Typical optimization objective: argmin # KL # . 2 3 4 ≜ 1 2 3 4 log 7 4|8 • Notation: KL # = KL % # & || ( & ) . 13

  14. Stoch chastic c Va Variational Inference ce • Typical optimization objective: argmin # KL # . ? @ A ≜ > ? @ A log D A|E • Notation: KL # = KL % # & || ( & ) . • Optimization by stochastic gradient descent: * +,- ← * + − 0.01× 4 # KL # | #5# 6 . 14

  15. Stoch chastic c Va Variational Inference ce • Typical optimization objective: argmin # KL # . ? @ A ≜ > ? @ A log D A|E • Notation: KL # = KL % # & || ( & ) . • Optimization by stochastic gradient descent: * +,- ← * + − 0.01× 4 # KL # | #5# 6 . 15

  16. Stoch chastic c Va Variational Inference ce • Typical optimization objective: argmin # KL # . ? @ A ≜ > ? @ A log D A|E • Notation: KL # = KL % # & || ( & ) . • Optimization by stochastic gradient descent: * +,- ← * + − 0.01× 4 # KL # | #5# 6 . 16

  17. Stoch chastic c Va Variational Inference ce • Typical optimization objective: argmin # KL # ? @ A ≜ > ? @ A log D A|E • Notation: Wh What t can an go wrong? g? KL # = KL % # & || ( & ) . • Optimization by stochastic gradient descent: * +,- ← * + − 0.01× 4 # KL # | #5# 6 . 17

  18. Issues in Stoch chastic c Variational Inference ce Issue 1: Undefined KL # • Typical optimization objective: argmin # KL # ? @ A ≜ > ? @ A log D A|E • Notation: KL # = KL % # & || ( & ) . • Optimization by stochastic gradient descent: * +,- ← * + − 0.01× 4 # KL # | #5# 6 . 18

  19. Issues in Stoch chastic c Variational Inference ce Issue 1: Undefined KL # • Typical optimization objective: argmin # KL # ? @ A ≜ > ? @ A log D A|E • Notation: KL # = KL % # & || ( & ) . • Optimization by stochastic gradient descent: * +,- ← * + − 0.01× 4 # KL # | #5# 6 . Issue 2: Undefined 4 # KL # 19

  20. Issues in Stoch chastic c Variational Inference ce Issue 1: Undefined KL # • Typical optimization objective: argmin # KL # ? @ A ≜ > ? @ A log D A|E • Notation: KL # = KL % # & || ( & ) . Issue 3: Wrong estimate • Optimization by stochastic gradient descent: * +,- ← * + − 0.01× 4 # KL # | #5# 6 . Issue 2: Undefined 4 # KL # 20

  21. Is Issue e 1: 1: Undefined ed KL # & ' ( KL # = % & ' ( log , (|. & ' ( = ∫ 01 2 # 1 log , (|. KL # could be undefined for two reasons. 21

  22. Is Issue e 1: 1: Undefined ed KL # & ' ( KL # = % & ' ( log , (|. & ' ( = ∫ 01 2 # 1 log , (|. KL # could be undefined for two reasons. (a) Undefined integrand: 2 # 1 ≠ 0 and 5 1 6 = 0 for some 1 . 22

  23. Is Issue e 1: 1: Undefined ed KL # & ' ( KL # = % & ' ( log , (|. & ' ( = ∫ 01 2 # 1 log , (|. KL # could be undefined for two reasons. (a) Undefined integrand: 2 # 1 ≠ 0 and 5 1 6 = 0 for some 1 . (b) Undefined integral: ∫ 01 ⋯ is not integrable. 23

  24. Is Issue e 1: 1: Examp mple • Example 2: Bayesian regression (from Pyro webpage). def p(): # model_eg2 ... sigma = pyro.sample(“sigma”, Uniform(0., 10.)) ... pyro.sample(“obs”, Normal(..., sigma), obs=...) def q θ (): # guide_eg2 ... sigma = pyro.sample(“sigma”, Normal(θ, 0.05)) • KL # is undefined. • [Q] How to fix it? 24

  25. Is Issue e 1: 1: Examp mple • Example 2: Bayesian regression (from Pyro webpage). def p(): # model_eg2 ... sigma = pyro.sample(“sigma”, Uniform(0., 10.)) ... pyro.sample(“obs”, Normal(..., sigma), obs=...) def q θ (): # guide_eg2 ... sigma = pyro.sample(“sigma”, Normal(θ, 0.05)) • KL # is undefined. • [Q] How to fix it? 25

  26. Is Issue e 1: 1: Examp mple • Example 2: Bayesian regression (from Pyro webpage). def p(): # model_eg2 ... sigma = pyro.sample(“sigma”, Uniform(0., 10.) ) ... pyro.sample(“obs”, Normal(..., sigma), obs=...) def q θ (): # guide_eg2 ... sigma = pyro.sample(“sigma”, Normal(θ, 0.05) ) • KL # is undefined. [Q] How to fix it? 26

  27. Issue Is e 1: 1: Examp mple • Example 2: Bayesian regression (from Pyro webpage). def p(): # model_eg2 ... sigma = pyro.sample(“sigma”, Uniform(0., 10.)) ... pyro.sample(“obs”, Normal(..., sigma), obs=...) $ # % ≠ 0 and ( % ) = 0 for % < 0 . def q θ (): # guide_eg2 ... sigma = pyro.sample(“sigma”, Normal(θ, 0.05)) • KL # is undefined. Reason: (a) undefined integrand. • [Q] How to fix it? 27

  28. Is Issue e 1: 1: Examp mple • Example 2: Bayesian regression (from Pyro webpage). def p(): # model_eg2 ... sigma = pyro.sample(“sigma”, Uniform(0., 10.)) ... pyro.sample(“obs”, Normal(..., sigma), obs=...) def q θ (): # guide_eg2 ... sigma = pyro.sample(“sigma”, Normal(θ, 0.05)) • KL # is undefined. Reason: (a) undefined integrand. • [Q] How to fix model? 28

  29. Is Issue e 1: 1: Examp mple • Example 2: Bayesian regression (from Pyro webpage). def p(): # model_eg2’ ... Normal(5., 5.) sigma = pyro.sample(“sigma”, Uniform(0., 10.)) ... abs(sigma) pyro.sample(“obs”, Normal(..., sigma), obs=...) def q θ (): # guide_eg2 ... sigma = pyro.sample(“sigma”, Normal(θ, 0.05)) • [Q] How to fix model? 29

  30. Issue Is e 1: 1: Examp mple • Example 2: Bayesian regression (from Pyro webpage). def p(): # model_eg2’ ... Normal(5., 5.) sigma = pyro.sample(“sigma”, Uniform(0., 10.)) ... abs(sigma) pyro.sample(“obs”, Normal(..., sigma), obs=...) def q θ (): # guide_eg2 ... sigma = pyro.sample(“sigma”, Normal(θ, 0.05)) • KL # is still undefined. • [Q] How to fix model? 30

Recommend

Variational Inference for GPs: Presenters Group1: Stochastic variational inference. Slides 2 - 28

Variational Inference for GPs: Presenters Group1: Stochastic variational inference. Slides 2 - 28

Variational Inference for GPs: Presenters Group1: Stochastic variational inference. Slides 2 - 28 Chaoqi Wang Sana Tonekaboni Will Grathwohl Group2: Variational inference for GPs. Slides 29 - 57 Trefor Evans Kingsley Chang Shems Saleh James

1.32k views • 98 slides
161-17 Stochastic Variational Lecture Inference I Kaushal Panchi Scribes : Jay DeYoung

161-17 Stochastic Variational Lecture Inference I Kaushal Panchi Scribes : Jay DeYoung

161-17 Stochastic Variational Lecture Inference I Kaushal Panchi Scribes : Jay DeYoung Recap Vaniatianal Inference : Approximate Goal Posterior : 17,13 ) pH )p( 137 Generative Model 13 ) pc plx ,z : = , Approx

347 views • 18 slides
Doubly Stochastic Variational Inference for Neural Processes with Hierarchical Latent Variables

Doubly Stochastic Variational Inference for Neural Processes with Hierarchical Latent Variables

Doubly Stochastic Variational Inference for Neural Processes with Hierarchical Latent Variables Q. Wang &amp; Herke van Hoof Amsterdam Machine Learning Lab ICML 2020 1 / 69 Highlights in this Work 2 / 69 Highlights in this Work A

965 views • 69 slides
CS480/680 Machine Learning Lecture 11: February 11 th , 2020 Variational Inference Zahra

CS480/680 Machine Learning Lecture 11: February 11 th , 2020 Variational Inference Zahra

CS480/680 Machine Learning Lecture 11: February 11 th , 2020 Variational Inference Zahra Sheikhbahaee VARIATIONAL ALGORITHMS FOR APPROXIMATE BAYESIAN INFERENCE (Beal 2003, chapter 2) Variational Inference: A Review for Statisticians (Blei et al.

713 views • 28 slides
Margulies mark : - Daniel 2- eiberg Stochastic Recap : Variation Inference al Bound (

Margulies mark : - Daniel 2- eiberg Stochastic Recap : Variation Inference al Bound (

Lecture 18 : Black Box Variational Inference Niklas Swede Scribes Margulies mark : - Daniel 2- eiberg Stochastic Recap : Variation Inference al Bound ( ELBO ) Lower Objective Evidence : , ,[ log.gl?tTr.. , ] 219,10 Ea , ) =

342 views • 23 slides
American-style options, stochastic volatility, and degenerate parabolic variational inequalities

American-style options, stochastic volatility, and degenerate parabolic variational inequalities

Introduction Stationary variational inequalities for Heston generator Evolutionary variational inequalities for Heston generator Stochastic representation of solutions to variational problems References American-style options, stochastic

1.2k views • 79 slides
Rejection Sampling Variational Inference Karan Grewal CSC2547 / STA4273 Overview Variational

Rejection Sampling Variational Inference Karan Grewal CSC2547 / STA4273 Overview Variational

Rejection Sampling Variational Inference Karan Grewal CSC2547 / STA4273 Overview Variational Inference Interested in computing posterior , but it is often intractable parametrize a variational family of distributions to

623 views • 12 slides
Deep Variational Inference FLARE Reading Group Presentation Wesley Tansey 9/28/2016 What is

Deep Variational Inference FLARE Reading Group Presentation Wesley Tansey 9/28/2016 What is

Deep Variational Inference FLARE Reading Group Presentation Wesley Tansey 9/28/2016 What is Variational Inference? What is Variational Inference? p*(x) Want to estimate some distribution, p*(x) What is Variational Inference?

684 views • 52 slides
Lecture Variational 13 Inference Panini Kaushal Scribes : - Margulies Smedeuranh Niklas

Lecture Variational 13 Inference Panini Kaushal Scribes : - Margulies Smedeuranh Niklas

Lecture Variational 13 Inference Panini Kaushal Scribes : - Margulies Smedeuranh Niklas Variational Inference Approximate by posterior Idea maximizing , bound lower Ptt variational fly ply ? ) a , , ) &quot; 9) * =

709 views • 15 slides
Variational Inference for Bayes vMF Mixture Hanxiao Liu September 23, 2014 1 / 14 Variational

Variational Inference for Bayes vMF Mixture Hanxiao Liu September 23, 2014 1 / 14 Variational

Variational Inference for Bayes vMF Mixture Hanxiao Liu September 23, 2014 1 / 14 Variational Inference Review Lower bound the likelihood L ( ; X ) = E q log p ( X | ) log p ( X , Z | ) q ( Z ) = E q + E q log q (

310 views • 14 slides
Variational Inference for Diffusion Processes C edric Archambeau Xerox Research Centre Europe

Variational Inference for Diffusion Processes C edric Archambeau Xerox Research Centre Europe

Variational Inference for Diffusion Processes C edric Archambeau Xerox Research Centre Europe cedric.archambeau@xerox.com Joint work with Manfred Opper. Statlearn 11 Grenoble, March 2011 Stochastic differential systems Many real

815 views • 25 slides
Fast and Simple Natural-Gradient Variational Inference with Mixture of Exponential-family

Fast and Simple Natural-Gradient Variational Inference with Mixture of Exponential-family

Fast and Simple Natural-Gradient Variational Inference with Mixture of Exponential-family Approximations Wu Lin (UBC) June 11, 2019 Joint work with Mohammad Emtiyaz Khan (AIP, RIKEN) and Mark Schmidt (UBC) 1 / 7 Variational Inference (VI) VI

119 views • 7 slides
Variational Inference CMSC 691 UMBC Goal: Posterior Inference Hyperparameters Unknown

Variational Inference CMSC 691 UMBC Goal: Posterior Inference Hyperparameters Unknown

Approximate Inference: Variational Inference CMSC 691 UMBC Goal: Posterior Inference Hyperparameters Unknown parameters Data: p ( | ) Likelihood model: p( | ) (Some) Learning Techniques MAP/MLE: Point

1.09k views • 81 slides
Neural Variational Inference and Learning Andriy Mnih, Karol Gregor 22 June 2014 1 / 14

Neural Variational Inference and Learning Andriy Mnih, Karol Gregor 22 June 2014 1 / 14

Neural Variational Inference and Learning Andriy Mnih, Karol Gregor 22 June 2014 1 / 14 Introduction Training directed latent variable models is difficult because inference in them is intractable. Both MCMC and traditional variational

322 views • 14 slides
Lecture 14: Inference in Dirichlet Processes (Blei &amp; Jordan, Variational inference for

Lecture 14: Inference in Dirichlet Processes (Blei &amp; Jordan, Variational inference for

CS598JHM: Advanced NLP (Spring 2013) http://courses.engr.illinois.edu/cs598jhm/ Lecture 14: Inference in Dirichlet Processes (Blei &amp; Jordan, Variational inference for Dirichlet Process Mixture models, Bayesian Analysis 2006) Julia

354 views • 21 slides
quancol . ........ . . . ... ... ... ... ... ... ... Stochastic Process Algebras

quancol . ........ . . . ... ... ... ... ... ... ... Stochastic Process Algebras

Stochastic Process Algebras Modelling in a Data Rich World ProPPA Inference Results Conclusions Integrating Inference with Stochastic Process Algebra Models Jane Hillston School of Informatics, University of Edinburgh 11th January 2018

1.48k views • 104 slides
Variational Inference and Learning Michael Gutmann Probabilistic Modelling and Reasoning

Variational Inference and Learning Michael Gutmann Probabilistic Modelling and Reasoning

Variational Inference and Learning Michael Gutmann Probabilistic Modelling and Reasoning (INFR11134) School of Informatics, University of Edinburgh Spring semester 2018 Recap Learning and inference often involves intractable integrals

786 views • 36 slides
Meta-Amoruized Variational Inference and Learning Kristy Choi CS236: December 4th, 2019

Meta-Amoruized Variational Inference and Learning Kristy Choi CS236: December 4th, 2019

Meta-Amoruized Variational Inference and Learning Kristy Choi CS236: December 4th, 2019 Probabilistic Inference Probabilistic inference is a paruicular way of viewing the world: + = Observations Updated (posterior) Prior belief Typically

452 views • 28 slides
Variational Mean Field Variational Mean Field for Graphical Models for Graphical Models

Variational Mean Field Variational Mean Field for Graphical Models for Graphical Models

Variational Mean Field Variational Mean Field for Graphical Models for Graphical Models CS/CNS/EE 155 Baback Moghaddam Machine Learning Group baback @ jpl.nasa.gov Approximate Inference Approximate Inference Consider general UGs ( i.e.,

382 views • 37 slides
Regret bounds for online variational inference Pierre Alquier ACML Nagoya, Nov. 18, 2019

Regret bounds for online variational inference Pierre Alquier ACML Nagoya, Nov. 18, 2019

Regret bounds for online variational inference Pierre Alquier ACML Nagoya, Nov. 18, 2019 Pierre Alquier, RIKEN AIP Regret bounds for online variational inference Co-authors Emtiyaz Khan Badr-Eddine Chrief-Abdellatif Approximate

779 views • 45 slides
Variational inference Probabilistic Graphical Models Sharif University of Technology Soleymani

Variational inference Probabilistic Graphical Models Sharif University of Technology Soleymani

Variational inference Probabilistic Graphical Models Sharif University of Technology Soleymani Spring 2018 Some slides are adapted from Xing s slides Exact methods for inference Variable elimination Message Passing: shared terms

1.2k views • 84 slides
CS 285 Instructor: Sergey Levine UC Berkeley Todays Lecture 1. Probabilistic latent variable

CS 285 Instructor: Sergey Levine UC Berkeley Todays Lecture 1. Probabilistic latent variable

Variational Inference and Generative Models CS 285 Instructor: Sergey Levine UC Berkeley Todays Lecture 1. Probabilistic latent variable models 2. Variational inference 3. Amortized variational inference 4. Generative models: variational

608 views • 34 slides
Approximate inference on graphical models: variational methods Alexandre Bouchard-C ot e

Approximate inference on graphical models: variational methods Alexandre Bouchard-C ot e

Approximate inference on graphical models: variational methods Alexandre Bouchard-C ot e Exact inference in general graphs. . . Recall: we now have an exact, general and efficient inference algorithm: the Junction-Tree algorithm

782 views • 39 slides
All in the Exponential Family: Bregman Duality in Thermodynamic Variational Inference Rob

All in the Exponential Family: Bregman Duality in Thermodynamic Variational Inference Rob

All in the Exponential Family: Bregman Duality in Thermodynamic Variational Inference Rob Brekelmans Vaden Masrani Frank Wood Greg Ver Steeg Aram Galstyan 1 &lt;latexit

638 views • 31 slides

More recommend