the necessity and formulation of a robust imprecise bayes
play

The necessity and formulation of a robust (imprecise) Bayes Factor - PowerPoint PPT Presentation

Mar 04, 2023 •44 likes •604 views

The necessity and formulation of a robust (imprecise) Bayes Factor Patrick Schwaferts Ludwig-Maximilians-Universit at M unchen 01. August 2018 Patrick Schwaferts (LMU) Imprecise Bayes Factor 01. August 2018 1 / 18 Introduction

  1. The necessity and formulation of a robust (imprecise) Bayes Factor Patrick Schwaferts Ludwig-Maximilians-Universit¨ at M¨ unchen 01. August 2018 Patrick Schwaferts (LMU) Imprecise Bayes Factor 01. August 2018 1 / 18

  2. Introduction Patrick Schwaferts (LMU) Imprecise Bayes Factor 01. August 2018 2 / 18

  3. Introduction Reproducibility crisis in psychological research Patrick Schwaferts (LMU) Imprecise Bayes Factor 01. August 2018 2 / 18

  4. Introduction Reproducibility crisis in psychological research Rise of popularity of Bayesian Statistics: promoted as being the solution Patrick Schwaferts (LMU) Imprecise Bayes Factor 01. August 2018 2 / 18

  5. Introduction Reproducibility crisis in psychological research Rise of popularity of Bayesian Statistics: promoted as being the solution Bayes Factor for comparing two hypotheses (“Bayesian t -Test”) Patrick Schwaferts (LMU) Imprecise Bayes Factor 01. August 2018 2 / 18

  6. What is the Bayes Factor? Patrick Schwaferts (LMU) Imprecise Bayes Factor 01. August 2018 3 / 18

  7. What is the Bayes Factor? Informal: A generalization of the Likelihood Ratio to include prior information. Patrick Schwaferts (LMU) Imprecise Bayes Factor 01. August 2018 3 / 18

  8. From Likelihood Ratio to Bayes Factor I Patrick Schwaferts (LMU) Imprecise Bayes Factor 01. August 2018 4 / 18

  9. From Likelihood Ratio to Bayes Factor I Situation: Two independent groups with observations x i and y j and model X i ∼ N ( µ, σ 2 ) , i = 1 , ..., n , Y j ∼ N ( µ + α, σ 2 ) , j = 1 , ..., m , with parameters µ , σ 2 , δ = α/σ . Patrick Schwaferts (LMU) Imprecise Bayes Factor 01. August 2018 4 / 18

  10. From Likelihood Ratio to Bayes Factor I Situation: Two independent groups with observations x i and y j and model X i ∼ N ( µ, σ 2 ) , i = 1 , ..., n , Y j ∼ N ( µ + α, σ 2 ) , j = 1 , ..., m , with parameters µ , σ 2 , δ = α/σ . Research Question: Is there a difference between both groups? Patrick Schwaferts (LMU) Imprecise Bayes Factor 01. August 2018 4 / 18

  11. From Likelihood Ratio to Bayes Factor I Situation: Two independent groups with observations x i and y j and model X i ∼ N ( µ, σ 2 ) , i = 1 , ..., n , Y j ∼ N ( µ + α, σ 2 ) , j = 1 , ..., m , with parameters µ , σ 2 , δ = α/σ . Research Question: Is there a difference between both groups? Hypotheses: H 0 : δ = 0 vs . H 1 : δ � = 0 Patrick Schwaferts (LMU) Imprecise Bayes Factor 01. August 2018 4 / 18

  12. From Likelihood Ratio to Bayes Factor II Likelihood Ratio: µ,σ 2 ,δ f ( data | µ, σ 2 , δ ) max R 10 = L µ,σ 2 f ( data | µ, σ 2 , δ = 0) max Patrick Schwaferts (LMU) Imprecise Bayes Factor 01. August 2018 5 / 18

  13. From Likelihood Ratio to Bayes Factor II Likelihood Ratio: µ,σ 2 ,δ f ( data | µ, σ 2 , δ ) max R 10 = L µ,σ 2 f ( data | µ, σ 2 , δ = 0) max Law of Likelihood: The extent to which the data support one model over another (:= evidence ) is equal to the ratio of their likelihoods. Patrick Schwaferts (LMU) Imprecise Bayes Factor 01. August 2018 5 / 18

  14. From Likelihood Ratio to Bayes Factor II Likelihood Ratio: µ,σ 2 ,δ f ( data | µ, σ 2 , δ ) max R 10 = L µ,σ 2 f ( data | µ, σ 2 , δ = 0) max Law of Likelihood: The extent to which the data support one model over another (:= evidence ) is equal to the ratio of their likelihoods. Interpretation of LR: R 10 times as much evidence for the model chosen ( ∗ ) under H 1 The data is L than for the model chosen ( ∗ ) under H 0 . ( ∗ ) : chosen refers to the max -operation ⇒ L R 10 quantifies the maximum evidence for H 1 (in a comparison with H 0 ) Patrick Schwaferts (LMU) Imprecise Bayes Factor 01. August 2018 5 / 18

  15. From Likelihood Ratio to Bayes Factor III Introducing Prior Probabilities: P ( H 1 ) P ( H 0 ) and Patrick Schwaferts (LMU) Imprecise Bayes Factor 01. August 2018 6 / 18

  16. From Likelihood Ratio to Bayes Factor III Introducing Prior Probabilities: P ( H 1 ) P ( H 0 ) and Bayes Rule: P ( H 1 | data ) R 10 · P ( H 1 ) = L P ( H 0 | data ) P ( H 0 ) � �� � � �� � PosteriorOdds PriorOdds The data is used to learn about P ( H 1 ) and P ( H 0 ). Patrick Schwaferts (LMU) Imprecise Bayes Factor 01. August 2018 6 / 18

  17. From Likelihood Ratio to Bayes Factor III Introducing Prior Probabilities: P ( H 1 ) P ( H 0 ) and Bayes Rule: P ( H 1 | data ) R 10 · P ( H 1 ) = L P ( H 0 | data ) P ( H 0 ) � �� � � �� � PosteriorOdds PriorOdds The data is used to learn about P ( H 1 ) and P ( H 0 ). Interpretation of Posterior Probabilities: After seeing the data, the maximum belief in H 1 is P ( H 1 | data ). Patrick Schwaferts (LMU) Imprecise Bayes Factor 01. August 2018 6 / 18

  18. From Likelihood Ratio to Bayes Factor IV Introducing Parameter Priors: P µ , P σ 2 and P δ Patrick Schwaferts (LMU) Imprecise Bayes Factor 01. August 2018 7 / 18

  19. From Likelihood Ratio to Bayes Factor IV Introducing Parameter Priors: P µ , P σ 2 and P δ Bayesian Hypotheses: µ ∼ P µ µ ∼ P µ H B H B σ 2 ∼ P σ 2 σ 2 ∼ P σ 2 0 : vs . 1 : δ = 0 δ ∼ P δ P δ is called test-relevant prior . Patrick Schwaferts (LMU) Imprecise Bayes Factor 01. August 2018 7 / 18

  20. From Likelihood Ratio to Bayes Factor IV Introducing Parameter Priors: P µ , P σ 2 and P δ Bayesian Hypotheses: µ ∼ P µ µ ∼ P µ H B H B σ 2 ∼ P σ 2 σ 2 ∼ P σ 2 0 : vs . 1 : δ = 0 δ ∼ P δ P δ is called test-relevant prior . Marginalized Likelihoods: ��� m ( data | H B f ( data | µ, σ 2 , δ ) P µ ( µ ) P σ 2 ( σ 2 ) P δ ( δ ) d δ d σ 2 d µ 1 ) = �� m ( data | H B f ( data | µ, σ 2 , δ = 0) P µ ( µ ) P σ 2 ( σ 2 ) d σ 2 d µ 0 ) = Patrick Schwaferts (LMU) Imprecise Bayes Factor 01. August 2018 7 / 18

  21. From Likelihood Ratio to Bayes Factor V Bayes Factor: BF 10 = m ( data | H B 1 ) m ( data | H B 0 ) Patrick Schwaferts (LMU) Imprecise Bayes Factor 01. August 2018 8 / 18

  22. From Likelihood Ratio to Bayes Factor V Bayes Factor: BF 10 = m ( data | H B 1 ) m ( data | H B 0 ) Bayes Rule: P ( H B 0 | data ) = BF 10 · P ( H B 1 | data ) 1 ) P ( H B P ( H B 0 ) The data is used to learn about P ( H B 1 ) and P ( H B 0 ). Nothing can be ⇒ P δ is part of the H B learned about the parameter priors. 1 -model. Patrick Schwaferts (LMU) Imprecise Bayes Factor 01. August 2018 8 / 18

  23. From Likelihood Ratio to Bayes Factor V Bayes Factor: BF 10 = m ( data | H B 1 ) m ( data | H B 0 ) Bayes Rule: P ( H B 0 | data ) = BF 10 · P ( H B 1 | data ) 1 ) P ( H B P ( H B 0 ) The data is used to learn about P ( H B 1 ) and P ( H B 0 ). Nothing can be ⇒ P δ is part of the H B learned about the parameter priors. 1 -model. Interpretation of BF: The data is BF 10 times as much evidence for the model behind m ( data | H B 1 ) than for the model behind m ( data | H B 0 ) . Patrick Schwaferts (LMU) Imprecise Bayes Factor 01. August 2018 8 / 18

  24. What is the model behind m ( data | H B 1 )? Patrick Schwaferts (LMU) Imprecise Bayes Factor 01. August 2018 9 / 18

  25. What is the model behind m ( data | H B 1 )? Again Bayes Rule: 1 | data ) = m ( data | H B 1 ) · P ( H 1 ) P ( H B P ( data ) Patrick Schwaferts (LMU) Imprecise Bayes Factor 01. August 2018 9 / 18

  26. What is the model behind m ( data | H B 1 )? Again Bayes Rule: 1 | data ) = m ( data | H B 1 ) · P ( H 1 ) P ( H B P ( data ) In order to apply Bayes Rule, m ( data | H B 1 ) needs to be a likelihood, which describes the data-generating process. Patrick Schwaferts (LMU) Imprecise Bayes Factor 01. August 2018 9 / 18

  27. What is the model behind m ( data | H B 1 )? Again Bayes Rule: 1 | data ) = m ( data | H B 1 ) · P ( H 1 ) P ( H B P ( data ) In order to apply Bayes Rule, m ( data | H B 1 ) needs to be a likelihood, which describes the data-generating process. So the model behind m ( data | H B 1 ) models a data-generating process with likelihood ��� m ( data | H B f ( data | µ, σ 2 , δ ) P µ ( µ ) P σ 2 ( σ 2 ) P δ ( δ ) d δ d σ 2 d µ 1 ) = Patrick Schwaferts (LMU) Imprecise Bayes Factor 01. August 2018 9 / 18

  28. What is the model behind m ( data | H B 1 )? Again Bayes Rule: 1 | data ) = m ( data | H B 1 ) · P ( H 1 ) P ( H B P ( data ) In order to apply Bayes Rule, m ( data | H B 1 ) needs to be a likelihood, which describes the data-generating process. So the model behind m ( data | H B 1 ) models a data-generating process with likelihood ��� m ( data | H B f ( data | µ, σ 2 , δ ) P µ ( µ ) P σ 2 ( σ 2 ) P δ ( δ ) d δ d σ 2 d µ 1 ) = ⇒ A model with subjective components! Patrick Schwaferts (LMU) Imprecise Bayes Factor 01. August 2018 9 / 18

  29. What is the model behind m ( data | H B 1 )? Again Bayes Rule: 1 | data ) = m ( data | H B 1 ) · P ( H 1 ) P ( H B P ( data ) In order to apply Bayes Rule, m ( data | H B 1 ) needs to be a likelihood, which describes the data-generating process. So the model behind m ( data | H B 1 ) models a data-generating process with likelihood ��� m ( data | H B f ( data | µ, σ 2 , δ ) P µ ( µ ) P σ 2 ( σ 2 ) P δ ( δ ) d δ d σ 2 d µ 1 ) = ⇒ A model with subjective components! [The Bayes Factor does not directly answer: Is there an effect? ] Patrick Schwaferts (LMU) Imprecise Bayes Factor 01. August 2018 9 / 18

  30. Necessity of properly specifying P δ Patrick Schwaferts (LMU) Imprecise Bayes Factor 01. August 2018 10 / 18

Recommend

On Generalized Empirical Bayes Updating Thomas Augustin (LMU Munich) 1 / 1 Search for compromise

On Generalized Empirical Bayes Updating Thomas Augustin (LMU Munich) 1 / 1 Search for compromise

Revisiting the venerable question of updating imprecise probabilities. Search for compromise between Generalized Bayes Rule and ML-II / empirical Bayes updating from traditional statistics Update only those priors that are reasonable in the

835 views • 4 slides
The Geometry of Imprecise Inference Mik elis Bickis University of Saskatchewan ISIPTA15

The Geometry of Imprecise Inference Mik elis Bickis University of Saskatchewan ISIPTA15

Bayes theorem Exponential family Dual manifold Lower envelope theorem Linear updating Examples The Geometry of Imprecise Inference Mik elis Bickis University of Saskatchewan ISIPTA15 20 July 2015 Pescara, Italy Bickis U of S

443 views • 18 slides
Imprecise Gaussian Discriminant Classification 11th International Symposium on Imprecise

Imprecise Gaussian Discriminant Classification 11th International Symposium on Imprecise

Imprecise Gaussian Discriminant Classification 11th International Symposium on Imprecise Probabilities: Theories and Applications CARRANZA-ALARCON Yonatan-Carlos Ph.D. Candidate in Computer Science DESTERCKE Sbastien Ph.D Director 03 Jul

566 views • 20 slides
First-Order Necessity and Validity First-Order Necessity and Validity Mark Criley IWU

First-Order Necessity and Validity First-Order Necessity and Validity Mark Criley IWU

First-Order Necessity and Validity First-Order Necessity and Validity Mark Criley IWU BackOf, Between, Small, etc. predicates other than =. necessity does. But FO-necessity pays attention to a little bit less than Logical

107 views • 9 slides
Challenges on the use of Imprecise Prior for Imprecise Inference on Poisson Sampling Models Chel

Challenges on the use of Imprecise Prior for Imprecise Inference on Poisson Sampling Models Chel

Challenges on the use of Imprecise Prior for Imprecise Inference on Poisson Sampling Models Chel Hee Lee 1 , elis Bickis 2 Mik 1 Clinical Research Support Unit Community Health and Epidemiology College of Medicine University of Saskatchewan 2

830 views • 60 slides
Medical Necessity of Medical Necessity of Cardiac Implants: p The New Enforcement Priority

Medical Necessity of Medical Necessity of Cardiac Implants: p The New Enforcement Priority

Medical Necessity of Medical Necessity of Cardiac Implants: p The New Enforcement Priority Morgan, Lewis & Bockius, LLP Scott A. Memmott Albert W. Shay B Background k d Increased efforts over the last two years to combat

782 views • 43 slides
Search-Based Software Project Scheduling Francisco Chicano joint work with E. Alba, A. Cervantes,

Search-Based Software Project Scheduling Francisco Chicano joint work with E. Alba, A. Cervantes,

Conclusions Basic Multi-Objective Robust Preference-Based Introduction Formulation Formulation Formulation Formulation & Future Work Search-Based Software Project Scheduling Francisco Chicano joint work with E. Alba, A. Cervantes,

931 views • 54 slides
Existence of Simple Tours through Imprecise Points Maarten L offler Center for Geometry,

Existence of Simple Tours through Imprecise Points Maarten L offler Center for Geometry,

Existence of Simple Tours through Imprecise Points Maarten L offler Center for Geometry, Imaging and Virtual Environments Utrecht University 1-1 Overview Imprecise points Imprecise simple polygons NP-hardness proof Planar

845 views • 42 slides
Bayes Theorem Thomas Bayes (1701-1761) Simple form of Bayes Theorem, for

Bayes Theorem Thomas Bayes (1701-1761) Simple form of Bayes Theorem, for

Nave Bayes Classifica/on Debapriyo Majumdar Data Mining Fall 2014 Indian Statistical Institute Kolkata August 14, 2014 Bayes Theorem Thomas Bayes (1701-1761) Simple form of Bayes Theorem, for two

1.04k views • 20 slides
1 Bayes Nets: Assumptions Independence in a BN Assumptions we are required to make to define

1 Bayes Nets: Assumptions Independence in a BN Assumptions we are required to make to define

1 2 Recap: Bayes Nets CS 473: Artificial Intelligence Bayes Nets: Independence A Bayes net is an efficient encoding of a probabilistic model of a domain Questions we can ask: Inference: given a fixed BN, what is P(X | e)?

197 views • 5 slides
Introduction to the theory of imprecise probability Erik Quaeghebeur TU Delft, the Netherlands

Introduction to the theory of imprecise probability Erik Quaeghebeur TU Delft, the Netherlands

Introduction to the theory of imprecise probability Erik Quaeghebeur TU Delft, the Netherlands UTOPIAE Training School 2018, Durham, England Why would you want your probability to be imprecise? 2 versus 3 Uncertainty about outcome of. . .

859 views • 57 slides
The Comparison of Information Structures in Games: Bayes Correlated Equilibrium and Individual

The Comparison of Information Structures in Games: Bayes Correlated Equilibrium and Individual

The Comparison of Information Structures in Games: Bayes Correlated Equilibrium and Individual Sufficiency Dirk Bergemann and Stephen Morris USC February 2014 Robust Predictions game theoretic predictions are very sensitive to

768 views • 60 slides
An introduction to the theory of coherent lower previsions 2nd SIPTA School on Imprecise

An introduction to the theory of coherent lower previsions 2nd SIPTA School on Imprecise

An introduction to the theory of coherent lower previsions 2nd SIPTA School on Imprecise Probabilities, Madrid, July 24-28, 2006 Enrique Miranda Rey Juan Carlos University Dep. of Statistics and O.R. 2nd SIPTA school on imprecise

1.17k views • 85 slides
Empirical Interpretation of Imprecise Probabilities Marco Cattaneo School of Mathematics and

Empirical Interpretation of Imprecise Probabilities Marco Cattaneo School of Mathematics and

Empirical Interpretation of Imprecise Probabilities Marco Cattaneo School of Mathematics and Physical Sciences University of Hull ISIPTA 17 ECSQARU 2017, Lugano, Switzerland 10 July 2017 introduction imprecise probabilities can have

311 views • 8 slides
Bayes Classifiers Nave Bayes Classification Patrick Mair Bayes Classifiers Weather data

Bayes Classifiers Nave Bayes Classification Patrick Mair Bayes Classifiers Weather data

Bayes Classifiers Nave Bayes Classification Patrick Mair Bayes Classifiers Weather data set Predictors: Outlook, Temperature, Humidity, Windy. Response: Play (yes/no) Starting point Cross classification: Predictor/Response

98 views • 6 slides
Nave Bayes in a Nutshell Bayes rule: Assuming conditional independence among X i s: So,

Nave Bayes in a Nutshell Bayes rule: Assuming conditional independence among X i s: So,

Machine Learning 10-701 Tom M. Mitchell Machine Learning Department Carnegie Mellon University January 25, 2011 Today: Readings: Nave Bayes Required: discrete-valued X i s Mitchell: Nave Bayes and Document

624 views • 15 slides
Imprecise Network Monitoring Tools Brian Nisbet, HEAnet TF NOC, Prague Caveats! Important

Imprecise Network Monitoring Tools Brian Nisbet, HEAnet TF NOC, Prague Caveats! Important

Imprecise Network Monitoring Tools Brian Nisbet, HEAnet TF NOC, Prague Caveats! Important word here is imprecise This is a secondary information source at best People on the Internet are often wrong Do not go home and turn off

272 views • 11 slides
Necessity of 45-day Transesophageal Echocardiography after WATCHMAN Procedure amid the COVID-19

Necessity of 45-day Transesophageal Echocardiography after WATCHMAN Procedure amid the COVID-19

Necessity of 45-day Transesophageal Echocardiography after WATCHMAN Procedure amid the COVID-19 Pandemic Bryan E-Xin Tan, M.D. PGY-3 Internal Medicine Rochester General Hospital No Conflict of Interest Necessity of 45-day Transesophageal RESULTS

250 views • 8 slides
DATA MINING: NAVE BAYES 1 Nave Bayes Classifier Thomas Bayes 1702 - 1761 We will start off

DATA MINING: NAVE BAYES 1 Nave Bayes Classifier Thomas Bayes 1702 - 1761 We will start off

DATA MINING: NAVE BAYES 1 Nave Bayes Classifier Thomas Bayes 1702 - 1761 We will start off with some mathematical background. But first we start with some visual intuition. 2 Grasshoppers Katydids 10 9 8 7 Antenna Length 6 5 4

1.29k views • 61 slides
La th eorie PAC-Bayes en apprentissage supervis e Pr esentation au LRI de luniversit

La th eorie PAC-Bayes en apprentissage supervis e Pr esentation au LRI de luniversit

The mathematics of the PAC-Bayes Theory PAC-Bayes bounds and algorithms References La th eorie PAC-Bayes en apprentissage supervis e Pr esentation au LRI de luniversit e Paris XI Fran cois Laviolette, Laboratoire du GRAAL,

615 views • 50 slides
STAT 339 Naive Bayes Classification 8-10 March 2017 Colin Reimer Dawson Outline Naive Bayes

STAT 339 Naive Bayes Classification 8-10 March 2017 Colin Reimer Dawson Outline Naive Bayes

STAT 339 Naive Bayes Classification 8-10 March 2017 Colin Reimer Dawson Outline Naive Bayes Classification Naive Bayes Classifier Using MLE Parameter Estimates Bayesian Naive Bayes Continuous Features Mixed Feature Types Back to Supervised

530 views • 21 slides
Large Sample Robustness Bayes Nets with Incomplete Information Jim Smith and Ali Daneshkhah

Large Sample Robustness Bayes Nets with Incomplete Information Jim Smith and Ali Daneshkhah

Large Sample Robustness Bayes Nets with Incomplete Information Jim Smith and Ali Daneshkhah Universities of Warwick and Strathclyde Denmark PGM September 2008 Denmark PGM September 2008 1 / Jim Smith (Warwick) Robust Bayes Nets 30

395 views • 37 slides
Another Walkthrough of Variational Bayes Bevan Jones ML for NLP Reading Group The University of

Another Walkthrough of Variational Bayes Bevan Jones ML for NLP Reading Group The University of

Another Walkthrough of Variational Bayes Bevan Jones ML for NLP Reading Group The University of Edinburgh 18 th of October, 2012 2 Variational Bayes? Bayes Bayes Theorem But the integral is intractable! Sampling Gibbs,

1.51k views • 140 slides
Imprecise probabilistic models for inference in exponential families Erik Quaeghebeur Gert de

Imprecise probabilistic models for inference in exponential families Erik Quaeghebeur Gert de

Sketch of the context The specifics Summary Imprecise probabilistic models for inference in exponential families Erik Quaeghebeur Gert de Cooman SYSTeMS reseach group Ghent University 2 June 2006 Erik Quaeghebeur, Gert de Cooman Imprecise

774 views • 48 slides

More recommend