Inference under the entropy-maximizing Bayesian model of sufficient - PowerPoint PPT Presentation

Apr 04, 2024 •206 likes •366 views

Inference under the entropy-maximizing Bayesian model of sufficient evidence The Third International Conference on Mathematical and Computational Medicine 18 May 2016 David Bickel University of Ottawa Loss function example What act is

Inference under the entropy-maximizing Bayesian model of sufficient evidence The Third International Conference on Mathematical and Computational Medicine 18 May 2016 David Bickel University of Ottawa
Loss function example What act is appropriate? • Given multiple priors of sufficient evidence, agreement with the data • With or without confidence sets
Adequate models have sufficient evidence
Assessing multiple models All models Models in conflict with the data Adequate models (models of sufficient evidential support)
Decisions under robust Bayes rules applied to models of sufficient evidence Robust Bayes acts: Adequate • E-admissible Adequate models posteriors • Hurwicz criterion • Γ -minimax Bickel, International Journal of Approximate Reasoning 66 , 53-72 Loss function 1 model 1 posterior Bayes act
Bayesian model assessment Does the prior or parametric family conflict with the data? • Yes, if it has low evidential support compared to alternatives • Measures of support satisfying the criteria of Bickel, International Statistical Review 81 , 188-206: • Likelihood ratio (limited to comparing two simple models) • Bayes factor • Penalized likelihood ratio No Yes Use the model to take Bayes act Change the model (minimize posterior expected loss) to an adequate model, a even if other models are adequate model of sufficient support
Decisions under the entropy-maximizing Bayesian model of sufficient evidence Adequate Adequate models posteriors Bickel, International Journal of Approximate Reasoning 66 , 53-72 Blending Loss function Nested confidence 1 posterior Bayes act sets
Decisions under the entropy-maximizing Bayesian model of sufficient evidence Adequate Adequate models posteriors Bickel, International Journal of Approximate Reasoning 66 , 53-72 Blending Loss function Nested confidence 1 posterior Bayes act sets
Decisions under entropy-based pooling of Bayesian model of sufficient evidence Bickel, International Journal of Approximate Reasoning 66 , 53-72 Adequate Adequate models posteriors Pooling Loss function 1 posterior Minimize expected loss
The three players • Combiner is you, the statistician who combines the candidate distributions • Goal 1: minimize error; Goal 2: beat Chooser • Chooser is the imaginary statistician who instead chooses a single candidate distribution • Goal 1: minimize error; Goal 2: beat Combiner • Nature picks the true distribution among those that are plausible in order to help Chooser
Information game • Information divergence and inferential gain: • Utility paid to Statistician 2 (Combiner or Chooser): • Reduction to game of Combiner v. Nature-Chooser Coalition:
Robust Bayes acts: Adequate • E-admissible Adequate models posteriors • Hurwicz criterion • Γ -minimax Blending Pooling Loss function Nested confidence 1 posterior Bayes act sets Funded by the Natural Sciences and Engineering Research Council of Canada

Recommend

Meta-Bayesian Analysis A Bayesian decision-theoretic analysis of Bayesian inference under model

Meta-Bayesian Analysis A Bayesian decision-theoretic analysis of Bayesian inference under model misspecification Jun Yang joint work with Daniel Roy Department of Statistical Sciences University of Toronto World Congress in Probability and

190 views • 17 slides

MaxEnt14, The 34th International Workshop on Bayesian Inference and Maximum Entropy Methods in

Socit de l'lectricit, de l'lectronique et des technologies de l'information et de la communication MaxEnt14, The 34th International Workshop on Bayesian Inference and Maximum Entropy Methods in Science and Engineering Frdric

582 views • 39 slides

Entropy Inference Based on An Objective Bayesian Approach for Upper Record Values Having the

Conference Proceedings Paper Entropy Inference Based on An Objective Bayesian Approach for Upper Record Values Having the Two-Parameter Logistic Distribution Jung-In Seo Department of Statistics, Daejeon University, 62 Daehak-ro, Daejeon,

121 views • 9 slides

Obtaining first place estimates for Model 1 James Ritchie (and Iain Murray) Bayesian Inference

Obtaining first place estimates for Model 1 James Ritchie (and Iain Murray) Bayesian Inference Bayes' rule: Prior Likelihood Posterior Bayesian Inference Approximate with S samples drawn from Priors Need to choose Read the

565 views • 22 slides

CS440/ECE448 Lecture 15: Bayesian Inference and Bayesian Learning Slides by Svetlana Lazebnik,

CS440/ECE448 Lecture 15: Bayesian Inference and Bayesian Learning Slides by Svetlana Lazebnik, 10/2016 Modified by Mark Hasegawa-Johnson, 3/2019 Bayesian Inference and Bayesian Learning Bayes Rule Bayesian Inference Misdiagnosis

829 views • 38 slides

Analytics, Inference and Computation in Cosmology: Exercises on Bayesian Inference Roberto

Analytics, Inference and Computation in Cosmology: Exercises on Bayesian Inference Roberto Trotta, Imperial College London Sept 2018 Contents 1 Bayesian Reasoning 1 2 Bayesian Parameter Estimation 2 2.1 Coin Tossing: Binomial

292 views • 10 slides

From probabilistic inference to Bayesian unfolding (passing through a toy model) Giulio

From probabilistic inference to Bayesian unfolding (passing through a toy model) Giulio DAgostini University and INFN Section of Roma1 Helmholtz School Advanced Topics in Statistics G ottingen, 17-20 October 2010 G.

1.57k views • 127 slides

Polynomial Chaos Acceleration for the Bayesian Inference of Random Fields with Gaussian Priors and

Bayesian Inference Coordinate transformation for Uncertain Correlation Function PC surrogate model Inference Example Polynomial Chaos Acceleration for the Bayesian Inference of Random Fields with Gaussian Priors and Uncertain Covariance

573 views • 21 slides

Comparison Between Bayesian and Maximum Entropy Analysis of Flow Networks 1 Maximum Entropy

Comparison Between Bayesian and Maximum Entropy Analysis of Flow Networks 1 Maximum Entropy The Maximum Entropy (MaxEnt) method is a methodology to assign or update probability distributions to describe systems which are not completely

202 views • 17 slides

An Introduction to Bayesian Inference and MCMC Methods for Capture-Recapture Trinity River

An Introduction to Bayesian Inference and MCMC Methods for Capture-Recapture Trinity River Restoration Program Workshop on Outmigration: Population Estimation October 68, 2009 An Introduction to Bayesian Inference The Binomial Model 1

675 views • 63 slides

Bayesian Model Selection and Averaging Nonlinear Models Bayes factors Example Families FFX

Bayesian Model Selection and Averaging Will Penny Model Comparison Model Evidence Complexity Bayesian Model Selection and Averaging Nonlinear Models Bayes factors Example Families FFX Model Will Penny Inference RFX Model Inference

600 views • 59 slides

BAYESIAN CALIBRATION OF COMPUTER MODELS Bayesian inference & Markov chain Monte Carlo

BAYESIAN CALIBRATION OF COMPUTER MODELS Bayesian inference & Markov chain Monte Carlo Gaussian processes, Computer model calibration and prediction Dave Higdon, Virginia Tech, Brian Williams & Jim Gattiker Statistical Sciences Group,

1.52k views • 133 slides

Approximate Bayesian inference for latent Gaussian models avard Rue 1 H Department of

Approximative Bayesian inference Approximate Bayesian inference for latent Gaussian models avard Rue 1 H Department of Mathematical Sciences NTNU, Norway December 4, 2009 1 With S.Martino/N.Chopin Approximative Bayesian inference Overview

1.61k views • 159 slides

Machine Learning: Foundations Lecturer: Yishay Mansour Lecture 2 Bayesian Inference Kfir Bar

Machine Learning: Foundations Lecturer: Yishay Mansour Lecture 2 Bayesian Inference Kfir Bar Yaniv Bar Marcelo Bacher Based on notes by Shahar Yifrah, Keren Yizhak, Hadas Zur (2012) Bayesian Inference Bayesian inference is a method of

600 views • 37 slides

EST5104 Bayesian Inference EST5803 Advanced Bayesian Inference Ricardo Ehlers ehlers@icmc.usp.br

EST5104 Bayesian Inference EST5803 Advanced Bayesian Inference Ricardo Ehlers ehlers@icmc.usp.br http://www.icmc.usp.br/~ehlers Departamento de Matem atica Aplicada e Estat stica Universidade de S ao Paulo Presentation Start date:

443 views • 25 slides

Introduction to Bayesian Inference Frank Wood April 6, 2010 Introduction Overview of Topics

Introduction to Bayesian Inference Frank Wood April 6, 2010 Introduction Overview of Topics Bayesian Analysis Single Parameter Model Bayesian Analysis Recipe Bayesian data analysis can be described as a three step process 1. Set up a full

833 views • 31 slides

Inference in Bayesian networks Chapter 14.45 Chapter 14.45 1 Outline Exact inference

Inference in Bayesian networks Chapter 14.45 Chapter 14.45 1 Outline Exact inference by enumeration Approximate inference by stochastic simulation Chapter 14.45 2 Inference tasks Simple queries: compute posterior marginal P (

450 views • 28 slides

Sequential Point Process Model and Bayesian Inference for Spatial Point Patterns with Linear

Sequential Point Process Model and Bayesian Inference for Spatial Point Patterns with Linear Structures Jakob G. Rasmussen Joint work with Jesper Mller Department of Mathematical Sciences Aalborg University Denmark 1 / 19 Outline Data

380 views • 19 slides

Exact inference (Ch. 14) Bayesian Network A Bayesian network (Bayes net) is: (1) a directed

Exact inference (Ch. 14) Bayesian Network A Bayesian network (Bayes net) is: (1) a directed graph (2) acyclic Additionally, Bayesian networks are assumed to be defined by conditional probability tables (3) P(x | Parents(x) ) We have actually

673 views • 28 slides

Quasi-Bayesian inference - pitfalls of incoherence Jacek Osiewalski (Cracow University of

Quasi-Bayesian inference - pitfalls of incoherence Jacek Osiewalski (Cracow University of Economics) Bayesian analysis for a given statistical model: probabilistic representation of initial un certainty about all unknowns not only

140 views • 11 slides

Probability, Entropy, and Inference Ensemble X is a triple ( x, A X , P X ) , where Based on

2 Ensembles and probabilities Probability, Entropy, and Inference Ensemble X is a triple ( x, A X , P X ) , where Based on David J.C. MacKay: x is the outcome of random variable Information Theory, Inference and Learning Algorithms, 2003

207 views • 4 slides

Bayesian inference for age-structured population model of infectious disease with application to

Bayesian inference for age-structured population model of infectious disease with application to varicella in Poland Piotr Gwiazda, Baej Miasojedow, Magdalena Rosiska 02.XII.2016 Varicella Varicella or chickenpox is a viral disease which

727 views • 20 slides

Outline Intro to RL and Bayesian Learning History of Bayesian RL Model-based Bayesian

Outline Intro to RL and Bayesian Learning History of Bayesian RL Model-based Bayesian RL Prior knowledge, policy optimization, discussion, Bayesian approaches for other RL variants Model-free Bayesian RL Gaussian

1.23k views • 63 slides

Bayesian model comparison with applications Johannes Bergstr om Department of Theoretical

Foundations Bayesian inference Examples and applications Bayesian model comparison with applications Johannes Bergstr om Department of Theoretical Physics, KTH Royal Institute of Technology July 16, 2013 Johannes Bergstr om Bayesian

831 views • 33 slides