On the Hardness of Probabilistic Inference Relaxations Supratik - PowerPoint PPT Presentation

Apr 11, 2023 •345 likes •412 views

On the Hardness of Probabilistic Inference Relaxations Supratik Chakraborty 1 Kuldeep S. Meel 2 Moshe Y. Vardi 3 1 Indian Institute of Technology, Bombay 2 School of Computing, National University of Singapore 3 Department of Computer Science, Rice

On the Hardness of Probabilistic Inference Relaxations Supratik Chakraborty 1 Kuldeep S. Meel 2 Moshe Y. Vardi 3 1 Indian Institute of Technology, Bombay 2 School of Computing, National University of Singapore 3 Department of Computer Science, Rice University 1 / 3
Probabilistic Models Smoker ( S ) Asthma ( A ) Cough ( C ) Let q = Pr[Asthma( A ) | Cough( C )] Pr[Event | Evidence] 2 / 3
Probabilistic Models Smoker ( S ) Asthma ( A ) Cough ( C ) Let q = Pr[Asthma( A ) | Cough( C )] Pr[Event | Evidence] #P-Hard to compute, so need for relaxations 2 / 3
The Story of Relaxations with a Moral Conclusion Let q = Pr[Event | Evidence] • Additive Relaxations Given: δ, ε Estimate r such that Pr[ q − ε < r < q + ε ] ≥ 1 − δ (Sarkhel et al. 2016); (Fink,Huang, and Olteanu 2013) • Threshold Relaxations Given: thresh , δ if r ≥ thresh, then textbfOutput YES, else textbfOutput NO (Moy´ e 2006; King, Rosopa, and Minium 2010; Zongming 2009; Gordon et al. 2014; Bornholt, Mytkowicz, and McKinley 2014) 3 / 3
The Story of Relaxations with a Moral Conclusion Let q = Pr[Event | Evidence] • Additive Relaxations Given: δ, ε Estimate r such that Pr[ q − ε < r < q + ε ] ≥ 1 − δ (Sarkhel et al. 2016); (Fink,Huang, and Olteanu 2013) • Threshold Relaxations Given: thresh , δ if r ≥ thresh, then textbfOutput YES, else textbfOutput NO (Moy´ e 2006; King, Rosopa, and Minium 2010; Zongming 2009; Gordon et al. 2014; Bornholt, Mytkowicz, and McKinley 2014) The proposed relaxations are as hard as computing q exactly 3 / 3
The Story of Relaxations with a Moral Conclusion Let q = Pr[Event | Evidence] • Additive Relaxations Given: δ, ε Estimate r such that Pr[ q − ε < r < q + ε ] ≥ 1 − δ (Sarkhel et al. 2016); (Fink,Huang, and Olteanu 2013) • Threshold Relaxations Given: thresh , δ if r ≥ thresh, then textbfOutput YES, else textbfOutput NO (Moy´ e 2006; King, Rosopa, and Minium 2010; Zongming 2009; Gordon et al. 2014; Bornholt, Mytkowicz, and McKinley 2014) The proposed relaxations are as hard as computing q exactly Not all is lost. New Relaxation that is efficient to compute and can replace threshold relaxation for statistical testing applications Money Back Guarantee: Come to the poster tonight, and you will leave demanding a rigorous analysis everytime someone proposes new relaxation. 3 / 3

Recommend

15-780 Graduate Artificial Intelligence: Probabilistic inference J. Zico Kolter (this

15-780 Graduate Artificial Intelligence: Probabilistic inference J. Zico Kolter (this lecture) and Nihar Shah Carnegie Mellon University Spring 2020 1 Outline Probabilistic graphical models Probabilistic inference Exact inference

665 views • 39 slides

Unifying Local Consistency and MAX SAT Relaxations for Scalable Inference with Rounding

Unifying Local Consistency and MAX SAT Relaxations for Scalable Inference with Rounding Guarantees Stephen H. Bach Bert Huang Lise Getoor Maryland Virginia Tech UC Santa Cruz AISTATS

715 views • 35 slides

On Computational and Probabilistic Inference Rajat Mani Thomas Objectives: Revisiting Bayesian

On Computational and Probabilistic Inference Rajat Mani Thomas Objectives: Revisiting Bayesian inference . A look at Likelihood and the prior Probabilistic programming: Automating Bayesian (like) Inference Probabilistic Toolkit:

833 views • 59 slides

Advanced inference in probabilistic programs Brooks Paige Inference thus far Likelihood

Advanced inference in probabilistic programs Brooks Paige Inference thus far Likelihood weighting / importance sampling MCMC (single-dimension, coded by hand) Lightweight Metropolis-Hastings (update one random choice at a time,

995 views • 86 slides

Probabilistic Graphical Models Probabilistic Graphical Models MAP inference Siamak Ravanbakhsh

Probabilistic Graphical Models Probabilistic Graphical Models MAP inference Siamak Ravanbakhsh Fall 2019 Learning objectives Learning objectives MAP inference and its complexity exact & approximate MAP inference max-product and max-sum

957 views • 74 slides

Lifted Probabilistic Inference by First-Order Knowledge Compilation Guy Van den Broeck Nima

Lifted Probabilistic Inference by First-Order Knowledge Compilation Guy Van den Broeck Nima Taghipour Wannes Meert Jesse Davis Luc De Raedt Lifted Inference in Probabilistic Logical Models - Tutorial - IJCAI11 18/07/11 Outline Overview

947 views • 80 slides

Probabilistic Partial Evaluation: Exploiting rule structure in probabilistic inference David

To appear, Proc. 15th International Joint Conference on AI (IJCAI-97), Nagoya, Japan, August, 1997 Probabilistic Partial Evaluation: Exploiting rule structure in probabilistic inference David Poole Department of Computer Science University

220 views • 8 slides

Applying Search Based Probabilistic Inference Algorithms to Probabilistic Conformant Planning:

Applying Search Based Probabilistic Inference Algorithms to Probabilistic Conformant Planning: Preliminary Results Junkyu Lee * , Radu Marinescu ** and Rina Dechter * * University of California, Irvine ** IBM Research, Ireland ISAIM 2016

592 views • 35 slides

Probabilistic Partial Evaluation: Exploiting rule structure in probabilistic inference David

Probabilistic Partial Evaluation: Exploiting rule structure in probabilistic inference David Poole University of British Columbia 1 Overview Belief Networks Variable Elimination Algorithm Parent Contexts & Structured

259 views • 21 slides

Mechanical Properties of Paint Coatings Hardness Measurement Shore Hardness D Barcol Hardness

Mechanical Properties of Paint Coatings Hardness Measurement Shore Hardness D Barcol Hardness ASTM D2583 Fiberglass Aluminum Aluminum Alloys Soft Metals Plastics Scratch Hardness- (IS 101 - Part 5/Sec 2) BS 3900 Hardness can

1.89k views • 30 slides

CS325 Artificial Intelligence Ch 14b Probabilistic Inference Cengiz Gnay Spring 2013

CS325 Artificial Intelligence Ch 14b Probabilistic Inference Cengiz Gnay Spring 2013 Gnay Ch 14b Probabilistic Inference Inference tasks Simple queries: compute posterior marginal P ( X i | E = e ) Conjunctive queries: P ( X i , X

402 views • 19 slides

Towards Verified Stochastic Variational Inference for Probabilistic Programs Wonyeol Lee 1

Towards Verified Stochastic Variational Inference for Probabilistic Programs Wonyeol Lee 1 Hangyeol Yu 1 Xavier Rival 2 Hongseok Yang 1 1 KAIST, South Korea 2 INRIA/ENS/CNRS, France POPL 2020 Probabilistic c Programming Example 1: def p():

774 views • 66 slides

On the relation between certain stochastic control problems and probabilistic inference Manfred

On the relation between certain stochastic control problems and probabilistic inference Manfred Opper Computer Science 1 Control problem inference problem (Bert Kappen & Ema- Bellman nuel Todorov) Inference

432 views • 18 slides

t ' ! tractable probabilistic inference meeting ! December 11th 2019 - NeurIPS 2019 , Vancouver

t ' ! tractable probabilistic inference meeting ! December 11th 2019 - NeurIPS 2019 , Vancouver Lets discuss about the current state of flexible , reliable , and efficient probabilistic inference and learning and where we want it to be! 2

547 views • 26 slides

Approximate inference: Sampling methods Probabilistic Graphical Models Sharif University of

Approximate inference: Sampling methods Probabilistic Graphical Models Sharif University of Technology Spring 2018 Soleymani Approximate inference Approximate inference techniques Deterministic approximation Variational algorithms

1.95k views • 97 slides

Self-applicable probabilistic inference without interpretive overhead Oleg Kiselyov Chung-chieh

Self-applicable probabilistic inference without interpretive overhead Oleg Kiselyov Chung-chieh Shan FNMOC Rutgers University oleg@pobox.com ccshan@rutgers.edu Tufts University 12 February 2010 Probabilistic inference Model (what)

770 views • 66 slides

Inference and Learning for Probabilistic Logic Programming Fabrizio Riguzzi Dipartimento di

Inference and Learning for Probabilistic Logic Programming Fabrizio Riguzzi Dipartimento di Matematica e Informatica Universit di Ferrara F. Riguzzi (DMI) Inference and learning for PLP 1 / 25 Outline Probabilistic Logic Languages 1

405 views • 25 slides

Meta-Amoruized Variational Inference and Learning Kristy Choi CS236: December 4th, 2019

Meta-Amoruized Variational Inference and Learning Kristy Choi CS236: December 4th, 2019 Probabilistic Inference Probabilistic inference is a paruicular way of viewing the world: + = Observations Updated (posterior) Prior belief Typically

452 views • 28 slides

Variational Inference and Learning Michael Gutmann Probabilistic Modelling and Reasoning

Variational Inference and Learning Michael Gutmann Probabilistic Modelling and Reasoning (INFR11134) School of Informatics, University of Edinburgh Spring semester 2018 Recap Learning and inference often involves intractable integrals

786 views • 36 slides

Self-applicable probabilistic inference without interpretive overhead Oleg Kiselyov Chung-chieh

Self-applicable probabilistic inference without interpretive overhead Oleg Kiselyov Chung-chieh Shan FNMOC Rutgers University oleg@pobox.com ccshan@rutgers.edu 16 April 2009 Patrick Hughes Patrick Hughes Probabilistic inference Pr

797 views • 50 slides

Rank of tensors of l-out-of-k functions: an application in probabilistic inference Ji r

Rank of tensors of l-out-of-k functions: an application in probabilistic inference Ji r Vomlel Institute of Information Theory and Automation ( UTIA) Academy of Sciences of the Czech Republic Contents The computer game of

764 views • 59 slides

PCP and Hardness of Approximation Aman Bansal Adwait Godbole October 2019 Aman Bansal Adwait

PCP and Hardness of Approximation Aman Bansal Adwait Godbole October 2019 Aman Bansal Adwait Godbole PCP and Hardness of Approximation October 2019 1 / 37 Trajectory Relaxations of Hard Problems 1 Approximate Problems Gap Problem

867 views • 63 slides

Variational inference Probabilistic Graphical Models Sharif University of Technology Soleymani

Variational inference Probabilistic Graphical Models Sharif University of Technology Soleymani Spring 2018 Some slides are adapted from Xing s slides Exact methods for inference Variable elimination Message Passing: shared terms

1.2k views • 84 slides

Approximate Inference: Mean Field Methods Probabilistic Graphical Models (10- Probabilistic

School of Computer Science Approximate Inference: Mean Field Methods Probabilistic Graphical Models (10- Probabilistic Graphical Models (10 -708) 708) Lecture 17, Nov 12, 2007 Receptor A Receptor A X 1 X 1 X 1 Receptor B Receptor B X 2

672 views • 18 slides