investigating the use of bayesian networks in the hora
play

Investigating the Use of Bayesian Networks in the Hora Approach for - PowerPoint PPT Presentation

Dec 15, 2023 •758 likes •1.36k views

Investigating the Use of Bayesian Networks in the Hora Approach for Component-based Online Failure Prediction Teerat Pitakrat, Andr van Hoorn University of Stuttgart Institute of Software Technology (ISTE) Reliable Software Systems (RSS)

  1. Investigating the Use of Bayesian Networks in the Hora Approach for Component-based Online Failure Prediction Teerat Pitakrat, André van Hoorn University of Stuttgart Institute of Software Technology (ISTE) Reliable Software Systems (RSS) Group Stuttgart, Germany Nov 27, 2014 @ SOSP 2014, Stuttgart T. Pitakrat, A. van Hoorn Investigating the Use of Bayesian Networks in Hora for C-B OFP Nov. 27, 2014 @ SOSP 2014 1 / 29

  2. Service Failure Motivation: Failure Management T. Pitakrat, A. van Hoorn Investigating the Use of Bayesian Networks in Hora for C-B OFP Nov. 27, 2014 @ SOSP 2014 2 / 29

  3. Service Failure Motivation: Failure Management T. Pitakrat, A. van Hoorn Investigating the Use of Bayesian Networks in Hora for C-B OFP Nov. 27, 2014 @ SOSP 2014 2 / 29

  4. Service Failure Motivation: Failure Management T. Pitakrat, A. van Hoorn Investigating the Use of Bayesian Networks in Hora for C-B OFP Nov. 27, 2014 @ SOSP 2014 2 / 29

  5. Service Failure Motivation: Failure Management “A service failure , often abbreviated here to failure , is an event that occurs when the delivered service deviates from correct service.” — Avizienis et al. [2004] T. Pitakrat, A. van Hoorn Investigating the Use of Bayesian Networks in Hora for C-B OFP Nov. 27, 2014 @ SOSP 2014 3 / 29

  6. Reactive vs. Proactive Failure Mgmt. Motivation: Failure Management 100% QoS 0% Reactive Failure Failure detected Start recovery System recovered T. Pitakrat, A. van Hoorn Investigating the Use of Bayesian Networks in Hora for C-B OFP Nov. 27, 2014 @ SOSP 2014 4 / 29

  7. Reactive vs. Proactive Failure Mgmt. Motivation: Failure Management 100% QoS 0% Reactive Failure Failure detected Start recovery System recovered 100% QoS Proactive 0% Failure predicted Prepare recovery Failure System recovered T. Pitakrat, A. van Hoorn Investigating the Use of Bayesian Networks in Hora for C-B OFP Nov. 27, 2014 @ SOSP 2014 4 / 29

  8. Agenda Motivation: Failure Management 1 [Recap] Hora: Online Failure Prediction for CB Systems 2 Hora: Framework and Implementation 3 Evaluation 4 Conclusion 5 T. Pitakrat, A. van Hoorn Investigating the Use of Bayesian Networks in Hora for C-B OFP Nov. 27, 2014 @ SOSP 2014 5 / 29

  9. Related Approaches vs. Hora Approach [Recap] Hora: Online Failure Prediction for CB Systems Amin et al. [2012], Liang et al. [2007] T. Pitakrat, A. van Hoorn Investigating the Use of Bayesian Networks in Hora for C-B OFP Nov. 27, 2014 @ SOSP 2014 6 / 29

  10. Related Approaches vs. Hora Approach [Recap] Hora: Online Failure Prediction for CB Systems Bielefeld [2012] T. Pitakrat, A. van Hoorn Investigating the Use of Bayesian Networks in Hora for C-B OFP Nov. 27, 2014 @ SOSP 2014 6 / 29

  11. Related Approaches vs. Hora Approach [Recap] Hora: Online Failure Prediction for CB Systems Pitakrat [2013], Pitakrat et al. [2014b] T. Pitakrat, A. van Hoorn Investigating the Use of Bayesian Networks in Hora for C-B OFP Nov. 27, 2014 @ SOSP 2014 6 / 29

  12. Related Approaches vs. Hora Approach [Recap] Hora: Online Failure Prediction for CB Systems Component-level Prediction Models + System-level Prediction Model Component Dependency Pitakrat [2013], Pitakrat et al. [2014b] T. Pitakrat, A. van Hoorn Investigating the Use of Bayesian Networks in Hora for C-B OFP Nov. 27, 2014 @ SOSP 2014 6 / 29

  13. Hora: Component-level Prediction Models [Recap] Hora: Online Failure Prediction for CB Systems T. Pitakrat, A. van Hoorn Investigating the Use of Bayesian Networks in Hora for C-B OFP Nov. 27, 2014 @ SOSP 2014 7 / 29

  14. Hora: Component-level Prediction Models [Recap] Hora: Online Failure Prediction for CB Systems x x x x x x x x x T. Pitakrat, A. van Hoorn Investigating the Use of Bayesian Networks in Hora for C-B OFP Nov. 27, 2014 @ SOSP 2014 7 / 29

  15. Hora: Framework Architecture [Recap] Hora: Online Failure Prediction for CB Systems PCM SLAstic ... Component-level Predictors HDD Failure Predictor CDT System-level Predictor PAD Monitoring ! Reader ! Event Log Analyzer Hora Kieker, Weka, R, ESPER, ... Becker et al. [2009], Bielefeld [2012], Pitakrat et al. [2013; 2014a], van Hoorn [2014] T. Pitakrat, A. van Hoorn Investigating the Use of Bayesian Networks in Hora for C-B OFP Nov. 27, 2014 @ SOSP 2014 8 / 29

  16. Hora: Framework Architecture [Recap] Hora: Online Failure Prediction for CB Systems PCM SLAstic ... Component-level Predictors HDD Failure Predictor CDT System-level Predictor PAD Monitoring ! Reader ! Event Log Analyzer Hora Kieker, Weka, R, ESPER, ... Questions: 1 What is a suitable model for System-level Prediction Model (SPM)? 2 How to transform architectural models to CDT and to SPM? 3 How does Hora improve online failure prediction? Becker et al. [2009], Bielefeld [2012], Pitakrat et al. [2013; 2014a], van Hoorn [2014] T. Pitakrat, A. van Hoorn Investigating the Use of Bayesian Networks in Hora for C-B OFP Nov. 27, 2014 @ SOSP 2014 8 / 29

  17. Agenda Hora: Framework and Implementation Motivation: Failure Management 1 [Recap] Hora: Online Failure Prediction for CB Systems 2 Hora: Framework and Implementation 3 Evaluation 4 Conclusion 5 T. Pitakrat, A. van Hoorn Investigating the Use of Bayesian Networks in Hora for C-B OFP Nov. 27, 2014 @ SOSP 2014 9 / 29

  18. Hora: Framework Architecture Hora: Framework and Implementation PCM SLAstic ... Component-level Predictors HDD Failure Predictor CDT System-level Predictor PAD Monitoring ! Reader ! Event Log Analyzer Hora Kieker, Weka, R, ESPER, ... Questions: 1 What is a suitable model for System-level Prediction Model (SPM)? 2 How to transform architectural models to CDT and to SPM? 3 How does Hora improve online failure prediction? T. Pitakrat, A. van Hoorn Investigating the Use of Bayesian Networks in Hora for C-B OFP Nov. 27, 2014 @ SOSP 2014 10 / 29

  19. System-level Prediction Model Hora: Framework and Implementation Bayesian network: probabilistic graphical model Bayesian network library used in Hora: https://github.com/kutschkem/Jayes T. Pitakrat, A. van Hoorn Investigating the Use of Bayesian Networks in Hora for C-B OFP Nov. 27, 2014 @ SOSP 2014 11 / 29

  20. System-level Prediction Model Hora: Framework and Implementation Bayesian network: probabilistic graphical model Rain T F Rain 0.2 0.8 Sprinkler Rain T F Sprinkler Grass wet T 0.01 0.99 Sprinkler Rain T F F 0.4 0.6 T T 0.99 0.01 T F 0.9 0.1 Grass F T 0.8 0.2 F F 0.0 1.0 Bayesian network library used in Hora: https://github.com/kutschkem/Jayes T. Pitakrat, A. van Hoorn Investigating the Use of Bayesian Networks in Hora for C-B OFP Nov. 27, 2014 @ SOSP 2014 11 / 29

  21. System-level Prediction Model Hora: Framework and Implementation Bayesian network: probabilistic graphical model 0.2 0.8 0.01 0.99 0.4 0.6 0.99 0.01 0.9 0.1 0.8 0.2 0.0 1.0 Bayesian network library used in Hora: https://github.com/kutschkem/Jayes T. Pitakrat, A. van Hoorn Investigating the Use of Bayesian Networks in Hora for C-B OFP Nov. 27, 2014 @ SOSP 2014 11 / 29

  22. Hora: Framework Architecture Hora: Framework and Implementation PCM SLAstic ... Component-level Predictors HDD Failure Predictor CDT System-level Predictor PAD Monitoring ! Reader ! Event Log Analyzer Hora Kieker, Weka, R, ESPER, ... Questions: 1 What is a suitable model for System-level Prediction Model (SPM)? 2 How to transform architectural models to CDT and to SPM? 3 How does Hora improve online failure prediction? T. Pitakrat, A. van Hoorn Investigating the Use of Bayesian Networks in Hora for C-B OFP Nov. 27, 2014 @ SOSP 2014 12 / 29

  23. Component Dependency Table Component Dependencies Hora: Framework and Implementation T. Pitakrat, A. van Hoorn Investigating the Use of Bayesian Networks in Hora for C-B OFP Nov. 27, 2014 @ SOSP 2014 13 / 29

  24. Component Dependency Table Component Dependencies Hora: Framework and Implementation C 1 C 2 C 3 H 1 H 2 C 1 • • • C 2 • • C 3 • H 1 H 2 T. Pitakrat, A. van Hoorn Investigating the Use of Bayesian Networks in Hora for C-B OFP Nov. 27, 2014 @ SOSP 2014 13 / 29

  25. Component Dependency Table Dependency Calling Probability Hora: Framework and Implementation C 1 C 2 C 3 H 1 H 2 C 1 0 . 5 0 . 5 1 . 0 C 2 0 . 5 1 . 0 C 3 1 . 0 H 1 H 2 T. Pitakrat, A. van Hoorn Investigating the Use of Bayesian Networks in Hora for C-B OFP Nov. 27, 2014 @ SOSP 2014 14 / 29

  26. System-level Prediction Model Hora: Framework and Implementation C 1 C 2 C 3 H 1 H 2 C 1 0 . 5 0 . 5 1 . 0 C 2 0 . 5 1 . 0 C 3 1 . 0 H 1 H 2 T. Pitakrat, A. van Hoorn Investigating the Use of Bayesian Networks in Hora for C-B OFP Nov. 27, 2014 @ SOSP 2014 15 / 29

  27. System-level Prediction Model Hora: Framework and Implementation C 1 C 2 C 3 H 1 H 2 C 1 0 . 5 0 . 5 1 . 0 C 2 0 . 5 1 . 0 C 3 1 . 0 H 1 H 2 T. Pitakrat, A. van Hoorn Investigating the Use of Bayesian Networks in Hora for C-B OFP Nov. 27, 2014 @ SOSP 2014 15 / 29

  28. System-level Prediction Model Hora: Framework and Implementation C 1 C 2 C 3 H 1 H 2 C 1 0 . 5 0 . 5 1 . 0 C 2 0 . 5 1 . 0 H 2 C 3 1 . 0 ✓ ✗ H 1 0 . 8 0 . 2 H 2 T. Pitakrat, A. van Hoorn Investigating the Use of Bayesian Networks in Hora for C-B OFP Nov. 27, 2014 @ SOSP 2014 15 / 29

Recommend

CS 331: Bayesian Networks 2 1 Bayesian Networks Youve heard about how Bayesian networks

CS 331: Bayesian Networks 2 1 Bayesian Networks Youve heard about how Bayesian networks

CS 331: Bayesian Networks 2 1 Bayesian Networks Youve heard about how Bayesian networks have revolutionized AI Youve seen what they are There are two nagging questions: 1. How do you come up with a Bayesian network

196 views • 17 slides
Bayesian networks (2) Lirong Xia Last class Bayesian networks compact, graphical

Bayesian networks (2) Lirong Xia Last class Bayesian networks compact, graphical

Bayesian networks (2) Lirong Xia Last class Bayesian networks compact, graphical representation of a joint probability distribution conditional independence 2 Bayesian network Definition of Bayesian network (Bayes net or

674 views • 23 slides
Bayesian Networks C H A P T E R 1 4 H A S S A N K H O S R A V I S P R I N G 2 0 1 1

Bayesian Networks C H A P T E R 1 4 H A S S A N K H O S R A V I S P R I N G 2 0 1 1

Bayesian Networks C H A P T E R 1 4 H A S S A N K H O S R A V I S P R I N G 2 0 1 1 Definition of Bayesian networks Representing a joint distribution by a graph Can yield an efficient factored representation for a joint

965 views • 67 slides
Bayesian Networks Youve heard about how Bayesian networks have revolutionized AI

Bayesian Networks Youve heard about how Bayesian networks have revolutionized AI

Bayesian Networks Youve heard about how Bayesian networks have revolutionized AI Youve seen what they are CS 331: Bayesian Networks 2 There are two nagging questions: 1. How do you come up with a Bayesian network

529 views • 6 slides
Probabilistic Modeling: Bayesian Networks Bioinformatics: Sequence Analysis COMP 571 - Spring

Probabilistic Modeling: Bayesian Networks Bioinformatics: Sequence Analysis COMP 571 - Spring

Probabilistic Modeling: Bayesian Networks Bioinformatics: Sequence Analysis COMP 571 - Spring 2015 Luay Nakhleh, Rice University Bayesian Networks Bayesian networks are probabilistic descriptions of the regulatory network. A Bayesian

409 views • 36 slides
5.2 Learning Bayesian networks: General idea See Witten et al. 2011. Bayesian (belief) networks

5.2 Learning Bayesian networks: General idea See Witten et al. 2011. Bayesian (belief) networks

5.2 Learning Bayesian networks: General idea See Witten et al. 2011. Bayesian (belief) networks aim at representing probability distributions of features and how to combine them to make predictions about the likelihood that a particular

622 views • 22 slides
ECE 4524 Artificial Intelligence and Engineering Applications Lecture 19: Bayesian Networks

ECE 4524 Artificial Intelligence and Engineering Applications Lecture 19: Bayesian Networks

ECE 4524 Artificial Intelligence and Engineering Applications Lecture 19: Bayesian Networks Reading: AIAMA 14.1-14.4 Todays Schedule: Bayesian Networks Causal Reasoning Exact Inference Bayesian Networks (BN) A BN is a

206 views • 9 slides
Bayesian networks Independence Bayesian networks Markov conditions Inference by

Bayesian networks Independence Bayesian networks Markov conditions Inference by

Bayesian networks Independence Bayesian networks Markov conditions Inference by enumeration rejection sampling Gibbs sampler Independence if P(A=a,B=a) = P(A=a)P(B=b) for all a and b, then we call A and B

733 views • 19 slides
Bayesian networks 1 Outline Syntax Semantics Parameterized distributions 2 Bayesian

Bayesian networks 1 Outline Syntax Semantics Parameterized distributions 2 Bayesian

Bayesian networks 1 Outline Syntax Semantics Parameterized distributions 2 Bayesian networks A simple, graphical notation for conditional independence assertions and hence for compact specification of full joint distributions

426 views • 31 slides
Why This Matters Bayesian networks have been one of the most important contributions to the

Why This Matters Bayesian networks have been one of the most important contributions to the

Why This Matters Bayesian networks have been one of the most important contributions to the field of CS 331: Artificial Intelligence AI in the last 10-20 years Bayesian Networks Provide a way to represent knowledge in an uncertain

114 views • 7 slides
Bayesian Neural Networks - Presenters Group 1: A Practical Bayesian Framework for Backpropagation

Bayesian Neural Networks - Presenters Group 1: A Practical Bayesian Framework for Backpropagation

Bayesian Neural Networks - Presenters Group 1: A Practical Bayesian Framework for Backpropagation Networks - Slides 2-40 Paul Vicol Shane Baccas George Alexandru Adam Group 2: Priors for Infinite Networks - Slides 41-64

1.37k views • 110 slides
Bioinformatics: Network Analysis Probabilistic Modeling: Bayesian Networks COMP 572 (BIOS 572 /

Bioinformatics: Network Analysis Probabilistic Modeling: Bayesian Networks COMP 572 (BIOS 572 /

Bioinformatics: Network Analysis Probabilistic Modeling: Bayesian Networks COMP 572 (BIOS 572 / BIOE 564) - Fall 2013 Luay Nakhleh, Rice University 1 Bayesian Networks Bayesian networks are probabilistic descriptions of the regulatory

471 views • 36 slides
Chapter14 Probabilistic Reasoning (Bayesian Networks) Sec. 1 - 2 20070607 Chap14 1

Chapter14 Probabilistic Reasoning (Bayesian Networks) Sec. 1 - 2 20070607 Chap14 1

Outline Syntax Semantics Chapter14 Probabilistic Reasoning (Bayesian Networks) Sec. 1 - 2 20070607 Chap14 1 20070607 Chap14 2 Bayesian networks Bayesian networks (cont.) Syntax: Bayesian Networks also called

424 views • 4 slides
Lecture 6: Examples of Bayesian Networks and Markov Networks Zhenke Wu Department of

Lecture 6: Examples of Bayesian Networks and Markov Networks Zhenke Wu Department of

Lecture 6: Examples of Bayesian Networks and Markov Networks Zhenke Wu Department of Biostatistics, University of Michigan September 22, 2016 Lecture 5 Main Points Once Again Bayesian network ( ) , P - Directed acyclic graph (DAG):

476 views • 14 slides
Bayesian Methods for Neural Networks Readings: Bishop, Neural Networks for Pattern Recognition .

Bayesian Methods for Neural Networks Readings: Bishop, Neural Networks for Pattern Recognition .

Bayesian Methods for Neural Networks Readings: Bishop, Neural Networks for Pattern Recognition . Chapter 10. Aaron Courville Bayesian Methods for Neural Networks p.1/29 Bayesian Inference Weve seen Bayesian inference before, remember

542 views • 29 slides
AND MACHINE LEARNING CHAPTER 8: GRAPHICAL MODELS Bayesian Networks Directed Acyclic Graph (DAG)

AND MACHINE LEARNING CHAPTER 8: GRAPHICAL MODELS Bayesian Networks Directed Acyclic Graph (DAG)

PATTERN RECOGNITION AND MACHINE LEARNING CHAPTER 8: GRAPHICAL MODELS Bayesian Networks Directed Acyclic Graph (DAG) Bayesian Networks General Factorization Bayesian Curve Fitting (1) Polynomial Bayesian Curve Fitting (2) Plate Bayesian

846 views • 71 slides
Modelling Survey Data with Bayesian Networks Marco Scutari scutari@stats.ox.ac.uk Department of

Modelling Survey Data with Bayesian Networks Marco Scutari scutari@stats.ox.ac.uk Department of

Modelling Survey Data with Bayesian Networks Marco Scutari scutari@stats.ox.ac.uk Department of Statistics University of Oxford May 18, 2015 Bayesian Networks Bayesian networks (BNs) [6, 13] are defined by: a network structure, a directed

505 views • 27 slides
Bayesian Networks Li Xiong Slide credits: Page (Wisconsin) CS760 , Zhu (Wisconsin) KDD 12

Bayesian Networks Li Xiong Slide credits: Page (Wisconsin) CS760 , Zhu (Wisconsin) KDD 12

Probabilistic Graphical Models: Bayesian Networks Li Xiong Slide credits: Page (Wisconsin) CS760 , Zhu (Wisconsin) KDD 12 tutorial Outline Graphical models Bayesian networks - definition Bayesian networks - inference Bayesian

916 views • 87 slides
Probabilistic Graphical Models Lecture 5 Bayesian Learning of Bayesian Networks CS/CNS/EE

Probabilistic Graphical Models Lecture 5 Bayesian Learning of Bayesian Networks CS/CNS/EE

Probabilistic Graphical Models Lecture 5 Bayesian Learning of Bayesian Networks CS/CNS/EE 155 Andreas Krause Announcements Recitations: Every Tuesday 4-5:30 in 243 Annenberg Homework 1 out. Due in class Wed Oct 21 Project proposals due

521 views • 41 slides
Bayesian Networks Part 1 CS 760@UW-Madison Goals for the lecture you should understand the

Bayesian Networks Part 1 CS 760@UW-Madison Goals for the lecture you should understand the

Bayesian Networks Part 1 CS 760@UW-Madison Goals for the lecture you should understand the following concepts the Bayesian network representation inference by enumeration Introduce the learning tasks for Bayes nets Bayesian

541 views • 29 slides
Causal Modelling Using Bayesian Networks Outline Methodology:

Causal Modelling Using Bayesian Networks Outline Methodology:

www.eecs.qmul.ac.uk Causal Modelling Using Bayesian Networks Outline Methodology: Bayesian Networks Challenges for Useful Decision Support Trauma Models:

283 views • 26 slides
Graphical Models and Bayesian Networks Required reading: Ghahramani, section 2, Learning

Graphical Models and Bayesian Networks Required reading: Ghahramani, section 2, Learning

Graphical Models and Bayesian Networks Required reading: Ghahramani, section 2, Learning Dynamic Bayesian Networks (just 3.5 pages :-) Optional reading: Mitchell, chapter 6.11 Bayesian Belief Networks Machine Learning 10-701

548 views • 11 slides
Bayesian networks Compact representa)on of distribu)ons over large

Bayesian networks Compact representa)on of distribu)ons over large

Introduc)on to Ar)ficial Intelligence Lecture 13 Approximate Inference CS/CNS/EE 154 Andreas Krause TexPoint fonts used in EMF. Bayesian networks

744 views • 31 slides
CSE 473: Artificial Intelligence Bayesian Networks: Inference Hanna Hajishirzi Many slides over

CSE 473: Artificial Intelligence Bayesian Networks: Inference Hanna Hajishirzi Many slides over

CSE 473: Artificial Intelligence Bayesian Networks: Inference Hanna Hajishirzi Many slides over the course adapted from either Luke Zettlemoyer, Pieter Abbeel, Dan Klein, Stuart Russell or Andrew Moore 1 Outline Bayesian Networks

539 views • 24 slides

More recommend