markov chain usage models and concurrency
play

Markov Chain Usage Models and Concurrency Stacy Prowell - PowerPoint PPT Presentation

Aug 05, 2023 •219 likes •546 views

Quick Overview Testing Complex Systems Summary Markov Chain Usage Models and Concurrency Stacy Prowell sprowell@cs.utk.edu January 2005 SQRL: Prowell MBT: Testing Complex Systems Quick Overview Testing Complex Systems Summary Online

  1. Quick Overview Testing Complex Systems Summary Markov Chain Usage Models and Concurrency Stacy Prowell sprowell@cs.utk.edu January 2005 SQRL: Prowell MBT: Testing Complex Systems

  2. Quick Overview Testing Complex Systems Summary Online Software Quality Research Laboratory http://www.cs.utk.edu/sqrl/ Markov Chain Usage Models http://www.cs.utk.edu/~sprowell/markov.html SQRL: Prowell MBT: Testing Complex Systems

  3. Testing as a Statistical Experiment Quick Overview Simple Markov Chain Models Testing Complex Systems What are they good for? Summary Tools Outline 1 Quick Overview Testing as a Statistical Experiment Simple Markov Chain Models What are they good for? Tools 2 Testing Complex Systems Concurrency Combining Tests TGL Synchronization SQRL: Prowell MBT: Testing Complex Systems

  4. Testing as a Statistical Experiment Quick Overview Simple Markov Chain Models Testing Complex Systems What are they good for? Summary Tools Objective Usage Based Testing The objective should not be simply “to find bugs,” because bugs are not equal. A better objective is give sufficient confidence that software release will not be harmful . Bugs to find are the ones which (1) occur most frequently in field use and (2) are most serious by some measure. To meet (1), bias testing toward expected use. To meet (2), bias testing toward critical functionality in the context of expected use . SQRL: Prowell MBT: Testing Complex Systems

  5. Testing as a Statistical Experiment Quick Overview Simple Markov Chain Models Testing Complex Systems What are they good for? Summary Tools Testing is Sampling For most software, there is an infinite number of tests (all sequences of inputs: S ∗ ). Only a finite sample of these can be run. How should the sample be selected ? What should we infer from the sample? This is a statistical experiment . SQRL: Prowell MBT: Testing Complex Systems

  6. Testing as a Statistical Experiment Quick Overview Simple Markov Chain Models Testing Complex Systems What are they good for? Summary Tools Testing is Sampling For most software, there is an infinite number of tests (all sequences of inputs: S ∗ ). Only a finite sample of these can be run. How should the sample be selected ? What should we infer from the sample? This is a statistical experiment . SQRL: Prowell MBT: Testing Complex Systems

  7. Testing as a Statistical Experiment Quick Overview Simple Markov Chain Models Testing Complex Systems What are they good for? Summary Tools Testing is Sampling For most software, there is an infinite number of tests (all sequences of inputs: S ∗ ). Only a finite sample of these can be run. How should the sample be selected ? What should we infer from the sample? This is a statistical experiment . SQRL: Prowell MBT: Testing Complex Systems

  8. Testing as a Statistical Experiment Quick Overview Simple Markov Chain Models Testing Complex Systems What are they good for? Summary Tools Testing is Sampling For most software, there is an infinite number of tests (all sequences of inputs: S ∗ ). Only a finite sample of these can be run. How should the sample be selected ? What should we infer from the sample? This is a statistical experiment . SQRL: Prowell MBT: Testing Complex Systems

  9. Testing as a Statistical Experiment Quick Overview Simple Markov Chain Models Testing Complex Systems What are they good for? Summary Tools Testing is Sampling For most software, there is an infinite number of tests (all sequences of inputs: S ∗ ). Only a finite sample of these can be run. How should the sample be selected ? What should we infer from the sample? This is a statistical experiment . SQRL: Prowell MBT: Testing Complex Systems

  10. Testing as a Statistical Experiment Quick Overview Simple Markov Chain Models Testing Complex Systems What are they good for? Summary Tools Statistics “In a metrics mentality , the goal is to find quantities that can be calculated easily. This metrics mentality leads to the calculation of meaningless quantities. The user thinks he has useful information, but is mistaken. A statistical mentality defines parameters, collects data, and applies statistical procedures using the data to estimate parameters. The results are meaningful, useful estimates.” - John Healy SQRL: Prowell MBT: Testing Complex Systems

  11. Testing as a Statistical Experiment Quick Overview Simple Markov Chain Models Testing Complex Systems What are they good for? Summary Tools Markov Chains Test Cases Test cases are sequences of events. Possible next events depend on history . The event selection is stochastic . Finite Markov Chains Familiar model; states and arcs. Many tools support creating digraphs and statecharts. Nice graphical representation. Well-studied; nearly any result is computable . “All models are wrong, but some are useful .” - George Box SQRL: Prowell MBT: Testing Complex Systems

  12. Testing as a Statistical Experiment Quick Overview Simple Markov Chain Models Testing Complex Systems What are they good for? Summary Tools Markov Chains Test Cases Test cases are sequences of events. Possible next events depend on history . The event selection is stochastic . Finite Markov Chains Familiar model; states and arcs. Many tools support creating digraphs and statecharts. Nice graphical representation. Well-studied; nearly any result is computable . “All models are wrong, but some are useful .” - George Box SQRL: Prowell MBT: Testing Complex Systems

  13. Testing as a Statistical Experiment Quick Overview Simple Markov Chain Models Testing Complex Systems What are they good for? Summary Tools Simple Markov Chain Models Ringing incoming call disconnect (0.5) (0.5) On Hook Arcs are labeled with usage events. lift receiver (0.5) Nodes are “states lift receiver Off Hook (0.5) of use” which dial good dial busy dial bad provide correct (0.25) (0.25) (0.25) disconnect sequencing. Ring Tone (0.5) Probabilities are hang up connect Busy Tone Error Tone (0.25) (0.5) based on known hang up hang up hang up Connected (0.5) (1.0) (1.0) or anticipated use. hang up (0.5) Exit SQRL: Prowell MBT: Testing Complex Systems

  14. Testing as a Statistical Experiment Quick Overview Simple Markov Chain Models Testing Complex Systems What are they good for? Summary Tools What Can You Do With Them? Generate Tests Random walk; generate tests in order by probability. Weighted generation; generate tests in order by weight (for example, most probable tests). Coverage set; use postman algorithm to generate minimum coverage set for baseline test. All can be automated . Compute Statistics Static analysis of model; based on assumptions, what does use look like? Analysis of test results; what is expected reliability of delivered system and when is testing adequate? SQRL: Prowell MBT: Testing Complex Systems

  15. Testing as a Statistical Experiment Quick Overview Simple Markov Chain Models Testing Complex Systems What are they good for? Summary Tools What Can You Do With Them? Generate Tests Random walk; generate tests in order by probability. Weighted generation; generate tests in order by weight (for example, most probable tests). Coverage set; use postman algorithm to generate minimum coverage set for baseline test. All can be automated . Compute Statistics Static analysis of model; based on assumptions, what does use look like? Analysis of test results; what is expected reliability of delivered system and when is testing adequate? SQRL: Prowell MBT: Testing Complex Systems

  16. Testing as a Statistical Experiment Quick Overview Simple Markov Chain Models Testing Complex Systems What are they good for? Summary Tools Tools Third Generation J Usage Model Builder Library ( JUMBL ) developed in Java at UT starting in 1999. Piloted many new ideas (weighted generation, new notations, new computations and reliability models, faster algorithms). Several usability and performance enhancements driven by industrial application. Standard interchange formats ( XML ) for models ( MML / EMML ), test records ( TCML ), test generation ( TGL ). Version 4 currently available. SQRL: Prowell MBT: Testing Complex Systems

  17. Concurrency Quick Overview Combining Tests Testing Complex Systems TGL Summary Synchronization Outline 1 Quick Overview Testing as a Statistical Experiment Simple Markov Chain Models What are they good for? Tools 2 Testing Complex Systems Concurrency Combining Tests TGL Synchronization SQRL: Prowell MBT: Testing Complex Systems

  18. Concurrency Quick Overview Combining Tests Testing Complex Systems TGL Summary Synchronization Concurrency Network components: multiple streams of inputs. Invent strong abstractions to address this: all, some, none. Example All phones on hook. Some of the phones go off hook. Now some phones are on hook and some are off hook. Hard to translate into executable test cases. SQRL: Prowell MBT: Testing Complex Systems

  19. Concurrency Quick Overview Combining Tests Testing Complex Systems TGL Summary Synchronization Concurrency Network components: multiple streams of inputs. Invent strong abstractions to address this: all, some, none. Example All phones on hook. Some of the phones go off hook. Now some phones are on hook and some are off hook. Hard to translate into executable test cases. SQRL: Prowell MBT: Testing Complex Systems

Recommend

1 X 1 X 2 X 3 Ghostbusters HMM Chain Rule and HMMs E 1 E 2 E 3 P(X 1 ) = uniform 1/9 1/9

1 X 1 X 2 X 3 Ghostbusters HMM Chain Rule and HMMs E 1 E 2 E 3 P(X 1 ) = uniform 1/9 1/9

Hidden Markov Models 1 Hidden Markov Models Markov chains not so useful for most agents Need observations to update your beliefs Hidden Markov models (HMMs) Underlying Markov chain over states X You observe outputs (effects) at

617 views • 7 slides
Democracy and the role of minorities in Markov chain models Non-reversible perturbations of

Democracy and the role of minorities in Markov chain models Non-reversible perturbations of

Democracy and the role of minorities in Markov chain models Non-reversible perturbations of Markov chains models Fabio Fagnani, Politecnico di Torino joint work with Giacomo Como, Lund University Lund, 19-10-2012 Perturbation of dynamical

379 views • 34 slides
Probabilistic Graphical Models Probabilistic Graphical Models Markov Chain Monte Carlo Inference

Probabilistic Graphical Models Probabilistic Graphical Models Markov Chain Monte Carlo Inference

Probabilistic Graphical Models Probabilistic Graphical Models Markov Chain Monte Carlo Inference Fall 2019 Siamak Ravanbakhsh Learning objectives Learning objectives Markov chains the idea behind Markov Chain Monte Carlo (MCMC) two

1.03k views • 71 slides
Applications of Markov Chains Markov Chain Definition Three key components (and one

Applications of Markov Chains Markov Chain Definition Three key components (and one

Applications of Markov Chains Markov Chain Definition Three key components (and one assumption): I Models systems of states and transitions I Set S of States Intro to Markov Chains a graph I PageRank Googles search algorithm.

68 views • 4 slides
CSE P 590 A Markov Models and Hidden Markov Models

CSE P 590 A Markov Models and Hidden Markov Models

CSE P 590 A Markov Models and Hidden Markov Models http://upload.wikimedia.org/wikipedia/commons/b/ba/Calico_cat Dosage Compensation Reminder: Proteins Read DNA and X-Inactivation E.g.: 2 copies (mom/dad) of each

1.28k views • 21 slides
Continuous Time Markov Chain Birth and Death Process IE 502: Probabilistic Models Jayendran

Continuous Time Markov Chain Birth and Death Process IE 502: Probabilistic Models Jayendran

Continuous Time Markov Chain Birth and Death Process IE 502: Probabilistic Models Jayendran Venkateswaran IE & OR Continuous Time Markov Chain { X ( t ), t 0} is a Continuous Time Markov Chain if, for all s , t 0 and for all i ,

258 views • 11 slides
Distributed Markov chain Monte Carlo Lawrence Murray CSIRO Mathematics, Informatics and

Distributed Markov chain Monte Carlo Lawrence Murray CSIRO Mathematics, Informatics and

Distributed Markov chain Monte Carlo Lawrence Murray CSIRO Mathematics, Informatics and Statistics Motivation Bayesian inference in environmental models. Particle Markov chain Monte Carlo (PMCMC): state-space model,

355 views • 7 slides
Metastates in Markov chain driven mean-field models Praha 1 September 2011 Metastates in random

Metastates in Markov chain driven mean-field models Praha 1 September 2011 Metastates in random

Christof K ulske Metastates in Markov chain driven mean-field models Praha 1 September 2011 Metastates in random spin models Lattice spin models with a quenched random Hamiltonian, examples Edwards-Anderson spinglass H = J i,j i

803 views • 25 slides
CSE 527 " Markov Models and Hidden Markov Models !

CSE 527 " Markov Models and Hidden Markov Models !

CSE 527 " Markov Models and Hidden Markov Models ! http://upload.wikimedia.org/wikipedia/commons/b/ba/Calico_cat ! Dosage Compensation Reminder: Proteins Read DNA ! and X-Inactivation ! E.g.: ! 2 copies (mom/dad) of each chromosome

770 views • 17 slides
CSE 427 Markov Models and Hidden Markov Models 2

CSE 427 Markov Models and Hidden Markov Models 2

CSE 427 Markov Models and Hidden Markov Models 2 http://upload.wikimedia.org/wikipedia/commons/b/ba/Calico_cat Dosage Compensation and X-Inactivation 2 copies (mom/dad) of each chromosome 1-23 Mostly, both copies of each gene are

1.07k views • 60 slides
CSE P 527 Markov Models and Hidden Markov Models 1 2

CSE P 527 Markov Models and Hidden Markov Models 1 2

CSE P 527 Markov Models and Hidden Markov Models 1 2 http://upload.wikimedia.org/wikipedia/commons/b/ba/Calico_cat Dosage Compensation and X-Inactivation 2 copies (mom/dad) of each chromosome 1-23 Mostly, both copies of each gene are

970 views • 66 slides
Probabilistic Graphical Models Lecture 17: Markov chain Monte Carlo Andrew Gordon Wilson

Probabilistic Graphical Models Lecture 17: Markov chain Monte Carlo Andrew Gordon Wilson

Probabilistic Graphical Models Lecture 17: Markov chain Monte Carlo Andrew Gordon Wilson www.cs.cmu.edu/~andrewgw Carnegie Mellon University March 18, 2015 1 / 45 Resources and Attribution Image credits, inspiration, pointers for further

1.15k views • 45 slides
BAYESIAN CALIBRATION OF COMPUTER MODELS Bayesian inference & Markov chain Monte Carlo

BAYESIAN CALIBRATION OF COMPUTER MODELS Bayesian inference & Markov chain Monte Carlo

BAYESIAN CALIBRATION OF COMPUTER MODELS Bayesian inference & Markov chain Monte Carlo Gaussian processes, Computer model calibration and prediction Dave Higdon, Virginia Tech, Brian Williams & Jim Gattiker Statistical Sciences Group,

1.52k views • 133 slides
Graphical Models CS 6355: Structured Prediction 1 So far We discussed sequence labeling

Graphical Models CS 6355: Structured Prediction 1 So far We discussed sequence labeling

Graphical Models CS 6355: Structured Prediction 1 So far We discussed sequence labeling tasks: HMM: Hidden Markov Models MEMM: Maximum Entropy Markov Models CRF: Conditional Random Fields All these models use a linear chain

744 views • 52 slides
Markov chains and Hidden Markov Models 9000 Markov chains and HMMs We will discuss: Markov

Markov chains and Hidden Markov Models 9000 Markov chains and HMMs We will discuss: Markov

Markov chains and Hidden Markov Models 9000 Markov chains and HMMs We will discuss: Markov chains Hidden Markov Models (HMMs) Algorithms: Viterbi, forward, backward, posterior decoding Profile HMMs Baum-Welch algorithm 9001

1.16k views • 87 slides
Non-Homogeneous Hidden Markov Chain Models for Wavelet-Based Hyperspectral Image Processing

Non-Homogeneous Hidden Markov Chain Models for Wavelet-Based Hyperspectral Image Processing

Non-Homogeneous Hidden Markov Chain Models for Wavelet-Based Hyperspectral Image Processing Marco F. Duarte Mario Parente Hyperspectral Imaging One signal/image per band Hyperspectral datacube Spectrum at each pixel represents

415 views • 27 slides
Multilevel Monte Carlo for the continuous time Markov chain models arising in biology David F.

Multilevel Monte Carlo for the continuous time Markov chain models arising in biology David F.

Multilevel Monte Carlo for the continuous time Markov chain models arising in biology David F. Anderson anderson@math.wisc.edu Department of Mathematics University of Wisconsin - Madison Work is joint with Des Higham MCQMC 2012

824 views • 35 slides
CSE 527 Lectures 11-12 Markov Models and Hidden Markov Models DNA Methylation CH 3 CpG - 2

CSE 527 Lectures 11-12 Markov Models and Hidden Markov Models DNA Methylation CH 3 CpG - 2

CSE 527 Lectures 11-12 Markov Models and Hidden Markov Models DNA Methylation CH 3 CpG - 2 adjacent nts, same strand (not Watson-Crick pair; p mnemonic for the phosphodiester bond of the DNA backbone) C of CpG is often (70-80%)

780 views • 55 slides
CSE 527 Lectures 12-13 Markov Models and Hidden Markov Models DNA Methylation CH 3 CpG - 2

CSE 527 Lectures 12-13 Markov Models and Hidden Markov Models DNA Methylation CH 3 CpG - 2

CSE 527 Lectures 12-13 Markov Models and Hidden Markov Models DNA Methylation CH 3 CpG - 2 adjacent nts, same strand (not Watson-Crick pair; p mnemonic for the phosphodiester bond of the DNA backbone) C of CpG is often (70-80%)

690 views • 55 slides
HMM Review Lecture Outline 1. Markov models 2. Hidden Markov

HMM Review Lecture Outline 1. Markov models 2. Hidden Markov

HMM Review Lecture Outline 1. Markov models 2. Hidden Markov models 3. Viterbi algorithm MARKOV MODELS One View of Text Sequence of symbols (bytes,

489 views • 46 slides
Some Definition and Example of Markov Chain Bowen Dai The Ohio State University April 5 th 2016

Some Definition and Example of Markov Chain Bowen Dai The Ohio State University April 5 th 2016

Some Definition and Example of Markov Chain Bowen Dai The Ohio State University April 5 th 2016 Introduction Definition and Notation Simple example of Markov Chain Aim Have some taste of Markov Chain and how it relate to some

658 views • 16 slides
Markov Chain Monte Carlo Methods Michel Bierlaire michel.bierlaire@epfl.ch Transport and

Markov Chain Monte Carlo Methods Michel Bierlaire michel.bierlaire@epfl.ch Transport and

Markov Chain Monte Carlo Methods Michel Bierlaire michel.bierlaire@epfl.ch Transport and Mobility Laboratory Markov Chain Monte Carlo Methods p. 1/36 Markov Chains Andrey Markov, 18561922, Russian mathematician. Markov Chain Monte

570 views • 36 slides
The biggest Markov chain in the world Randys web-surfing behavior: From whatever page hes

The biggest Markov chain in the world Randys web-surfing behavior: From whatever page hes

The biggest Markov chain in the world Randys web-surfing behavior: From whatever page hes viewing, he selects one of the links uniformly at random and follows it. Defines a Markov chain in which the states are web pages. Idea: Suppose this

826 views • 30 slides
Markov Chains and Hidden Markov Models COMP 571 Luay Nakhleh, Rice University Markov Chains and

Markov Chains and Hidden Markov Models COMP 571 Luay Nakhleh, Rice University Markov Chains and

Markov Chains and Hidden Markov Models COMP 571 Luay Nakhleh, Rice University Markov Chains and Hidden Markov Models Modeling the statistical properties of biological sequences and distinguishing regions based on these models For the

1.33k views • 96 slides

More recommend