accuracy of markov state models msms and hidden markov
play

Accuracy of Markov State Models (MSMs) and Hidden Markov Models - PowerPoint PPT Presentation

Jan 31, 2024 •38 likes •218 views

Accuracy of Markov State Models (MSMs) and Hidden Markov Models (HMMs) Frank No (FU Berlin) frank.noe@fu-berlin.de Discretization Backward propagator Spectral decomposition Processes: Eigenvalues / timescales i-1 Prinz et al, JCP 134 ,

  1. Accuracy of Markov State Models (MSMs) and Hidden Markov Models (HMMs) Frank Noé (FU Berlin) frank.noe@fu-berlin.de

  2. Discretization Backward propagator Spectral decomposition Processes: Eigenvalues / timescales κ i-1 Prinz et al, JCP 134 , 174105 (2011)

  3. Discretization Prinz et al, JCP 134 , 174105 (2011)

  4. Two flavors of discretization errors Projection error

  6. Hidden Markov Model

  7. Hidden Markov Model

  8. Hidden Markov Model

  9. Hidden Markov Model

  10. Case 1: coarse discretization

  11. Case 1: coarse discretization MSM: Implied timescales

  12. Case 1: coarse discretization MSM: Chapman-Kolmogorov Test

  13. Case 1: coarse discretization HMM: Implied timescales

  14. Case 1: coarse discretization HMM: Chapman-Kolmogorov Test

  15. Case 1: coarse discretization Why does the HMM work better than the MSM? MSM at lag 40: HMM at lag 40:

  16. Case 2: bad projection Probability density Energy surface Brownian dynamics simulation

  18. Acknowledgements Funding Positions available Collaborations frank.noe@fu-berlin.de Funding Cecilia Clementi (Rice) Christof Schütte (FU Berlin) Vijay Pande (Stanford) Eric Vanden-Eijnden (Courant Institut NY) Katja, Faelber, Oliver Daumke (MDC) Thomas Weikl (MPI Potsdam) John Chodera (MSKCC NY) Marcus Sauer, Sören Doose (Uni Würzburg) Gianni de Fabritiis (Barcelona)

Recommend

Markov Models Kunsch, H.R., State Space and Hidden Markov Models . ETH- Zurich, Zurich;

Markov Models Kunsch, H.R., State Space and Hidden Markov Models . ETH- Zurich, Zurich;

State Space and Hidden Markov Models Kunsch, H.R., State Space and Hidden Markov Models . ETH- Zurich, Zurich; Aliaksandr Hubin Oslo 2014 Contents 1. Introduction 2. Markov Chains 3. Hidden Markov and State Space Model 4. Filtering and

853 views • 37 slides
1 X 1 X 2 X 3 Ghostbusters HMM Chain Rule and HMMs E 1 E 2 E 3 P(X 1 ) = uniform 1/9 1/9

1 X 1 X 2 X 3 Ghostbusters HMM Chain Rule and HMMs E 1 E 2 E 3 P(X 1 ) = uniform 1/9 1/9

Hidden Markov Models 1 Hidden Markov Models Markov chains not so useful for most agents Need observations to update your beliefs Hidden Markov models (HMMs) Underlying Markov chain over states X You observe outputs (effects) at

617 views • 7 slides
CSE P 590 A Markov Models and Hidden Markov Models

CSE P 590 A Markov Models and Hidden Markov Models

CSE P 590 A Markov Models and Hidden Markov Models http://upload.wikimedia.org/wikipedia/commons/b/ba/Calico_cat Dosage Compensation Reminder: Proteins Read DNA and X-Inactivation E.g.: 2 copies (mom/dad) of each

1.28k views • 21 slides
A C Standard model has 1-1 correspondence between symbols and states, P(A | T) thus P ( x i

A C Standard model has 1-1 correspondence between symbols and states, P(A | T) thus P ( x i

Outline Markov chains CSCE 471/871 Lecture 3: Markov Chains and Hidden Markov Models Hidden Markov models (HMMs) Formal definition Finding most probable state path (Viterbi algorithm) Stephen D. Scott Forward and backward

640 views • 5 slides
Markov chains and Hidden Markov Models 9000 Markov chains and HMMs We will discuss: Markov

Markov chains and Hidden Markov Models 9000 Markov chains and HMMs We will discuss: Markov

Markov chains and Hidden Markov Models 9000 Markov chains and HMMs We will discuss: Markov chains Hidden Markov Models (HMMs) Algorithms: Viterbi, forward, backward, posterior decoding Profile HMMs Baum-Welch algorithm 9001

1.16k views • 87 slides
Hidden Markov Models Pratik Lahiri Introduction A hidden Markov model (HMM) is a

Hidden Markov Models Pratik Lahiri Introduction A hidden Markov model (HMM) is a

Hidden Markov Models Pratik Lahiri Introduction A hidden Markov model (HMM) is a statistical Markov model in which the system being modeled is assumed to be a Markov process with unobserved (hidden) states. We call the observed event

741 views • 13 slides
CSE 527 " Markov Models and Hidden Markov Models !

CSE 527 " Markov Models and Hidden Markov Models !

CSE 527 " Markov Models and Hidden Markov Models ! http://upload.wikimedia.org/wikipedia/commons/b/ba/Calico_cat ! Dosage Compensation Reminder: Proteins Read DNA ! and X-Inactivation ! E.g.: ! 2 copies (mom/dad) of each chromosome

770 views • 17 slides
CSE P 527 Markov Models and Hidden Markov Models 1 2

CSE P 527 Markov Models and Hidden Markov Models 1 2

CSE P 527 Markov Models and Hidden Markov Models 1 2 http://upload.wikimedia.org/wikipedia/commons/b/ba/Calico_cat Dosage Compensation and X-Inactivation 2 copies (mom/dad) of each chromosome 1-23 Mostly, both copies of each gene are

970 views • 66 slides
CSE 427 Markov Models and Hidden Markov Models 2

CSE 427 Markov Models and Hidden Markov Models 2

CSE 427 Markov Models and Hidden Markov Models 2 http://upload.wikimedia.org/wikipedia/commons/b/ba/Calico_cat Dosage Compensation and X-Inactivation 2 copies (mom/dad) of each chromosome 1-23 Mostly, both copies of each gene are

1.07k views • 60 slides
1 Real HMM Examples Real HMM Examples Speech recognition HMMs: Machine translation HMMs:

1 Real HMM Examples Real HMM Examples Speech recognition HMMs: Machine translation HMMs:

Hidden Markov Models CSE 473: Artificial Intelligence Markov chains not so useful for most agents Hidden Markov Models Eventually you dont know anything anymore Need observations to update your beliefs Hidden Markov models

567 views • 9 slides
Hidden Markov Models Markov Model (Finite State Machine with Probs) Modeling a sequence of

Hidden Markov Models Markov Model (Finite State Machine with Probs) Modeling a sequence of

Hidden Markov Models Markov Model (Finite State Machine with Probs) Modeling a sequence of weather observations Hidden Markov Models Assume the states in the machine are not observed and we can observe some output at certain states. Hidden

692 views • 26 slides
Markov Chains and Hidden Markov Models COMP 571 Luay Nakhleh, Rice University Markov Chains and

Markov Chains and Hidden Markov Models COMP 571 Luay Nakhleh, Rice University Markov Chains and

Markov Chains and Hidden Markov Models COMP 571 Luay Nakhleh, Rice University Markov Chains and Hidden Markov Models Modeling the statistical properties of biological sequences and distinguishing regions based on these models For the

1.33k views • 96 slides
Markov Chains and Hidden Markov Models COMP 571 Luay Nakhleh, Rice University 2 Markov Chains

Markov Chains and Hidden Markov Models COMP 571 Luay Nakhleh, Rice University 2 Markov Chains

1 Markov Chains and Hidden Markov Models COMP 571 Luay Nakhleh, Rice University 2 Markov Chains and Hidden Markov Models Modeling the statistical properties of biological sequences and distinguishing regions based on these models For the

437 views • 32 slides
1 Real HMM Examples Real HMM Examples Speech recognition HMMs: Machine translation HMMs:

1 Real HMM Examples Real HMM Examples Speech recognition HMMs: Machine translation HMMs:

Hidden Markov Models CSE 473: Artificial Intelligence Hidden Markov Models Markov chains not so useful for most agents Eventually you dont know anything anymore Need observations to update your beliefs Hidden Markov models (HMMs)

253 views • 7 slides
CSE 527 Lectures 11-12 Markov Models and Hidden Markov Models DNA Methylation CH 3 CpG - 2

CSE 527 Lectures 11-12 Markov Models and Hidden Markov Models DNA Methylation CH 3 CpG - 2

CSE 527 Lectures 11-12 Markov Models and Hidden Markov Models DNA Methylation CH 3 CpG - 2 adjacent nts, same strand (not Watson-Crick pair; p mnemonic for the phosphodiester bond of the DNA backbone) C of CpG is often (70-80%)

780 views • 55 slides
CSE 527 Lectures 12-13 Markov Models and Hidden Markov Models DNA Methylation CH 3 CpG - 2

CSE 527 Lectures 12-13 Markov Models and Hidden Markov Models DNA Methylation CH 3 CpG - 2

CSE 527 Lectures 12-13 Markov Models and Hidden Markov Models DNA Methylation CH 3 CpG - 2 adjacent nts, same strand (not Watson-Crick pair; p mnemonic for the phosphodiester bond of the DNA backbone) C of CpG is often (70-80%)

690 views • 55 slides
HMM Review Lecture Outline 1. Markov models 2. Hidden Markov

HMM Review Lecture Outline 1. Markov models 2. Hidden Markov

HMM Review Lecture Outline 1. Markov models 2. Hidden Markov models 3. Viterbi algorithm MARKOV MODELS One View of Text Sequence of symbols (bytes,

489 views • 46 slides
Introduction to Hidden Markov Models Antonio Art es-Rodr guez Unviersidad Carlos III de

Introduction to Hidden Markov Models Antonio Art es-Rodr guez Unviersidad Carlos III de

Introduction to Hidden Markov Models Antonio Art es-Rodr guez Unviersidad Carlos III de Madrid 2nd MLPM SS, September 17, 2014 1/33 Outline Markov and Hidden Markov Models Markov processes Definition of a HMM Applications of HMMs

940 views • 37 slides
Markov Systems, Markov Decision Processes, and Dynamic Programming Andrew W. Moore Note to

Markov Systems, Markov Decision Processes, and Dynamic Programming Andrew W. Moore Note to

Artificial Intelligence 15-381 April 5, 2007 Sequential Decision Problems & Markov Decision Processes Recap of last lecture Reasoning over time - Markov Processes - Hidden Markov Models - modeling state transitions - probability of

321 views • 16 slides
Markov Chains and Hidden Markov Models COMP 571 - Spring 2015 Luay Nakhleh, Rice University

Markov Chains and Hidden Markov Models COMP 571 - Spring 2015 Luay Nakhleh, Rice University

Markov Chains and Hidden Markov Models COMP 571 - Spring 2015 Luay Nakhleh, Rice University Markov Chains and Hidden Markov Models Modeling the statistical properties of biological sequences and distinguishing regions based on these models

873 views • 58 slides
CSE 427 Markov Models and Hidden Markov Models How Proteins Read DNA E.g.:

CSE 427 Markov Models and Hidden Markov Models How Proteins Read DNA E.g.:

CSE 427 Markov Models and Hidden Markov Models How Proteins Read DNA E.g.: Helix-Turn-Helix Motif Leucine Zipper Motif Down in the Groove Different patterns of hydrophobic methyls, potential H bonds, etc. at edges of different

877 views • 58 slides
Markov Models and Hidden Markov Models Robert Platt Northeastern University Some images and

Markov Models and Hidden Markov Models Robert Platt Northeastern University Some images and

Markov Models and Hidden Markov Models Robert Platt Northeastern University Some images and slides are used from: 1. CS188 UC Berkeley 2. RN, AIMA Markov Models We have already seen that an MDP provides a useful framework for modeling

846 views • 62 slides
Markov Models and Hidden Markov Models Robert Platt Northeastern University Some images and

Markov Models and Hidden Markov Models Robert Platt Northeastern University Some images and

Markov Models and Hidden Markov Models Robert Platt Northeastern University Some images and slides are used from: 1. CS188 UC Berkeley 2. RN, AIMA Markov Models We have already seen that an MDP provides a useful framework for modeling

1k views • 69 slides
Hidden Markov Models (Ch. 15) Announcements Homework 2 posted Programing: -Python (preferred)

Hidden Markov Models (Ch. 15) Announcements Homework 2 posted Programing: -Python (preferred)

Hidden Markov Models (Ch. 15) Announcements Homework 2 posted Programing: -Python (preferred) -Java -Matlab Markov... chains? Recap, Markov property: (Next state only depends on current state) pick B pick C c c c a a a b d

539 views • 25 slides

More recommend