feb 20 bayes rule expectation and variance how we design
play

Feb 20: Bayes' Rule, Expectation and Variance How we design this - PowerPoint PPT Presentation

May 19, 2023 •275 likes •482 views

Feb 20: Bayes' Rule, Expectation and Variance How we design this course 1. Learning goals 2. Homework that tests learning goals 3. Lectures and sessions that provide tools to do homework that tests learning goals if something seems hard,

  1. Feb 20: Bayes' Rule, Expectation and Variance

  2. How we design this course 1. Learning goals 2. Homework that tests learning goals 3. Lectures and sessions that provide tools to do homework that tests learning goals if something seems hard, look for the hidden clues! Source: Nintendo, shacknews.com

  3. How to stay out of trouble on homework Integrity: ... You may discuss homework problems, but you have to write your own answers by yourself. You may consult online forums or look at examples, but you cannot copy text or code from them. You are not helping your friend by allowing them to not learn. ...

  4. Contingency tables red blue circle square

  5. Normalize to joint probability P(Shape, Color) red blue red blue circle circle 1/3 1/4 square square 1/6 1/4

  6. Normalize to joint probability P(Shape, Color) red blue red blue circle circle 1/3 1/4 square square 1/6 1/4 "Normali{e" = Divide everything by the total sum

  7. Normalization loses information red blue circle 1/3 1/4 square 1/6 1/4

  8. Normalization loses information red blue red blue circle circle 1/3 1/4 square square 1/6 1/4

  9. Normalization loses information red blue red blue circle circle 1/3 1/4 square square 1/6 1/4

  10. Normalization loses information red blue red blue circle circle 1/3 1/4 square square 1/6 1/4 Tiree free Four free parameters parameters

  11. Marginal probabilities sum over one axis Axis 1 P(S,C) red blue P(S) Axis 0 circle circle 7/12 square square 5/12 P(C) red blue 6/12 6/12

  12. Divide joint by marginal to get conditionals red blue circle 1/3 1/4 square 1/6 1/4 / red blue 1/2 1/2 = red blue cir 2/3 cir 1/2 cle cle "Normali{e" = Divide everything by the total sum squ 1/3 squ 1/2 are are

  13. Divide joint by marginal to get conditionals red blue circle 1/3 1/4 P(Shape, Color) square 1/6 1/4 / P(Color) red blue = 1/2 1/2 = red blue P(Shape | Color) cir 2/3 cir 1/2 cle cle "Given" squ 1/3 squ 1/2 are are

  14. Which is larger? P(Shape=square, Color=blue) or P(Shape=square | Color=blue)

  15. Multiply conditionals by marginal to get joint red blue P(Shape, Color) circle 1/3 1/4 square 1/6 1/4 = = red blue 1/2 1/2 P(Shape | Color) P(Color) * red blue cir 2/3 cir 1/2 cle cle squ 1/3 squ 1/2 are are

  16. Divide by marginal going the other way red blue red blue = circle 1/3 1/4 circle 7/12 circle 4/7 3/7 / square 5/12 square 1/6 1/4 red blue square 2/5 3/5

  17. Divide by marginal going the other way red blue red blue = circle 1/3 1/4 circle 7/12 circle 4/7 3/7 / square 5/12 square 1/6 1/4 red blue square 2/5 3/5 P(Shape, Color) = P(Color | Shape) P(Shape)

  18. Bayes' Rule! red blue red blue = circle 1/3 1/4 circle 7/12 circle 4/7 3/7 / square 5/12 square 1/6 1/4 red blue = square 2/5 3/5 red blue 1/2 1/2 P(Shape | Color) P(Color) * P(Shape) red blue cir 2/3 cir 1/2 = P(Color | Shape) cle cle squ 1/3 squ 1/2 are are

  19. What we did to load section data Read multiple files from CSV Extract values from filenames with regular expressions Change variable types (int -> string) Extract new variables from existing variables with regular expressions Recode four-value variable to two values Count co-occurrences of two variables (section, grade level)

  20. What does it feel like to have a bug in code? Strange things keep happening, but you will ofuen be able to "explain away" results. At first. TRUST YOUR GUT. BE VIRTUOUS. BE PARANOID.

Recommend

Lecture 30: Bayes Rules, Expected Value and Variance, and Binormal Distribution Dr. Chengjiang

Lecture 30: Bayes Rules, Expected Value and Variance, and Binormal Distribution Dr. Chengjiang

Lecture 30: Bayes Rules, Expected Value and Variance, and Binormal Distribution Dr. Chengjiang Long Computer Vision Researcher at Kitware Inc. Adjunct Professor at SUNY at Albany. Email: clong2@albany.edu Outline Bayes Rule Expected

740 views • 44 slides
Foundations of Computer Science Lecture 21 Deviations from the Mean How Good is the Expectation

Foundations of Computer Science Lecture 21 Deviations from the Mean How Good is the Expectation

Foundations of Computer Science Lecture 21 Deviations from the Mean How Good is the Expectation as a Sumary of a Random Variable? Variance: Uniform; Bernoulli; Binomial; Waiting Times. Variance of a Sum Law of Large Numbers: The 3- Rule

666 views • 13 slides
Foundations of Computer Science Lecture 21 Deviations from the Mean How Good is the Expectation

Foundations of Computer Science Lecture 21 Deviations from the Mean How Good is the Expectation

Foundations of Computer Science Lecture 21 Deviations from the Mean How Good is the Expectation as a Sumary of a Random Variable? Variance: Uniform; Bernoulli; Binomial; Waiting Times. Variance of a Sum Law of Large Numbers: The 3- Rule

1.32k views • 93 slides
GMM & EM Last time summary Normalization Bias-Variance trade-off Overfitting and

GMM & EM Last time summary Normalization Bias-Variance trade-off Overfitting and

GMM & EM Last time summary Normalization Bias-Variance trade-off Overfitting and underfitting MLE vs MAP estimate How to use the prior LRT (Bayes Classifier) Nave Bayes A simple decision rule If we can know

471 views • 35 slides
3.2 More on Expectation 3.3 Variance and Standard Deviation Anna Karlin Most Slides by Alex Tsun

3.2 More on Expectation 3.3 Variance and Standard Deviation Anna Karlin Most Slides by Alex Tsun

3.2 More on Expectation 3.3 Variance and Standard Deviation Anna Karlin Most Slides by Alex Tsun Agenda Linearity of Expectation (LoE) Law of the Unconscious Statistician (Lotus) Variance Independence of random variables

735 views • 34 slides
Feb 27: Expectation, Variance, and Standard Deviation In-class Midterm Exam MOVED to 3/10

Feb 27: Expectation, Variance, and Standard Deviation In-class Midterm Exam MOVED to 3/10

Feb 27: Expectation, Variance, and Standard Deviation In-class Midterm Exam MOVED to 3/10 Goals for today What are mean, variance, and standard deviation? What is the difference between distribution mean/variance and sample mean/variance?

996 views • 46 slides
4. Expectation and Variance Joint PMFs Andrej Bogdanov Expected value The expected value

4. Expectation and Variance Joint PMFs Andrej Bogdanov Expected value The expected value

ENGG 2430 / ESTR 2004: Probability and Statistics Spring 2019 4. Expectation and Variance Joint PMFs Andrej Bogdanov Expected value The expected value (expectation) of a random variable X with p.m.f. p is E [ X ] = x x p ( x ) Example N =

1.11k views • 44 slides
Variance Will Perkins January 22, 2013 Variance Definition The variance of a random variable X

Variance Will Perkins January 22, 2013 Variance Definition The variance of a random variable X

Variance Will Perkins January 22, 2013 Variance Definition The variance of a random variable X is: var( X ) = E [( X E X ) 2 ] Alternatively, (check using linearity of expectation), var( X ) = E [ X 2 ] ( E X ) 2 Variance Variance is

395 views • 12 slides
Gov 51: Expectation, Variance, and Sample Means Matthew Blackwell Harvard University 1 / 13

Gov 51: Expectation, Variance, and Sample Means Matthew Blackwell Harvard University 1 / 13

Gov 51: Expectation, Variance, and Sample Means Matthew Blackwell Harvard University 1 / 13 Remember our goal Population Sample probability inference We want to learn about the chance process that generated our data. Last time:

389 views • 13 slides
Continuous Expectation and Variance, and the Law of Large Numbers 18.05 Spring 2018 0.5 0.4

Continuous Expectation and Variance, and the Law of Large Numbers 18.05 Spring 2018 0.5 0.4

Continuous Expectation and Variance, and the Law of Large Numbers 18.05 Spring 2018 0.5 0.4 0.3 0.2 0.1 0 -4 -3 -2 -1 0 1 2 3 4 Recall Exponential Random Variables Parameter: (called the rate parameter). Range: [0 , ).

666 views • 22 slides
The Probabilistic Method Week 6: Expectation, Variance, and Beyond Joshua Brody CS49/Math59

The Probabilistic Method Week 6: Expectation, Variance, and Beyond Joshua Brody CS49/Math59

The Probabilistic Method Week 6: Expectation, Variance, and Beyond Joshua Brody CS49/Math59 Fall 2015 Reading Quiz What is the following result commonly called: Theorem: Let X be a random variable that takes only nonnegative values. Then

487 views • 10 slides
variance Var[ X ] = E[( X - ) 2 ], often denoted 2 . The standard deviation of X is =

variance Var[ X ] = E[( X - ) 2 ], often denoted 2 . The standard deviation of X is =

properties of expectation One more linearity of expectation practice problem Linearity, II Given a DNA sequence of length n Let X and Y be two random variables derived from e.g. AAATGAATGAATCC outcomes of a single experiment.

328 views • 9 slides
Foundations of Computing II Lecture 8: Bayes Rule, Limited Independence Stefano Tessaro

Foundations of Computing II Lecture 8: Bayes Rule, Limited Independence Stefano Tessaro

CSE 312 Foundations of Computing II Lecture 8: Bayes Rule, Limited Independence Stefano Tessaro tessaro@cs.washington.edu 1 Today Bayes Rule Independence of multiple events 2 On LaTeX Overleaf is not the best approach for using

695 views • 26 slides
Expectation DS GA 1002 Probability and Statistics for Data Science

Expectation DS GA 1002 Probability and Statistics for Data Science

Expectation DS GA 1002 Probability and Statistics for Data Science http://www.cims.nyu.edu/~cfgranda/pages/DSGA1002_fall17 Carlos Fernandez-Granda Aim Describe random variables with a few numbers: mean, variance, covariance Expectation

1.52k views • 129 slides
Continuous Expectation and Variance, the Law of Large Numbers, and the Central Limit Theorem 18.05

Continuous Expectation and Variance, the Law of Large Numbers, and the Central Limit Theorem 18.05

Continuous Expectation and Variance, the Law of Large Numbers, and the Central Limit Theorem 18.05 Spring 2014 Jeremy Orloff and Jonathan Bloom 0.5 0.4 0.3 0.2 0.1 0 -4 -3 -2 -1 0 1 2 3 4 Expected value Expected value: measure of

500 views • 29 slides
Independence, Variance, Bayes Theorem Russell Impagliazzo and Miles Jones Thanks to Janine

Independence, Variance, Bayes Theorem Russell Impagliazzo and Miles Jones Thanks to Janine

Independence, Variance, Bayes Theorem Russell Impagliazzo and Miles Jones Thanks to Janine Tiefenbruck http://cseweb.ucsd.edu/classes/sp16/cse21-bd/ May 16, 2016 Resolving collisions with chaining Hash Table Each memory location holds

770 views • 60 slides
Independence, Variance, Bayes Theorem Russell Impagliazzo and Miles Jones Thanks to Janine

Independence, Variance, Bayes Theorem Russell Impagliazzo and Miles Jones Thanks to Janine

Independence, Variance, Bayes Theorem Russell Impagliazzo and Miles Jones Thanks to Janine Tiefenbruck http://cseweb.ucsd.edu/classes/sp16/cse21-bd/ May 16, 2016 Resolving collisions with chaining Hash Table Each memory location holds

563 views • 55 slides
Nave Bayes in a Nutshell Bayes rule: Assuming conditional independence among X i s: So,

Nave Bayes in a Nutshell Bayes rule: Assuming conditional independence among X i s: So,

Machine Learning 10-701 Tom M. Mitchell Machine Learning Department Carnegie Mellon University January 25, 2011 Today: Readings: Nave Bayes Required: discrete-valued X i s Mitchell: Nave Bayes and Document

624 views • 15 slides
Variance = E[I 2 ] 2pE[I] + p 2 = E[I] 2p p + p 2 = 2 2 = p-2p+ p pq variance.1

Variance = E[I 2 ] 2pE[I] + p 2 = E[I] 2p p + p 2 = 2 2 = p-2p+ p pq variance.1

Variance of an Indicator Mathematics for Computer Science MIT 6.042J/18.062J IanindicatorwithE[I]=p: Var[I]:: = E[(I p) 2 ] Variance = E[I 2 ] 2pE[I] + p 2 = E[I] 2p p + p 2 = 2 2 = p-2p+ p pq variance.1 variance.2

104 views • 6 slides
Bayes rule recall def of conditional: P(a|b) = P(a^b) / P(b) if P(b) != 0 Geoff

Bayes rule recall def of conditional: P(a|b) = P(a^b) / P(b) if P(b) != 0 Geoff

Bayes rule recall def of conditional: P(a|b) = P(a^b) / P(b) if P(b) != 0 Geoff Gordon10-701 Machine LearningFall 2013 1 mult thru by P(b): P(a|b) P(b) = P(a^b) holds even if P(b)=0 (check), so some take this as basic def of

731 views • 31 slides
Variance; Continuous Random Variables 18.05 Spring 2014 January 1, 2017 1 / 26 Variance and

Variance; Continuous Random Variables 18.05 Spring 2014 January 1, 2017 1 / 26 Variance and

Variance; Continuous Random Variables 18.05 Spring 2014 January 1, 2017 1 / 26 Variance and standard deviation X a discrete random variable with mean E ( X ) = . Meaning: spread of probability mass about the mean. Definition as expectation

579 views • 26 slides
Continuous Expectation and Variance, the Law of Large Numbers, and the Central Limit Theorem 18.05

Continuous Expectation and Variance, the Law of Large Numbers, and the Central Limit Theorem 18.05

Continuous Expectation and Variance, the Law of Large Numbers, and the Central Limit Theorem 18.05 Spring 2014 0.5 0.4 0.3 0.2 0.1 0 -4 -3 -2 -1 0 1 2 3 4 January 1, 2017 1 / 31 Expected value Expected value: measure of

446 views • 31 slides
Continuous Expectation and Variance, the Law of Large Numbers, and the Central Limit Theorem 18.05

Continuous Expectation and Variance, the Law of Large Numbers, and the Central Limit Theorem 18.05

Continuous Expectation and Variance, the Law of Large Numbers, and the Central Limit Theorem 18.05 Spring 2014 0.5 0.4 0.3 0.2 0.1 0 -4 -3 -2 -1 0 1 2 3 4 January 1, 2017 1 / 24 Expected value Expected value: measure of

374 views • 24 slides
r.r.fi use indicator others 0 IT In PrEIj Xn I In e EE In E EE Ide c In Xn Iie E ECTS

r.r.fi use indicator others 0 IT In PrEIj Xn I In e EE In E EE Ide c In Xn Iie E ECTS

variance and covariance July 23,2020 f Applications of of Expectation Linearity Variance 2 Covariance and correlation 3 Last time Distributions p if Xsl Bernoulli CP x PREM ipso p i f pin pj I Xu PHX Bincngp Linearity of

518 views • 13 slides

More recommend