Inference About a Future Value of Y A regression model may be fitted - PowerPoint PPT Presentation

Apr 09, 2024 •50 likes •120 views

ST 380 Probability and Statistics for the Physical Sciences Inference About a Future Value of Y A regression model may be fitted to learn about the association of Y and x , represented by 0 and especially 1 . However, sometimes the intent is

ST 380 Probability and Statistics for the Physical Sciences Inference About a Future Value of Y A regression model may be fitted to learn about the association of Y and x , represented by β 0 and especially β 1 . However, sometimes the intent is to make inferences about the likely values of Y under new conditions. We might want to learn about the distribution of Y when pH = 7.5, which is not one of the values in the data set. 1 / 7 Simple Linear Regression Prediction
ST 380 Probability and Statistics for the Physical Sciences In the regression model, when x has some new value x ∗ , E ( Y ) = β 0 + β 1 x ∗ , so the natural estimator of E ( Y ) is Y = ˆ ˆ β 0 + ˆ β 1 x ∗ . Y ) = β 0 + β 1 x ∗ = E ( Y ), so ˆ We can show that E ( ˆ Y is an unbiased estimator of E ( Y ). To construct confidence intervals for E ( Y ), we need the standard error of ˆ Y ; the formula is known, but using software is simpler. 2 / 7 Simple Linear Regression Prediction
ST 380 Probability and Statistics for the Physical Sciences In R arsenicLm <- lm(Percent ~ pH, arsenic) predict(arsenicLm, data.frame(pH = 7.5), se.fit = TRUE, interval = "confidence") Output $fit fit lwr upr 1 55.01145 50.67454 59.34837 $se.fit [1] 2.045806 $df [1] 16 $residual.scale [1] 6.125584 3 / 7 Simple Linear Regression Prediction
ST 380 Probability and Statistics for the Physical Sciences In the R output, fit is ˆ Y , and se.fit is its estimated standard error. lwr and upr are the endpoints of the confidence interval for E ( Y ), by default the 95% confidence interval. 4 / 7 Simple Linear Regression Prediction
ST 380 Probability and Statistics for the Physical Sciences Predicting the Future Value of Y Note: E ( Y ) is the expected value of Y when x = x ∗ ; in the example, it is the capability of the process to remove arsenic from water with a pH of x ∗ = 7 . 5. Sometimes we need to predict the observed value of Y in a future experiment with x = x ∗ . Since Y = E ( Y ) + ǫ and E ( ǫ ) = 0, the best predictor of Y is still ˆ Y . 5 / 7 Simple Linear Regression Prediction
ST 380 Probability and Statistics for the Physical Sciences But V ( Y − ˆ Y ) = V { [ Y − E ( Y )] + [ E ( Y ) − ˆ Y ] } = V [ Y − E ( Y )] + V [ E ( Y ) − ˆ Y ] = σ 2 + V [ ˆ Y ] . The prediction interval for Y is also centered at ˆ Y , but is wider than the confidence interval. 6 / 7 Simple Linear Regression Prediction
ST 380 Probability and Statistics for the Physical Sciences In R The same predict() method is used, but with an option to make the interval appropriately wider: predict(arsenicLm, data.frame(pH = 7.5), interval = "prediction") Output fit lwr upr 1 55.01145 41.32072 68.70218 Note that the prediction interval has a width of 27.4, whereas the confidence interval has a width of 8.7. 7 / 7 Simple Linear Regression Prediction

Recommend

Exact Inference Inference Basic task for inference: Compute

Exact Inference Inference Basic task for inference: Compute a posterior distribu8on for some query variables given some observed evidence Sum out

699 views • 30 slides

Inference in Bayesian networks Chapter 14.45 Chapter 14.45 1 Outline Exact inference

Inference in Bayesian networks Chapter 14.45 Chapter 14.45 1 Outline Exact inference by enumeration Approximate inference by stochastic simulation Chapter 14.45 2 Inference tasks Simple queries: compute posterior marginal P (

450 views • 28 slides

Inference in First-Order Logic C H A P T E R 9 H A S S A N K H O S R A V I S P R I N G 2 0 1 1

Inference in First-Order Logic C H A P T E R 9 H A S S A N K H O S R A V I S P R I N G 2 0 1 1 Outline Reducing first-order inference to propositional inference Unification Generalized Modus Ponens Forward chaining Backward

856 views • 58 slides

Inference in Bayesian networks Chapter 14.45 Chapter 14.45 1 Outline Exact inference

Inference in Bayesian networks Chapter 14.45 Chapter 14.45 1 Outline Exact inference by enumeration Exact inference by variable elimination Approximate inference by stochastic simulation Approximate inference by Markov

530 views • 38 slides

Type Inference 75 Definition Type Inference Type inference = Java compiler's ability

Type Inference 75 Definition Type Inference Type inference = Java compiler's ability To look at each method invocation + corresponding declaration In order to determine the type argument (or arguments) that make the

457 views • 11 slides

Causal Inference and Response Surface Modeling Inference and

Causal Inference and Response Surface Modeling Inference and Representa6on DS-GA-1005 Fall 2015 Guest lecturer: Uri Shalit What is Causal Inference?

503 views • 48 slides

Bayesian inference in astronomy: past, present and future. Sanjib Sharma (University of Sydney)

Bayesian inference in astronomy: past, present and future. Sanjib Sharma (University of Sydney) January 2020 Past Story of Mr Bayes: 1763 Bayes problem. Location of blue ball based on how many balls are to right and how many to left.

1.09k views • 86 slides

Soft Inference and Posterior Marginals September 19, 2013 Soft vs. Hard Inference Hard

Soft Inference and Posterior Marginals September 19, 2013 Soft vs. Hard Inference Hard inference Give me a single solution Viterbi algorithm Maximum spanning tree (Chu-Liu-Edmonds alg.) Soft inference Task 1:

994 views • 71 slides

Greed is Good if Randomized: New Inference for Dependency

Greed is Good if Randomized: New Inference for Dependency Parsing Yuan Zhang CSAIL, MIT Joint work with Tao Lei, Regina Barzilay, and Tommi Jaakkola 1 Inference vs. Scoring Exact Inference

928 views • 67 slides

Variational Inference for GPs: Presenters Group1: Stochastic variational inference. Slides 2 - 28

Variational Inference for GPs: Presenters Group1: Stochastic variational inference. Slides 2 - 28 Chaoqi Wang Sana Tonekaboni Will Grathwohl Group2: Variational inference for GPs. Slides 29 - 57 Trefor Evans Kingsley Chang Shems Saleh James

1.32k views • 98 slides

Inference in first-order logic Chapter 9 1 Outline Reducing first-order inference to

Inference in first-order logic Chapter 9 1 Outline Reducing first-order inference to propositional inference Unification Generalized Modus Ponens Forward and backward chaining Logic programming Resolution 2 Reasoning in

987 views • 40 slides

Variational Inference CMSC 691 UMBC Goal: Posterior Inference Hyperparameters Unknown

Approximate Inference: Variational Inference CMSC 691 UMBC Goal: Posterior Inference Hyperparameters Unknown parameters Data: p ( | ) Likelihood model: p( | ) (Some) Learning Techniques MAP/MLE: Point

1.09k views • 81 slides

Inference Statistical inference Definition: Definition: The act or process of reaching

10/20/2016 Outline Statistics in medicine Inference Lecture 2: Hypothesis testing and inference Hypothesis testing Type I error Type II error Fatma Shebl, MD, MS, MPH, PhD Confidence interval Assistant Professor Chronic

187 views • 6 slides

Inference in first-order logic Chapter 9 Chapter 9 1 Outline Reducing first-order inference

Inference in first-order logic Chapter 9 Chapter 9 1 Outline Reducing first-order inference to propositional inference Unification Generalized Modus Ponens Forward and backward chaining Resolution Chapter 9 2 Universal

789 views • 42 slides

Inference in first-order logic Chapter 9 Chapter 9 1 Outline Reducing first-order inference

1.2k views • 46 slides

Inference in first-order logic Chapter 9 Chapter 9 1 Outline Reducing first-order inference

793 views • 48 slides

Foundations for Inference I Dajiang Liu @PHS525 Feb-09-2016 Statistical Inference

Foundations for Inference I Dajiang Liu @PHS525 Feb-09-2016 Statistical Inference Statistical inference is usually performed using a randomly selected sample from the population The estimates obtained from the sample may not actually

168 views • 14 slides

TensorRT 2. Setup of the TensorRT inference engine 2. Setup of the TensorRT inference engine 3. I/O

TensorRT: C++ API 1. Initializations and import of a Caffe network model in TensorRT TensorRT 2. Setup of the TensorRT inference engine 2. Setup of the TensorRT inference engine 3. I/O data structures and launch of the inference Alessandro Biondi

367 views • 8 slides

ACMS 20340 Statistics for Life Sciences Chapter 15: Inference in Practice Inference in Practice

ACMS 20340 Statistics for Life Sciences Chapter 15: Inference in Practice Inference in Practice Recall the simple conditions for inference about a population mean: Known standard deviation Sample obtained randomly Normally

534 views • 30 slides

Signature Inference for Functional Property Discovery or: How never to come up with tests

Signature Inference for Functional Property Discovery or: How never to come up with tests manually anymore(*) Tom Sydney Kerckhove ETH Zurich https://cs-syd.eu/ https://github.com/NorfairKing 27 July 2017 Long term vision: A future in which

1.54k views • 116 slides

Approximate Inference: Randomized Methods October 15, 2015 Topics Hard Inference

Approximate Inference: Randomized Methods October 15, 2015 Topics Hard Inference Local search & hill climbing Stochastic hill climbing / Simulated Annealing Soft Inference Monte-Carlo approximations Markov-Chain

975 views • 66 slides

Variable Elimination 1 Inference Exact inference Enumeration Variable elimination

Variable Elimination 1 Inference Exact inference Enumeration Variable elimination Junction trees and belief propagation Approximate inference Loopy belief propagation Sampling methods: likelihood weighting, Markov

447 views • 12 slides

Advanced inference in probabilistic programs Brooks Paige Inference thus far Likelihood

Advanced inference in probabilistic programs Brooks Paige Inference thus far Likelihood weighting / importance sampling MCMC (single-dimension, coded by hand) Lightweight Metropolis-Hastings (update one random choice at a time,

995 views • 86 slides

What is ecological inference ( EI )? eiPack : Tools for R C Ecological Inference and Goal:

What is ecological inference ( EI )? eiPack : Tools for R C Ecological Inference and Goal: infer individual level behavior from aggregate data Higher-Dimension Data Management Unit of analysis: contingency table with observed marginals

197 views • 7 slides