research designs for causal inference
play

Research Designs for Causal Inference Department of Political - PowerPoint PPT Presentation

Apr 21, 2023 •457 likes •1.7k views

Background IV RDD ITS DID Research Designs for Causal Inference Department of Political Science and Government Aarhus University March 10, 2015 Background IV RDD ITS DID 1 Background 2 Instrumental Variables 3 Regression Discontinuity

  1. Background IV RDD ITS DID Finding Instruments Forward, not backward, causal inference Most instruments are not things we care about Weather, disasters Geography, borders, climate Lotteries A good instrument is one that satisfies both of our conditions, so we need: A good story about exogeneity Evidence that instrument is strong

  2. Background IV RDD ITS DID Instrumental Variables Activity Read each scenario Assess exogeneity and relevance Discuss with the person sitting next to you

  3. Background IV RDD ITS DID Questions about IV?

  4. Background IV RDD ITS DID 1 Background 2 Instrumental Variables 3 Regression Discontinuity Designs 4 Interrupted Time-Series 5 Difference-In-Differences

  5. Background IV RDD ITS DID Example: Maimonides’ Rule

  6. Background IV RDD ITS DID Example: Maimonides’ Rule 1 What is Maimonides’ Rule?

  7. Background IV RDD ITS DID Example: Maimonides’ Rule 1 What is Maimonides’ Rule? 2 Why is it a valid (credible) instrument? (Or why isn’t it?)

  8. Background IV RDD ITS DID Example: Maimonides’ Rule 1 What is Maimonides’ Rule? 2 Why is it a valid (credible) instrument? (Or why isn’t it?) 3 How does it differ from a randomized experiment?

  9. Background IV RDD ITS DID Z Class Size Test Scores Grade Size

  10. Background IV RDD ITS DID How RDD Works 1 Find a consequential threshold Examples? 2 Causal inference is about comparisons In an experiment, X is randomly assigned In matching or regression, we compare units that differ only in X but are similar in Z 3 In RDD, X is not randomly assigned and there is no covariate overlap W causally determines X , so units with different values of X also differ in their value of W compare units that are as similar as possible

  11. Background IV RDD ITS DID Regression Discontinuity Y X

  12. Background IV RDD ITS DID Regression Discontinuity Y • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • X

  13. Background IV RDD ITS DID Regression Discontinuity Y • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • X

  14. Background IV RDD ITS DID Regression Discontinuity Y • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • X Intervention

  15. Background IV RDD ITS DID Regression Discontinuity Y • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • X Intervention

  16. Background IV RDD ITS DID Regression Discontinuity Y • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • X Intervention

  17. Background IV RDD ITS DID Regression Discontinuity Y • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • X Intervention

  18. Background IV RDD ITS DID Regression Discontinuity Y • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • X Intervention

  19. Background IV RDD ITS DID Regression Discontinuity Y • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • X Intervention

  20. Background IV RDD ITS DID Regression Discontinuity Y • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • X Intervention

  21. Background IV RDD ITS DID Is There A Discontinuity? Y X

  22. Background IV RDD ITS DID Is There A Discontinuity? • • Y • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • X

  23. Background IV RDD ITS DID Is There A Discontinuity? • • Y • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • X Intervention

  24. Background IV RDD ITS DID Is There A Discontinuity? • • Y • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • X Intervention

  25. Background IV RDD ITS DID Is There A Discontinuity? • • Y • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • X Intervention

  26. Background IV RDD ITS DID Is There A Discontinuity? • • Y • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • X Intervention

  27. Background IV RDD ITS DID “Sharp” and “Fuzzy” RDD If a threshold perfectly causes X , then it produces a sharp discontinuity Potentially analyze as an experiment

  28. Background IV RDD ITS DID “Sharp” and “Fuzzy” RDD If a threshold perfectly causes X , then it produces a sharp discontinuity Potentially analyze as an experiment If a threshold imperfectly (probabilistically) causes X , then it produces a fuzzy discontinuity  1 , if X > threshold   W = 0 , if X < threshold  

  29. Background IV RDD ITS DID “Sharp” and “Fuzzy” RDD If a threshold perfectly causes X , then it produces a sharp discontinuity Potentially analyze as an experiment If a threshold imperfectly (probabilistically) causes X , then it produces a fuzzy discontinuity Analyze using Instrumental Variables  1 , if X > threshold   W = 0 , if X < threshold   Examples?

  30. Background IV RDD ITS DID Sharp vs. Fuzzy RDD Y • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • X Intervention

  31. Background IV RDD ITS DID Sharp vs. Fuzzy RDD Y • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • X Intervention

  32. Background IV RDD ITS DID Modelling RDD Sharp: Treat threshold as an experiment Fuzzy: Treat the threshold as an instrument Not all cases above threshold are treated Not all cases below threshold are untreated Effect is estimated at point of discontinuity, which may not reflect effect X → Y over the entire domain of X Need to choose bandwidths

  33. Background IV RDD ITS DID Sharp vs. Fuzzy RDD Y • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • X Intervention

  34. Background IV RDD ITS DID Sharp vs. Fuzzy RDD Y • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • X Intervention

  35. Background IV RDD ITS DID Sharp vs. Fuzzy RDD Y • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • X Intervention

  36. Background IV RDD ITS DID Modelling RDD Use bandwidths to subset the data Regress Y on X , interacted with W Often use polynomial terms: Y = β 0 + β 1 X + β 2 X 2 + ... + β 3 Z + β 4 XZ + β 5 X 2 Z + ...

  37. Background IV RDD ITS DID Problems with Discontinuities Campbell’s Law : The more any quantitative social indicator (or even some qualitative indicator) is used for social decision-making, the more subject it will be to corruption pressures and the more apt it will be to distort and corrupt the social processes it is intended to monitor.

  38. Background IV RDD ITS DID Problems with Discontinuities Campbell’s Law : The more any quantitative social indicator (or even some qualitative indicator) is used for social decision-making, the more subject it will be to corruption pressures and the more apt it will be to distort and corrupt the social processes it is intended to monitor. Discontinuities are exploitable

  39. Background IV RDD ITS DID Problems with Discontinuities Campbell’s Law : The more any quantitative social indicator (or even some qualitative indicator) is used for social decision-making, the more subject it will be to corruption pressures and the more apt it will be to distort and corrupt the social processes it is intended to monitor. Discontinuities are exploitable Compensatory rivalry and equalization

  40. Background IV RDD ITS DID Questions about RDD?

  41. Background IV RDD ITS DID 1 Background 2 Instrumental Variables 3 Regression Discontinuity Designs 4 Interrupted Time-Series 5 Difference-In-Differences

  42. Background IV RDD ITS DID How ITS Works Identify an exogenous shock in X that might affect Y Look at Y before ( t ) and after ( t + 1) the shock We only observe one manifest outcome at each point in time

  43. Background IV RDD ITS DID time Intervention

  44. Background IV RDD ITS DID time Intervention

  45. Background IV RDD ITS DID How ITS Works Identify an exogenous shock in X that might affect Y Look at Y before ( t ) and after ( t + 1) the shock We only observe one manifest outcome at each point in time

  46. Background IV RDD ITS DID How ITS Works Identify an exogenous shock in X that might affect Y Look at Y before ( t ) and after ( t + 1) the shock We only observe one manifest outcome at each point in time To make a causal inference, we need: Y 0 , t and Y 1 , t , or Y 0 , t + 1 and Y 1 , t + 1 Use pre-post comparisons to infer the value of unobserved potential outcomes

  47. Background IV RDD ITS DID time Intervention

  48. Background IV RDD ITS DID • • time Intervention

  49. Background IV RDD ITS DID • • time Intervention

  50. Background IV RDD ITS DID • Effect? • time Intervention

  51. Background IV RDD ITS DID • Effect? • time Intervention

  52. Background IV RDD ITS DID • • time Intervention

  53. Background IV RDD ITS DID Effect? • • time Intervention

  54. Background IV RDD ITS DID Threats to Inference Campbell and Ross talk about six “threats to validity” (i.e., threats to causal inference) related to time-series analysis What are those threats?

  55. Background IV RDD ITS DID ITS Considerations Changes in level and/or slope Effects can be delayed

  56. Background IV RDD ITS DID time Intervention

  57. Background IV RDD ITS DID ITS Considerations Changes in level and/or slope Effects can be delayed

  58. Background IV RDD ITS DID ITS Considerations Changes in level and/or slope Effects can be delayed Improving the design (easiest to hardest):

  59. Background IV RDD ITS DID ITS Considerations Changes in level and/or slope Effects can be delayed Improving the design (easiest to hardest): Multiple outcome measures

Recommend

Gov 2002 - Causal Inference III: Regression Discontinuity Designs Matthew Blackwell Arthur

Gov 2002 - Causal Inference III: Regression Discontinuity Designs Matthew Blackwell Arthur

Gov 2002 - Causal Inference III: Regression Discontinuity Designs Matthew Blackwell Arthur Spirling October 16th, 2014 Introduction Causal for us so far: selection of observables, instrumental variables for when this doesnt hold

2.07k views • 179 slides
Causal Inference An introduction based on S. Wagers course on Causal Inference (OIT 661) Imke

Causal Inference An introduction based on S. Wagers course on Causal Inference (OIT 661) Imke

Causal Inference An introduction based on S. Wagers course on Causal Inference (OIT 661) Imke Mayer November 23, 2018 Group Meeting, CMAP Outline 1. Treatment effect estimation in randomized experiments 2. Beyond a single randomized

1.48k views • 47 slides
Causal Inference and Response Surface Modeling Inference and

Causal Inference and Response Surface Modeling Inference and

Causal Inference and Response Surface Modeling Inference and Representa6on DS-GA-1005 Fall 2015 Guest lecturer: Uri Shalit What is Causal Inference?

504 views • 48 slides
Introduction to Causal Inference Lan Liu University of Minnesota at Twin Cities liux3771@umn.edu

Introduction to Causal Inference Lan Liu University of Minnesota at Twin Cities liux3771@umn.edu

Introduction to Causal Inference Lan Liu University of Minnesota at Twin Cities liux3771@umn.edu 1 Table of contents Causal ... or not? How Topics in Causal Inference Tools we use... Causal Inference in Industry 2 The Danger of Ice Cream

961 views • 52 slides
Modes of Statistical Inference for Causal Efgects Plus an overview of the testing based approach

Modes of Statistical Inference for Causal Efgects Plus an overview of the testing based approach

Modes of Statistical Inference for Causal Efgects Plus an overview of the testing based approach to causal inference for experiments on networks CSBS Causal Inference Workshop @ Illinois Jake Bowers Political Science &amp; Statistics

1k views • 88 slides
{ a) policy evaluation (treatment effects ) Old b) attribution but for gems

{ a) policy evaluation (treatment effects ) Old b) attribution but for gems

JSM-2016 presented: 8.1.16 OUTLINE CAUSAL INFERENCE IN STATISTICS: 1. The causal revolution from statistics to policy intervention to counterfactuals 2. The fundamental laws of causal inference A Gentle Introduction 3. From

369 views • 12 slides
Causal inference Gary Goertz Kroc Institute for International Peace Studies University of Notre

Causal inference Gary Goertz Kroc Institute for International Peace Studies University of Notre

Causal inference Gary Goertz Kroc Institute for International Peace Studies University of Notre Dame ggoertz@nd.edu Spring 2018 Experiments are the gold standard for causal inference Strategies of causal inference are satisfactory (with

318 views • 11 slides
A Brief Introduction to Causal Inference Brady Neal causalcourse.com What is causal inference?

A Brief Introduction to Causal Inference Brady Neal causalcourse.com What is causal inference?

A Brief Introduction to Causal Inference Brady Neal causalcourse.com What is causal inference? Inferring the effects of any treatment/policy/intervention/etc. 2 / 28 Brady Neal What is causal inference? Inferring the effects of any

2.8k views • 102 slides
Causal Inference Theory and Applications Dr. Matthias Uflacker, Johannes Huegle, Christopher

Causal Inference Theory and Applications Dr. Matthias Uflacker, Johannes Huegle, Christopher

Causal Inference Theory and Applications Dr. Matthias Uflacker, Johannes Huegle, Christopher Schmidt April 24, 2018 Agenda April 24, 2018 Jupyter Notebook Causal Inference in Application Recap Causal Inference in a Nutshell

520 views • 33 slides
Political Science 209 - Fall 2018 Causal Inference Florian Hollenbach 7th September 2018 Causal

Political Science 209 - Fall 2018 Causal Inference Florian Hollenbach 7th September 2018 Causal

Political Science 209 - Fall 2018 Causal Inference Florian Hollenbach 7th September 2018 Causal Inference What do you think is causal inference? Florian Hollenbach 1 Causal Inference causal: relationship between things where one causes

759 views • 47 slides
Causal Inference By: Miguel A. Hern an and James M. Robins Part I: Causal inference without

Causal Inference By: Miguel A. Hern an and James M. Robins Part I: Causal inference without

Causal Inference By: Miguel A. Hern an and James M. Robins Part I: Causal inference without models Chapter 1: A definition of causal effect 27 th November, 2013 27 th November, 2013 Chapter 1 (Hern an &amp; Robins) Definition of causal

491 views • 13 slides
Geographic Data Science - Lecture IX Causal Inference Dani Arribas-Bel Today Correlation Vs

Geographic Data Science - Lecture IX Causal Inference Dani Arribas-Bel Today Correlation Vs

Geographic Data Science - Lecture IX Causal Inference Dani Arribas-Bel Today Correlation Vs Causation Causal inference Why/when causality matters Hurdles to causal inference &amp; strategies to overcome them Correlation Vs Causation

457 views • 26 slides
Geographic Data Science - Lecture IX Causal Inference Dani Arribas-Bel Today Correlation Vs

Geographic Data Science - Lecture IX Causal Inference Dani Arribas-Bel Today Correlation Vs

Geographic Data Science - Lecture IX Causal Inference Dani Arribas-Bel Today Correlation Vs Causation Causal inference Why/when causality matters Hurdles to causal inference &amp; strategies to overcome them Correlation Vs Causation

741 views • 45 slides
Geographic Data Science - Lecture IX Causal Inference Dani Arribas-Bel Today Correlation Vs

Geographic Data Science - Lecture IX Causal Inference Dani Arribas-Bel Today Correlation Vs

Geographic Data Science - Lecture IX Causal Inference Dani Arribas-Bel Today Correlation Vs Causation Causal inference Why/when causality matters Hurdles to causal inference &amp; strategies to overcome them Correlation Vs Causation

626 views • 45 slides
Causal reasoning and inference with causal Bayes nets Alexander Gebharter Duesseldorf Center for

Causal reasoning and inference with causal Bayes nets Alexander Gebharter Duesseldorf Center for

Causal reasoning and inference with causal Bayes nets Alexander Gebharter Duesseldorf Center for Logic and Philosophy of Science Heinrich Heine University Duesseldorf 28.04.2016 Alexander Gebharter (DCLPS) Reasoning &amp; inference with CBNs

1.09k views • 106 slides
Contents 1 Causal Inference and Predictive Comparison 2 1.1 How Predictive Comparison Can

Contents 1 Causal Inference and Predictive Comparison 2 1.1 How Predictive Comparison Can

Causal Inference in Observational Studies Contents 1 Causal Inference and Predictive Comparison 2 1.1 How Predictive Comparison Can Mislead . . . . . . . . . . . . . 2 1.2 Adding Predictors as a Solution . . . . . . . . . . . . . . . . . .

274 views • 14 slides
CAUSAL INFERENCE AS COMPUTATIONAL LEARNING Judea Pearl University of California Los Angeles

CAUSAL INFERENCE AS COMPUTATIONAL LEARNING Judea Pearl University of California Los Angeles

CAUSAL INFERENCE AS COMPUTATIONAL LEARNING Judea Pearl University of California Los Angeles (www.cs.ucla.edu/~judea) OUTLINE Inference: Statistical vs. Causal distinctions and mental barriers Formal semantics for

773 views • 64 slides
Causal inference Part II: Difference In Difference and Instrumental Variables Difference in

Causal inference Part II: Difference In Difference and Instrumental Variables Difference in

Causal inference Part II: Difference In Difference and Instrumental Variables Difference in difference Card &amp; Krueger (1995,AER) Rise in minimum wage from 4,2$ to 5,05$ in April 1992 in the State of New Jersey. Research question:

405 views • 28 slides
High-dimensional causal inference, graphical modeling and structural equation models Peter B

High-dimensional causal inference, graphical modeling and structural equation models Peter B

High-dimensional causal inference, graphical modeling and structural equation models Peter B uhlmann Seminar f ur Statistik, ETH Z urich cannot do confirmatory causal inference without randomized intervention experiments... but we can

1.03k views • 88 slides
Causal Inference and Experimentation Macartan Humphreys mh2245@columbia.edu November 15, 2011

Causal Inference and Experimentation Macartan Humphreys mh2245@columbia.edu November 15, 2011

Causal Inference Design Road Map Analysis Estimands and Estimators Troubleshooting Prospects and Limitations Causal Inference and Experimentation Macartan Humphreys mh2245@columbia.edu November 15, 2011 Macartan Humphreys

627 views • 51 slides
Adapting Causal Inference Methods to Improve Identification of Healthcare Disparities Benjamin

Adapting Causal Inference Methods to Improve Identification of Healthcare Disparities Benjamin

Adapting Causal Inference Methods to Improve Identification of Healthcare Disparities Benjamin Cook, PhD MPH Director, Health Equity Research Lab Cambridge Health Alliance/Harvard Medical School healthequityresearch.org @cmmhr June 26, 2017

681 views • 39 slides
Causal inference with missing values Effect of tranexamic acid on mortality for head trauma

Causal inference with missing values Effect of tranexamic acid on mortality for head trauma

Causal inference with missing values Effect of tranexamic acid on mortality for head trauma patient Julie Josse, (INRIA XPOP - X) - Imke Mayer 22 January, 2019 Statistic seminar Nice 1 Research activities Dimensionality reduction methods

1.07k views • 66 slides
Probality-free causal inference via the Algorithmic Markov Condition Dominik Janzing Max Planck

Probality-free causal inference via the Algorithmic Markov Condition Dominik Janzing Max Planck

Probality-free causal inference via the Algorithmic Markov Condition Dominik Janzing Max Planck Institute for Intelligent Systems T ubingen, Germany 23. June 2015 Can we infer causal relations from passive observations? Recent study

721 views • 52 slides
Causal Inference: An Introduction Qingyuan Zhao Statistical Laboratory, University of Cambridge

Causal Inference: An Introduction Qingyuan Zhao Statistical Laboratory, University of Cambridge

Causal Inference: An Introduction Qingyuan Zhao Statistical Laboratory, University of Cambridge 4th March, 2020 @ Social Sciences Research Methods Programme (SSRMP), University of Cambridge Slides and more information are available at

829 views • 51 slides

More recommend