publication bias in qca publication bias in qca
play

Publication bias in QCA Publication bias in QCA Publication bias in - PowerPoint PPT Presentation

Mar 04, 2023 •150 likes •539 views

24.1.2019 Publication bias in QCA Publication bias in QCA Publication bias in QCA Publication bias in QCA Meaning, diagnosis and remedies Meaning, diagnosis and remedies Meaning, diagnosis and remedies Ingo Rohlng Ingo Rohlng Ingo

  1. 24.1.2019 Publication bias in QCA Publication bias in QCA Publication bias in QCA Publication bias in QCA Meaning, diagnosis and remedies Meaning, diagnosis and remedies Meaning, diagnosis and remedies Ingo Rohl�ng Ingo Rohl�ng Ingo Rohl�ng 2019/01/25 2019/01/25 2019/01/25 1 / 18 1 / 18 1 / 18 file:///C:/data/sync/qca/pubbias/text/pubbias_data/ossc_slides.html#1 1/39

  2. 24.1.2019 Publication bias in QCA A short intro to QCA 2 / 18 file:///C:/data/sync/qca/pubbias/text/pubbias_data/ossc_slides.html#1 2/39

  3. 24.1.2019 Publication bias in QCA Terminology and concepts Independent variable = condition (set) 3 / 18 file:///C:/data/sync/qca/pubbias/text/pubbias_data/ossc_slides.html#1 3/39

  4. 24.1.2019 Publication bias in QCA Terminology and concepts Independent variable = condition (set) Dependent variable = outcome (set) 3 / 18 file:///C:/data/sync/qca/pubbias/text/pubbias_data/ossc_slides.html#1 4/39

  5. 24.1.2019 Publication bias in QCA Terminology and concepts Independent variable = condition (set) Dependent variable = outcome (set) Interaction = configuration/conjunction 3 / 18 file:///C:/data/sync/qca/pubbias/text/pubbias_data/ossc_slides.html#1 5/39

  6. 24.1.2019 Publication bias in QCA Terminology and concepts Independent variable = condition (set) Dependent variable = outcome (set) Interaction = configuration/conjunction Search for set relations Sufficiency: If A, then Y 3 / 18 file:///C:/data/sync/qca/pubbias/text/pubbias_data/ossc_slides.html#1 6/39

  7. 24.1.2019 Publication bias in QCA Terminology and concepts Independent variable = condition (set) Dependent variable = outcome (set) Interaction = configuration/conjunction Search for set relations Sufficiency: If A, then Y Necessity: Only if A, then Y 3 / 18 file:///C:/data/sync/qca/pubbias/text/pubbias_data/ossc_slides.html#1 7/39

  8. 24.1.2019 Publication bias in QCA Terminology and concepts Independent variable = condition (set) Dependent variable = outcome (set) Interaction = configuration/conjunction Search for set relations Sufficiency: If A, then Y Necessity: Only if A, then Y Types of sets Crisp sets: 0 or 1 Fuzzy sets: Between 0 and 1 (including) 3 / 18 file:///C:/data/sync/qca/pubbias/text/pubbias_data/ossc_slides.html#1 8/39

  9. 24.1.2019 Publication bias in QCA From variables to sets: Calibration Uncalibrated variable 4 / 18 file:///C:/data/sync/qca/pubbias/text/pubbias_data/ossc_slides.html#1 9/39

  10. 24.1.2019 Publication bias in QCA From variables to sets: Calibration Calibrated variable 5 / 18 file:///C:/data/sync/qca/pubbias/text/pubbias_data/ossc_slides.html#1 10/39

  11. 24.1.2019 Publication bias in QCA Does the data support a set-relational claim? Consistency: Is data consistent with an inference of sufficiency? 6 / 18 file:///C:/data/sync/qca/pubbias/text/pubbias_data/ossc_slides.html#1 11/39

  12. 24.1.2019 Publication bias in QCA Does the data support a set-relational claim? Consistency: Is data consistent with an inference of sufficiency? Consistency of 0.8 A 0 1 Y 0 4 2 1 6 8 6 / 18 file:///C:/data/sync/qca/pubbias/text/pubbias_data/ossc_slides.html#1 12/39

  13. 24.1.2019 Publication bias in QCA Does the data support a set-relational claim? Consistency: Is data consistent with an inference of sufficiency? Consistency of 0.8 A 0 1 Y 0 4 2 1 6 8 Consistency of 0.5 A 0 1 Y 0 4 5 1 6 5 6 / 18 file:///C:/data/sync/qca/pubbias/text/pubbias_data/ossc_slides.html#1 13/39

  14. 24.1.2019 Publication bias in QCA Does the data support a set-relational claim? 7 / 18 file:///C:/data/sync/qca/pubbias/text/pubbias_data/ossc_slides.html#1 14/39

  15. 24.1.2019 Publication bias in QCA Distribution of solution consistency Results for 359 solutions from 170 articles (2009-2017) 8 / 18 file:///C:/data/sync/qca/pubbias/text/pubbias_data/ossc_slides.html#1 15/39

  16. 24.1.2019 Publication bias in QCA Distribution of solution consistency Results for 359 solutions from 170 articles (2009-2017) 8 / 18 file:///C:/data/sync/qca/pubbias/text/pubbias_data/ossc_slides.html#1 16/39

  17. 24.1.2019 Publication bias in QCA Caliper test for solution consistency 9 / 18 file:///C:/data/sync/qca/pubbias/text/pubbias_data/ossc_slides.html#1 17/39

  18. 24.1.2019 Publication bias in QCA Caliper test for solution consistency Results for 359 solutions from 170 articles (2009-2017) cutoff range lower upper above below pvalue 0.75 0.05 0.725 0.775 13 3 1.063538e-02 0.75 0.10 0.700 0.800 40 5 3.939192e-08 0.75 0.20 0.650 0.850 93 10 2.599305e-18 9 / 18 file:///C:/data/sync/qca/pubbias/text/pubbias_data/ossc_slides.html#1 18/39

  19. 24.1.2019 Publication bias in QCA Caliper test for solution consistency Results for 359 solutions from 170 articles (2009-2017) cutoff range lower upper above below pvalue 0.75 0.05 0.725 0.775 13 3 1.063538e-02 0.75 0.10 0.700 0.800 40 5 3.939192e-08 0.75 0.20 0.650 0.850 93 10 2.599305e-18 Results for 300 solutions from 50 dissertations (2009-2017) cutoff range lower upper above below pvalue 0.75 0.05 0.725 0.775 15 8 0.1050198078 0.75 0.10 0.700 0.800 33 20 0.0491853242 0.75 0.20 0.650 0.850 67 31 0.0001772669 9 / 18 file:///C:/data/sync/qca/pubbias/text/pubbias_data/ossc_slides.html#1 19/39

  20. 24.1.2019 Publication bias in QCA Should we bother about positive results? 10 / 18 file:///C:/data/sync/qca/pubbias/text/pubbias_data/ossc_slides.html#1 20/39

  21. 24.1.2019 Publication bias in QCA Should we bother about positive results? Exploration/induction vs confirmation/deduction in 170 QCA articles 10 / 18 file:///C:/data/sync/qca/pubbias/text/pubbias_data/ossc_slides.html#1 21/39

  22. 24.1.2019 Publication bias in QCA Should we bother about positive results? Exploration/induction vs confirmation/deduction in 170 QCA articles 10 / 18 file:///C:/data/sync/qca/pubbias/text/pubbias_data/ossc_slides.html#1 22/39

  23. 24.1.2019 Publication bias in QCA Researchers' degrees of freedom in QCA 11 / 18 file:///C:/data/sync/qca/pubbias/text/pubbias_data/ossc_slides.html#1 23/39

  24. 24.1.2019 Publication bias in QCA Researchers' degrees of freedom in QCA 1. Hypotheses 2. Choice of conditions and outcome 11 / 18 file:///C:/data/sync/qca/pubbias/text/pubbias_data/ossc_slides.html#1 24/39

  25. 24.1.2019 Publication bias in QCA Researchers' degrees of freedom in QCA 1. Hypotheses 2. Choice of conditions and outcome 3. Delineation of sample/population 11 / 18 file:///C:/data/sync/qca/pubbias/text/pubbias_data/ossc_slides.html#1 25/39

  26. 24.1.2019 Publication bias in QCA Researchers' degrees of freedom in QCA 1. Hypotheses 2. Choice of conditions and outcome 3. Delineation of sample/population 4. Calibration (anchors, link function) 11 / 18 file:///C:/data/sync/qca/pubbias/text/pubbias_data/ossc_slides.html#1 26/39

  27. 24.1.2019 Publication bias in QCA Researchers' degrees of freedom in QCA 1. Hypotheses 2. Choice of conditions and outcome 3. Delineation of sample/population 4. Calibration (anchors, link function) 5. Truth table parameters (cutoffs, remainder handling) 6. Solution parameters (type, remainder handling) 11 / 18 file:///C:/data/sync/qca/pubbias/text/pubbias_data/ossc_slides.html#1 27/39

  28. 24.1.2019 Publication bias in QCA Degrees of freedom: Sample and optional stopping 12 / 18 file:///C:/data/sync/qca/pubbias/text/pubbias_data/ossc_slides.html#1 28/39

  29. 24.1.2019 Publication bias in QCA Degrees of freedom: Sample and optional stopping 12 / 18 file:///C:/data/sync/qca/pubbias/text/pubbias_data/ossc_slides.html#1 29/39

  30. 24.1.2019 Publication bias in QCA Degrees of freedom: Samples and populations in articles 13 / 18 file:///C:/data/sync/qca/pubbias/text/pubbias_data/ossc_slides.html#1 30/39

  31. 24.1.2019 Publication bias in QCA Degrees of freedom: Samples and populations in articles Flexibility in delineating population (space, time, substance) 13 / 18 file:///C:/data/sync/qca/pubbias/text/pubbias_data/ossc_slides.html#1 31/39

  32. 24.1.2019 Publication bias in QCA Degrees of freedom: Samples and populations in articles Flexibility in delineating population (space, time, substance) Sizeable number of QCA articles use apparent populations or samples 13 / 18 file:///C:/data/sync/qca/pubbias/text/pubbias_data/ossc_slides.html#1 32/39

  33. 24.1.2019 Publication bias in QCA Degrees of freedom: Calibration 14 / 18 file:///C:/data/sync/qca/pubbias/text/pubbias_data/ossc_slides.html#1 33/39

  34. 24.1.2019 Publication bias in QCA Degrees of freedom: Calibration 15 / 18 file:///C:/data/sync/qca/pubbias/text/pubbias_data/ossc_slides.html#1 34/39

  35. 24.1.2019 Publication bias in QCA Opportunity for preregistration 16 / 18 file:///C:/data/sync/qca/pubbias/text/pubbias_data/ossc_slides.html#1 35/39

  36. 24.1.2019 Publication bias in QCA Opportunity for results-blind review 17 / 18 file:///C:/data/sync/qca/pubbias/text/pubbias_data/ossc_slides.html#1 36/39

  37. 24.1.2019 Publication bias in QCA Opportunity for results-blind review Information for judging quality of theory and design in results section? 17 / 18 file:///C:/data/sync/qca/pubbias/text/pubbias_data/ossc_slides.html#1 37/39

Recommend

Publication bias teaching materials The attached slides can be used to teach people about

Publication bias teaching materials The attached slides can be used to teach people about

Publication bias teaching materials The attached slides can be used to teach people about publication bias There are notes beneath the slides with suggestions of how they might be used Prepared by Professor Amanda Burls and

603 views • 28 slides
BIAS What Is Bias? Bias can be defined as favoring one side, position, or belief being

BIAS What Is Bias? Bias can be defined as favoring one side, position, or belief being

BIAS What Is Bias? Bias can be defined as favoring one side, position, or belief being partial or prejudiced Where have you seen bias? Bias vs. Propaganda Bias is prejudice; a preconceived judgment or an opinion formed

717 views • 29 slides
Identification of and correction for publication bias Isaiah Andrews Maximilian Kasy December

Identification of and correction for publication bias Isaiah Andrews Maximilian Kasy December

Identification of and correction for publication bias Isaiah Andrews Maximilian Kasy December 13, 2017 Introduction Fundamental requirement of science: replicability Different researchers should reach same conclusions Methodological

861 views • 50 slides
Asymmetries in Prior Conviction Bias (Presentation Slides, Accompanying Notes to Cowley &

Asymmetries in Prior Conviction Bias (Presentation Slides, Accompanying Notes to Cowley &

See discussions, stats, and author profiles for this publication at: https://www.researchgate.net/publication/332416846 Asymmetries in Prior Conviction Bias (Presentation Slides, Accompanying Notes to Cowley & Colyer, 2010) Article in SSRN

412 views • 22 slides
Adversary presentation and bias in legal decision making Article in Harvard Law Review December

Adversary presentation and bias in legal decision making Article in Harvard Law Review December

See discussions, stats, and author profiles for this publication at: https://www.researchgate.net/publication/258440342 Adversary presentation and bias in legal decision making Article in Harvard Law Review December 1972 CITATIONS READS 6 94

634 views • 18 slides
ICTIR 2016 Slides - The Impact of Fixed-Cost Pooling Strategies on Test Collection Bias

ICTIR 2016 Slides - The Impact of Fixed-Cost Pooling Strategies on Test Collection Bias

See discussions, stats, and author profiles for this publication at: https://www.researchgate.net/publication/308120269 ICTIR 2016 Slides - The Impact of Fixed-Cost Pooling Strategies on Test Collection Bias Presentation September 2016

728 views • 53 slides
Equity & Excellence: Hidden Bias Implicit Bias Inherent Bias

Equity & Excellence: Hidden Bias Implicit Bias Inherent Bias

Equity & Excellence: Hidden Bias Implicit Bias Inherent Bias ____________________________________________ Vincent R. De Lucia Educator-in-Residence Director of Mandatory Training & PD New Jersey School Boards Association Anderson

426 views • 41 slides
bad decision bias? 2 5 6 Affinity Bias: What can we do? 2. 3. 1. Seek

bad decision bias? 2 5 6 Affinity Bias: What can we do? 2. 3. 1. Seek

bad decision bias? 2 5 6 Affinity Bias: What can we do? 2. 3. 1. Seek outputs Compare rather than Be aware performance compentenci not people es 7 9 10 11 12 Unconscious bias refers to a

292 views • 15 slides
BIAS BIAS LIGHT LIGHT & & MEDIUM MEDIUM TR TRUCK UCK TIRES TIRES Bias Bias Ligh

BIAS BIAS LIGHT LIGHT & & MEDIUM MEDIUM TR TRUCK UCK TIRES TIRES Bias Bias Ligh

BIAS BIAS LIGHT LIGHT & & MEDIUM MEDIUM TR TRUCK UCK TIRES TIRES Bias Bias Ligh ight T t Truck / / Trail iler r Ti Tire Si Size No Nome mencla latu ture 9.50-16 9.50 16.5L .5LT/D T/D ST ST 7.00 7.00-15 15 1 10

121 views • 11 slides
Bias in, Bias out: Gender Equality and the Fourth Industrial Revolution Debra Howcroft and

Bias in, Bias out: Gender Equality and the Fourth Industrial Revolution Debra Howcroft and

Bias in, Bias out: Gender Equality and the Fourth Industrial Revolution Debra Howcroft and Jill Rubery Work and Equalities Institute University of Manchester Bias in, bias out: an overview Two parts Identify the methodology

706 views • 21 slides
Expectancy bias and Bias and forensic evidence Bias and speech research forensic speech

Expectancy bias and Bias and forensic evidence Bias and speech research forensic speech

Overview Bias effects Expectancy bias and Bias and forensic evidence Bias and speech research forensic speech research Blind forensic speech research Maartje Schreuder TMFI / Maastricht University I AFPA 2011 Bundeskrim

180 views • 7 slides
Implicit Bias Implicit bias Implicit bias refers to attitudes or stereotypes that affect our

Implicit Bias Implicit bias Implicit bias refers to attitudes or stereotypes that affect our

Implicit Bias Implicit bias Implicit bias refers to attitudes or stereotypes that affect our understanding, actions and decisions in an unconscious manner. It's different from suppressed thoughts we might conceal to keep the peace; it's

634 views • 16 slides
Bias Busting Across the Center: A Model to Interrupt Bias and Promote Inclusion Modeled on

Bias Busting Across the Center: A Model to Interrupt Bias and Promote Inclusion Modeled on

Bias Busting Across the Center: A Model to Interrupt Bias and Promote Inclusion Modeled on Googles BiasBusting@Work and Carnegie Mellons Bias Busters @ CMU Learning Outcomes Understand the role that biases play, positively &

637 views • 34 slides
Review Selection bias, overfitting Bias v. variance v. residual Bias-variance tradeoff

Review Selection bias, overfitting Bias v. variance v. residual Bias-variance tradeoff

Review Selection bias, overfitting Bias v. variance v. residual Bias-variance tradeoff 1 n=1 Cramr-Rao bound n=4 0.8 n=30 0.6 CDF of max of n samples of 0.4 N( =2, 2 =1) 0.2 [representing error estimates for n

517 views • 28 slides
Unconscious Bias: From Awareness to Action! Did you know that we all have unconscious bias, and

Unconscious Bias: From Awareness to Action! Did you know that we all have unconscious bias, and

Unconscious Bias: From Awareness to Action! Did you know that we all have unconscious bias, and that we each have a responsibility to prevent its unintended consequences? In this course, we will explore unconscious bias in the workplace and the

213 views • 5 slides
Bias and Equity Implicit Bias & Health Care Disparities Two sides of the same coin Clinical

Bias and Equity Implicit Bias & Health Care Disparities Two sides of the same coin Clinical

3/2/2018 Implicit Bias, Race and Medical Care We have nothing to disclose Kate Lupton, MD Sarah Schaeffer, MD, MPH University of California, San Francisco Bias and Equity Implicit Bias & Health Care Disparities Two sides of the same

394 views • 11 slides
Transistor bias circuits 1 Objectives Discuss the concept of dc biasing of a transistor for

Transistor bias circuits 1 Objectives Discuss the concept of dc biasing of a transistor for

Chapter 5 Transistor bias circuits 1 Objectives Discuss the concept of dc biasing of a transistor for linear operation Analyze voltage-divider bias, base bias, emitter bias and collector-feedback bias circuits. and collector-feedback

588 views • 31 slides
PVMD Miro Zeman Delft University of Technology P-N Junction under Bias - + V a I I A P N

PVMD Miro Zeman Delft University of Technology P-N Junction under Bias - + V a I I A P N

The Dark J-V Curve PVMD Miro Zeman Delft University of Technology P-N Junction under Bias - + V a I I A P N C I d Anode Cathode Bias Conditions Forward bias Reverse bias J-V Characteristic Shockley equation: Dark J-V

347 views • 5 slides
Hindsight Bias of Juries in Hindsight Bias of Juries in Personal Injury Actions Courtroom

Hindsight Bias of Juries in Hindsight Bias of Juries in Personal Injury Actions Courtroom

Presenting a live 90 minute webinar with interactive Q&A Hindsight Bias of Juries in Hindsight Bias of Juries in Personal Injury Actions Courtroom Strategies to Minimize Negative Effects of Hindsight Bias THURS DAY, AUGUS T 25, 2011 1pm

861 views • 83 slides
Biometric Security Roles & Resources Part 2 BIAS Cathy Tilton Chair, BIAS

Biometric Security Roles & Resources Part 2 BIAS Cathy Tilton Chair, BIAS

Biometric Security Roles & Resources Part 2 BIAS Cathy Tilton Chair, BIAS Integration TC VP, Standards & Emerging Tech, Daon www.oasis-open.org Biometric Identity Assurance Services (BIAS) Biometric Applications

723 views • 34 slides
What We Talk About When We Talk About Bias Library Instruction West 2018 Ryne Leuzinger

What We Talk About When We Talk About Bias Library Instruction West 2018 Ryne Leuzinger

Welcome To What We Talk About When We Talk About Bias Library Instruction West 2018 Ryne Leuzinger rleuzinger@csumb.edu Bandwagon effect Bias blind spot Choice-supportive bias Congruence bias Contrast effect Focusing

702 views • 37 slides
Predicting Min Predicting Min-Bias and the Bias and the Underlying Event at

Predicting Min Predicting Min-Bias and the Bias and the Underlying Event at

Predicting Min Predicting Min-Bias and the Bias and the Underlying Event at the LHC Underlying Event at the LHC Extrapolations from the Tevatron to RHIC and the LHC Rick Field University of Florida Outline of Talk

679 views • 49 slides
pn -junctonJ under dark conditons No Bias Forward Bias Reverse Bias Model - + Circuit P N

pn -junctonJ under dark conditons No Bias Forward Bias Reverse Bias Model - + Circuit P N

2.626/2.627 Lecture 5 (9/22/2011) pn -junctonJ under dark conditons No Bias Forward Bias Reverse Bias Model - + Circuit P N P N P N - + - + E E E p-type n-type p-type n-type p-type n-type Band Diagram x x x e - difusion: e

80 views • 3 slides
Making Generative Classifiers Robust to Selection Bias Andrew Smith Charles Elkan November

Making Generative Classifiers Robust to Selection Bias Andrew Smith Charles Elkan November

Making Generative Classifiers Robust to Selection Bias Andrew Smith Charles Elkan November 30th, 2007 Outline What is selection bias? Types of selection bias. Overcoming learnable bias with weighting. Overcoming bias with

736 views • 59 slides

More recommend