A Systematic Literature Review of QCA in Spatial Sciences Session: - PowerPoint PPT Presentation

Faculty of Spatial Sciences Department of Spatial Planning 13-02-2018 | 1 & Environment 11-04-2018 | 1 A Systematic Literature Review of QCA in Spatial Sciences Session: Closing Debate s.verweij@rug.nl www.stefanverweij.eu @Stefan_Verweij stefanverweij International QCA Summer Workshop, University of Wuppertal, May 28-30, 2018

2 13-02-2018 | 2 What is Spatial Planning? › Spatial Planning System: the methods and approaches used by the public and private sector to influence the organization of people and activities in spaces at various scales (local, regional, national, international) › Spatial Planning: the coordination of policies and practices affecting the socio-spatial organization › Alexander: “there is no planning, only planning practices” Sources: Wikipedia (2018); Alexander (2016)

13-02-2018 | 3 What is Spatial Planning?

4 13-02-2018 | 4 What is Spatial Planning? › Objects (‘what’): people and activities in spaces and the environment at various scales › Context (‘where’): the social-institutional environment of spatial planners’ practices › Tools (‘how’): methods and approaches, including skills and competences, for effective practices › Purpose (‘what for’): much debated; intervening in the public interest? › Spatial Design & Institutional Design Source: adapted from Alexander (2016)

5 13-02-2018 | 5 Spatial Planning Research › Providing input for policy change and institutional-spatial design in order to guide spatial and social developments › In some way or another, this involves comparison - Either between cases… - Or with a framework ultimately built on known examples and previously researched cases › Booth: “the desire to make comparisons [has] been fundamental to research activity in the field of spatial planning” Source: Alexander (2016); Booth (2015)

6 13-02-2018 | 6 Spatial Planning Research › Comparison and transfer of knowledge (case ←→ case & case ←→ existing knowledge) is challenging : - Spatial planning practices and conditions are very context-specific - So how and to what extent do lessons learned transfer to other cases? › Booth: “ the conditions that make a policy or practice work in one place are unlikely to obtain in another” › This is where QCA comes in Source: Booth (2015); Janssen-Jansen et al. (2008)

7 13-02-2018 | 7 C I M Outcome Y Cases 1 1 1 1 ZUID, NOORD, IJSS, SIJT , WEST 1 1 0 C LENT , SCHEL 1 0 1 1 PERK, DELFT 1 0 0 0 WIER 0 1 1 1 BROEK 0 1 0 C WAAL, GOUW 0 0 1 ??? 0 0 0 1 DIEF

8 13-02-2018 | 8 Introducing QCA › Yet little used; errors occurring › Introducing QCA to the Spatial Sciences; educating the new disciplines › How? - Systematic literature review of QCA in SPARD (‘Spatial Planning and Related Disciplines’) Book: Gerrits & Verweij (2018)

9 13-02-2018 | 9 Research Questions 1. When, where, and how is QCA used in SPARD? - Descriptive analysis of QCA-studies in SPARD 2. How does SPARD in those respects compare to other disciplines? - Comparison of QCA-studies in SPARD with larger-n of QCA-studies (e.g., Rihoux et al., 2011; 2013, Seny Kan et al., 2016) 3. What are the ways forward for QCA in spatial planning research? - Analysis of ‘good practices’ in the QCA - studies in SPARD (Schneider & Wagemann, 2010) - Analysis of stated usefulness of QCA

10 13-02-2018 | 10 Method and Data Selecting articles 1. Subject fields in Scopus of ‘Geography, Planning and Development’, ‘Transportation’ and ‘Urban Studies’ (427,255 documents) 2. Limiting: articles, in English, years 1987-2017 (282,267 articles) 3. Limiting: QCA-keywords (349 articles) 4. Selecting (independent coding) only empirical QCA-articles that are actually are in SPARD (33 articles) Coding articles › Independent coding using coding scheme based on previous literature reviews Keywords based on: Seny Kan et al. (2016); Gerrits & Verweij (2016; 2018)

11 13-02-2018 | 11 RQ1: Variants of QCA

12 13-02-2018 | 12 RQ1: Disciplines and UoA

13 13-02-2018 | 13 RQ1: Data Sources

14 13-02-2018 | 14 RQ1: Cases and Conditions Tab le 2: Div e rs ity o f c as e s a nd c o nditio ns in the QCA-s tudie s Co nditio ns To tal Few ≤ 4 Many >4 5 (45%) 8 applications (24%) 7 applications (21 %) 1 Few ≤ 20 15 applications (33%) 8 applications (17%) 23 (50%) Cas e s 8 (55%) 6 applications (1 8%) 1 2 applications (36%) 1 Many >20 8 applications (17%) 15 applications (33%) 23 (50%) 4 (42%) 00%) 1 1 9 (58%) 33 (1 To tal 23 (50%) 23 (50%) 46 (100%) ş

é ‘ ’ 15 13-02-2018 | 15 RQ1: Software & Visualization Fig ure 3: S o ftw are us e and v is ualizatio n o f re s ults in the QCA-s tudie s S oftware Visualization 16 30 14 25 12 10 20 8 15 6 4 10 2 5 0 0 Regular XY-plot Formula Flow No table diagram results ‘ ’ í

16 13-02-2018 | 16 RQ2: Comparison Disciplines su b c a t e g o r y ‘ r e g i o n a l / su b n a t i o n a l ’ i s › SPARD largely in line with larger population d i f f e r e n t r e se a r c h d i sc i p l i n e s’ f o c i › Differences regarding the units of analysis Table 3: Units o f a naly s is in QCA-s tudie s ac ro s s dis c ip line s To tal Public Po lic y Manag e m e nt S tudie s S PARD (Riho ux e t al., 2013) (Riho ux e t al., 2011) (S e ny Kan e t al., 2016) (this s tudy ) 92% Macro (total) 49% 1 6% 52% Transnational 6% 12% Country 55% 16% 12% Regional/subnational 31% 28% Meso (total) 21 % 6% 31 % 27% Organization 6% 31% 12% Project 15% Micro (total) 21 % 2% 29% 21 % Other 24% Total 91 % 1 00% 1 00% 1 00% N=313 N=143 N=95 N=33 p p l i c a t i o n s wi t h f e w c o n d i t i o n s ( ฀ 4 ) a n d m a n y c a se s ฀ ( ฀ 4 )

17 13-02-2018 | 17 RQ3: Good Practices › Often unclear which analytical choices have been made  discussion: instigating good practices; how? Tab le 4: As s e s s m e nt o f g o o d prac tic e s in the QCA-s tud ie s (N=33) Adhe re d to the g o o d prac tic e ? Go o d Prac tic e s Ye s S o m e w hat No The case selection should be explicitly detailed and the scope conditions should be clear 67% 15% 18% The calibration of case ’ s scores should be explicitly detailed 70% 15% 15% The appropriate terminology should be used 70% 9% 21% The analysis of necessity should be conducted separately and before the truth table analysis 39% 3% 58% The choice for consistency and coverage scores should be supported with arguments 48% 9% 42% The various solution formulas from the truth table analysis (complex, intermediate, 24% 3% 73% parsimonious) should be reported The outcome and non-outcome should be dealt with in separate truth table analyses 9 55% – 45% The raw data matrix should be reported 33% 36% 30% The truth table should be reported 58% 6% 36% The consistency and coverage measures for the results should be reported 79% – 21%

18 13-02-2018 | 18 RQ3: Stated Usefulness › QCA is sensitive to context (N=10) › QCA enables small-n and bridging qualitative- quantitative gap (N=14) › QCA enables studying complex wholes (N=21): conjunctural causation, asymmetry, complexity theory

19 13-02-2018 | 19 Discussion › Getting it right: ensuring good QCA-practices in new areas of application - Good practices: which are they? - Transparency in articles with tight word limits about analytical choices - Calibration of qualitative data (recently: De Block & Vis) › Addressing time and dynamics with QCA › Areas of applications: applying QCA in evaluation practice (the world of policy making )