The Implications of Sample-Based Vs. Self- Reported Measures of - PowerPoint PPT Presentation

The Implications of Sample-Based Vs. Self- Reported Measures of Urbanicity Co-authors: Presenter: Kat Devlin & Janell Fetterolf Alexandra Castillo, Ph.D. Research Associates, Global Attitudes Courtney Johnson Research Associate, Global Attitudes Research Associate, Science and Society

Pew Research Center • Established 1996 • Funded by The Pew Charitable Trusts, foundations • Non-profit, non-partisan fact tank in Washington • Since 2001, we have surveyed in 108 countries www.pewresearch.org • • @pewresearch 2

Spring 2018 Global Attitudes Survey • 30,133 interviews conducted from May 14 to August 12, 2018 in 41 languages • Based on telephone and face-to-face interviews with nationally representative samples of adults 18 and older In four European countries (Greece, Hungary, Italy and Poland), both sample- • based and self-reported urbanity were available 4,100 face-to-face interviews conducted from May 25 to July 12, 2018 • The margin of sampling error for the subset of weighted data is ± 4.6% - ± 4.8% • Samples were stratified by urbanity – classified from Eurostat’s DEGURBA • 3

The Importance of Urbanity • Urban-rural divides are growing Macroeconomic trends have led to divided economic opportunities • Choice of living location is tied to political preferences • • In Europe, supporters of right-wing populist parties tend to live in rural areas • Practical data collection implications in phone surveys 4

Comparing Sample-Based Versus Self-Reported Urbanicity 5

Recoding Self-Reported Urbanity % who say __ best describes the area where Collapsing self-reported urbanity into three they live categories A big city 34% Urban 34% The suburbs or 11 outskirts of a big city A town or small city 28 Suburban 40 A country village 25 Rural 27 A farm or home in 2 the countryside 6

Correspondence of Sample-Based And Self-Reported Urbanity Suburban Rural Urban Sample-Based 35% 35% 30% Self-Reported 34 40 27 7

Correspondence of Sample-Based And Self-Reported Urbanity by Country Sample-based Self-reported Suburban Rural Urban 39% 25% 36% -15% +11% Greece 54 14 32 31 37 32 Hungary 30 41 29 -24% 35 48 17 +18% Italy 17 72 11 34 29 37 Poland 34 31 34 8

Discontinuity Between Self-Reported And Sample-Based Urbanity 9

Strong Demographic Similarities between Self-Reported Urbanity Matches And Mismatches • Matches = Those whose self-reported urbanity corresponds with the sample- based measure; Mismatches = Those whose self-reported urbanity diverges from the sample-based measure • Around 30% or fewer cases are mismatches in Greece, Hungary and Poland; 44% of cases are mismatches in Italy • Similar demographic composition of matches and mismatches for self-reported urbanity • Gender • Age Education • Ideology • 10

Discontinuity between Sample-Based and Self-Reported Urbanity % of __ for each level of urbanization Match Mismatch Rural Urban TOTAL Suburban 36% 7% 29% 72% Greece 7 4 17 28 24 27 25 76 Hungary 6 14 4 24 14 39 57 4 Italy 3 33 7 44 28 15 27 71 Poland 30 16 7 7 11

How Urban Mismatches Were Classified by the Sample-Based Measure Mismatches who self-identified as urban were classified by the sample-based measure of urbanity as … Suburb Sub urban an Ru Rural ral Total Total urb urban an mismatches ismatches % % % n Greece 86 14 17 188 Hungary 100 0 6 63 Italy 100 0 3 33 Poland 100 0 7 61 12

How Suburban Mismatches Were Classified by the Sample-Based Measure Mismatches who self-identified as suburban were classified by the sample-based measure of urbanity as … Total Total subu suburb rban an Urba Ur ban Rural Ru ral mismatches ismatches % % % n Greece 35 65 7 85 Hungary 47 53 14 181 Italy 61 39 33 322 Poland 40 60 16 191 13

How Rural Mismatches Were Classified by the Sample-Based Measure Mismatches who self-identified as rural were classified by the sample-based measure of urbanity as … Urba Ur ban Suburb Sub urban an Total Total rura rural l mismatches ismatches % % % n Greece 13 87 4 53 Hungary 0 100 4 35 Italy 6 94 7 67 Poland 4 96 7 57 14

No Gender Differences between Self-Reported Urbanity Matches and Mismatches % of __ by gender Male Female Match 48% 52% Greece 51 49 Mismatch Match 47 53 Hungary 44 56 Mismatch Match 42 58 Italy 49 51 Mismatch Match 46 54 Poland Mismatch 49 51 15

Similar Age Breakdown between Self-Reported Urbanity Matches and Mismatches % of __ by age 18-29 30-49 50+ Match 16% 32% 52% Greece Mismatch 16 37 48 Match 18 37 45 Hungary 15 34 51 Mismatch 16 32 51 Match Italy 16 34 50 Mismatch Match 17 35 48 Poland Mismatch 17 37 47 16

Same Educational Profile between Self-Reported Urbanity Matches and Mismatches % of __ by education Higher education Lower education Match 75% 25% Greece 66 34 Mismatch Match 77 23 Hungary 78 22 Mismatch Match 85 15 Italy 88 12 Mismatch Match 74 26 Poland Mismatch 77 23 17

Demographic Comparisons between Self-Reported And Sample-Based Urbanity 18

Similar Demographic Characteristics between Self-Reported And Sample-Based Measures of Urbanity • The demographic profiles of the self-reported and sampled-based measures of urbanity are very similar across urban, suburban and rural areas • Internet usage • Gender • Age • Education • Ideology 19

Proportionate Internet Usage across The Sample-Based And Self- Reported Measures of Urbanity % who use the internet in __ areas by measures of urbanity Sample-based Self-reported Urban Suburban Rural 80% 74% 57% Greece 78 77 55 Hungary 85 75 62 82 75 63 85 67 69 Italy 88 72 62 75 74 72 Poland 72 78 71 20

Comparable Educational Composition across The Sample-Based And Self-Reported Measures of Urbanity % of rural respondents by levels of education for the __ measure of urbanity Lower education Higher education Sample-Based 87% 13% Greece 90 10 Self-Reported Sample-Based 88 12 Hungary 87 13 Self-Reported Sample-Based 92 8 Italy 84 16 Self-Reported Sample-Based 82 18 Poland Self-Reported 86 14 21

Substantive Patterns Of Public Opinion by Self-Reported And Sample-Based Urbanity 22

Strong Correspondence with Views of The Current Economic Situation across Both Measures of Urbanity % who say the current economic situation is bad in __ areas by measures of urbanity Self-reported Sample-based Urban Suburban Rural 92% 98% 98% Greece 94 97 99 51 47 49 Hungary 52 49 45 83 85 80 Italy +12% 84 82 92 22 25 31 Poland 21 28 29 23

Similar Levels of Confidence in Trump across The Sample-Based And Self-Reported Measures of Urbanity % who have confidence in Trump in __ areas by measures of urbanity Sample-based Self-reported Urban Suburban Rural 18% 13% 19% Greece 14 20 20 Hungary 38 32 33 35 32 37 32 22 33 Italy -12% 20 28 34 37 42 37 Poland 40 37 39 24

Concluding Remarks • Strong relationship between sample-based and self-reported measure of urbanicity, except Italy • The demographic profiles for both measures and mismatches are very similar • There are some notable differences across countries on substantive variables • The self-reported measure warrants further exploration on key variables, such as partisanship 25

Alexandra Castillo, Ph.D. Research Associate, Global Attitudes acastillo@pewresearch.org 26

Roughly Equal Gender Distributions across The Sample-Based And Self- Reported Measures of Urbanity % of rural respondents by gender for the __ measure of urbanity Male Female Sample-Based 52% 48% Greece Self-Reported 51 49 Sample-Based 46 54 Hungary 46 54 Self-Reported Sample-Based 48 52 Italy 49 51 Self-Reported Sample-Based 47 53 Poland 46 54 Self-Reported 27

Similar Age Profiles for Respondents across The Sample-Based And Self-Reported Measures of Urbanity % of urban respondents by age group for the __ measure of urbanity 50+ 30-49 18-29 Sample-Based 22% 36% 43% Greece 19 38 43 Self-Reported Sample-Based 21 38 42 Hungary 20 37 43 Self-Reported Sample-Based 19 34 47 Italy Self-Reported 16 40 43 Sample-Based 21 38 42 Poland Self-Reported 19 37 44 28

Ideological Similarities between Sample-Based And Self-Reported Measures of Urbanity % of urban respondents by ideology for the __ measure of urbanity Left Center Right Sample-Based 24% 38% 38% Greece Self-Reported 23 40 37 Sample-Based 17 26 56 Hungary 15 23 62 Self-Reported Sample-Based 23 45 32 Italy 25 45 30 Self-Reported Sample-Based 25 33 42 Poland 27 35 39 Self-Reported 29

Distribution of Ideological Affiliation Is the Same Across Matches and Mismatches of Self-Reported Urbanity % of __ by ideology Right Left Center Match 21% 43% 37% Greece Mismatch 17 46 37 Match 15 26 59 Hungary 10 29 61 Mismatch Match 24 38 39 Italy 24 36 40 Mismatch Match 19 31 50 Poland 18 36 46 Mismatch 30