The Challenges of Implementing the China Implementing the China - PowerPoint PPT Presentation

The Challenges of Implementing the China Implementing the China Family Panel Study (CFPS) JiaHui Yao Gina Qian Cheung Gina-Qian Cheung Youhong Liu IBUC 2010, Baltimore Survey Research Operations  Survey Research Center  Institute for Social Research

Overview Overview • Introduction Introduction • CFPS CAPI Sample Management • CFPS Blaise Instruments CFPS Bl i I t t • Challenges • Summary 11/3/2010 SRO  SRC  ISR 2 13th International Blaise Users Conference

Induction Induction • CFPS is China’s first nation wide panel CFPS is China s first nation wide panel survey with comprehensive research design design • 2008 Summer paper questionnaire pilot • 2009 Summer CAPI follow up pilot 2009 S CAPI f ll il t • 2010 Summer baseline data collection production 11/3/2010 SRO  SRC  ISR 3 13th International Blaise Users Conference

Background (1) Background (1) • 2008 paper questionnaire pilot: 2008 paper questionnaire pilot:  2375 households in three cities and province in China: Beijing, Shanghai, and Guangdong in China: Beijing, Shanghai, and Guangdong  2375 family Qs + about 8,000 around individual Qs who ware from age 1 to 80 + 95 Q g community Qs  “China Report” has been published by using p p y g the pilot which has been submitted to the China State Council 11/3/2010 SRO  SRC  ISR 4 13th International Blaise Users Conference

Background (2) Background (2) • 2009 Summer CAPI follow up pilot 2009 Summer CAPI follow up pilot  Re-interview 2008 families and all the individuals, no communities individuals, no communities  New move in and move out from the family, no re-interview will conducted  First time using SurveyTrak and Blaise… 11/3/2010 SRO  SRC  ISR 5 13th International Blaise Users Conference

Background (3) Background (3) • 2010 main data collection 2010 main data collection  Cover 25 provinces, 160 counties in rural and districts in urban, 640 villages in rural and districts in urban, 640 villages in rural and neighborhood communities  The 25 Provinces cover 95% of the total population in China  The Qs will reach 16,000 households and 56,000 individuals from age 0 to 80 11/3/2010 SRO  SRC  ISR 6 13th International Blaise Users Conference

CFPS CAPI Management System CFPS CAPI Management System • Used University of Michigan SurveyTrak Used University of Michigan SurveyTrak system as base • Translated all the interface screen from • Translated all the interface screen from English to Chinese • Added more functions which is suitable to Add d f ti hi h i it bl t the data collection environment in China • Created full training procedures for Chinese field interviewers 11/3/2010 SRO  SRC  ISR 7 13th International Blaise Users Conference

SurveyTrak in English SurveyTrak in English 11/3/2010 SRO  SRC  ISR 8 Conference Title

SurveyTrak in Chinese SurveyTrak in Chinese 11/3/2010 SRO  SRC  ISR 9 Conference Title

CFPS Blaise Instruments CFPS Blaise Instruments • 6 interview questionnaires: 6 interview questionnaires:  Screening  Family Member Confirmation  Family Member Confirmation  Family  Community  Community  Adult  Child Child • 1 observation questionnaire 11/3/2010 SRO  SRC  ISR 10 13th International Blaise Users Conference

11 13th International Blaise Users Conference 11/3/2010 SRO  SRC  ISR

Challenges Challenges • Study Design and Operation Challenges Study Design and Operation Challenges  Family level of survey with five subprojects  Add more functions needed for China  Add more functions needed for China production environment  Math and word testing with randomly Math and word testing with randomly assigned to respondents • Technical Challenges Technical Challenges  Different Database software for SurveyTrak  Blaise Transition (not just questionnaire)  Blaise Transition (not just questionnaire) 11/3/2010 SRO  SRC  ISR 12 13th International Blaise Users Conference

Blaise in Chinese Blaise in Chinese • Set up the Blaise Chinese Environment so Set up the Blaise Chinese Environment so that Chinese can be displayed right • Translation Blaise system text to Chinese • Translation Blaise system text to Chinese • Test, test, test… in Chinese 11/3/2010 SRO  SRC  ISR 13 13th International Blaise Users Conference

14 13th International Blaise Users Conference 11/3/2010 SRO  SRC  ISR

15 13th International Blaise Users Conference 11/3/2010 SRO  SRC  ISR

BlaiseIS for CFPS BlaiseIS for CFPS • Data Verification Data Verification • Sample Address maintenance • Both systems are not truly “Web Survey”, they are internal systems for management needs. 11/3/2010 SRO  SRC  ISR 16 13th International Blaise Users Conference

Outcome for CFPS Outcome for CFPS • 2010 Production started on April 3 rd 2010 2010 Production started on April 3 , 2010 • 2010 Production ended on September 25, 2010 (with some area needed to go back 2010 (with some area needed to go back in late fall or early months of 2011.) 11/3/2010 SRO  SRC  ISR 17 13th International Blaise Users Conference

The Numbers are impressive! The Numbers are impressive! Screening Survey Screening Survey 14806 14806 Family Confirmation Survey 14221 Family Survey 14097 Adult Survey Adult Survey 31861 31861 Child Survey 8727 Community Survey 586 Total cases completed 84298 Total cases completed 84 98 11/3/2010 SRO  SRC  ISR 18 13th International Blaise Users Conference

The Rates The Rates… • Response Rate Response Rate 80.00% 80.00% • Cooperate Rate 98.17% • Refusal Rate Refusal Rate 1 13% 1.13% • Contact Rate 1.49% 11/3/2010 SRO  SRC  ISR 19 13th International Blaise Users Conference

Summary Summary • It was great collaborative work! It was great collaborative work! • We wished that we had Blaise NG (Roger: you heard us ‐  ) • Any Sample/Case management is a business oriented system it must reflect business oriented system, it must reflect an organization's business vision and decisions. (Vese: let us continue to discuss this) decisions (Vese: let us continue to discuss this) • IBUC needs to go to China soon! (Hilde what do you think? come on!) (Hilde, what do you think? come on!) 11/3/2010 SRO  SRC  ISR 20 13th International Blaise Users Conference

Thank you! Thank you! Qianyang@umich.edu 11/3/2010 11/3/2010 13th International Blaise Users Conference Survey Research Operations  Survey Research Center  Institute for Social Research 21