Development of an Integra ated CARI Interactive Data Access System - PowerPoint PPT Presentation

Development of an Integra ated CARI Interactive Data Access System for th e US Census Bureau Mai Nguyen, M. Rita Thissen, Ch hristopher Siege, Sandhya Bikmal RTI Inter RTI I t rnational ti l 2010 International Bla ise User’s Conference B lti Baltimo ore, MD MD www.rti.org RTI International is a trade name of Research Triangle Institute

Development of the C CARI Interactive D Data Access System A S m • CARI Interactive Data Acc cess System overview • Coding workflow • Data flow • System integration y g 2 www.rti.org

Census Bureau Cont Census Bureau Cont text text • Implemented CARI* using Blaise 4.8.2 • Want to do behavior codin ng using CARI files for the g g ACS Content Test, starting g early 2011 • CATI and CAPI sources • System must be integrated d with current Census Bureau infrastructure for d data loading and g authentication • Quality assurance coding y g sometime in future * Computer Audio Recorded Interview Computer Audio Recorded Interview wing wing 3 3 www.rti.org

CARI Interactive Dat a Access System Overview O i Web-based CARI data ac ccess system • Behavior coding Beha ior coding • Quality assurance coding • Online training • Automated assessment too ol for user feedback • Tools for integration with Ce ensus Bureau infrastructure • Coaching Component (201 0 – 2012) 4 www.rti.org

Workflow for Behavio Workflow for Behavio or & QA Coding or & QA Coding • Create new survey entry a and user accounts • Configure and assign staff f to the survey • Load data into the system • Assign cases to sites and coders • Conduct coding • Monitor coding progress • Data extraction and close- -out 5 www.rti.org

User Roles User Roles • System roles – System Administrator – Security Administrator S – Site Administrator • Survey roles • Survey roles – Research Manager – Headquarters Staff q – Supervisor – Coder 6 www.rti.org

Web Pages by Roles Web Pages by Roles Research Manag ger and HQ Role • Survey Configuration y g Supervisor Role p • Assign Cases To Sites Coder Role • Assign Staf ff To Survey • Review Recordings • View Staff W View Staff W Workload Workload • Query Data Query Data • Login • Assign Cas ses To Staff • Extract Data • Select Survey • Restart Cas ses • Set Sampling Rates • Coding Workload g • Reports • Reports • Manage Case Sampling • Manage Case Sampling • Case Coding ― Media Player ― Image Viewing Image Viewing ― Notes 7 www.rti.org

Coding Workflow Coding Workflow System Administrators • – Create new surveys & user acco ounts – Load survey data y – Close out Research Managers • – Configure behavior and QA code Configure behavior and QA code es es – Assign cases to sites – Monitor progress S Supervisors i • – Assign cases to coders – Monitor progress Coders • – Coding cases 8 www.rti.org

Behavior Coding Pag Behavior Coding Pag ge ge Case Data Links to Blaise audio Cases file and captured image file and captured image Blaise Instrument Questions Behavior Codes A dio Pla er Audio Player Selected Codes Captured Blaise Case Notes Screen 9 9 www.rti.org

Data Flow Overview Data Flow Overview 10 10 www.rti.org

System Integration System Integration • LDAP* – User authentication • Master Control System (M MCS) – Import survey data, Blaise a audio files & captured Blaise screen images screen images • Data extraction – Reports epo ts – Analysis * Lightweight Directory Access Protocol Lightweight Directory Access Protocol 11 11 www.rti.org

Loading Survey Data Loading Survey Data a - What a What • Case’s paradata – Case ID – Question ID Question ID – Interviewer ID – Interview mode – Language – etc • Blaise audio files • Blaise audio files • Blaise captured screen im ages • Survey data can be loaded Survey data can be loaded d all-at-once or on a flow d all at once or on a flow basis 12 12 www.rti.org

Loading Survey Data Loading Survey Data a - How a How File-based interface • – Eliminate dependency – Freedom of implementation Freedom of implementation choices – Easy maintenance Oracle e ternal tables Oracle external tables • – Treat data files like a table – Handle Blaise audio files and captured images as part of binary large-objects (BLOBs) – Improve performance compared to other alternatives 13 13 www.rti.org

Data Extract Data Extract Coding data & notes • Multiple formats • – Excel – Excel – SAS 14 14 www.rti.org

Contact Info Contact Info Mai Ng Mai Nguyen en Rita Thissen Rita Thissen 919-541-6108 919-485-7728 mnguyen@rti.org rthissen@rti.org Chris Siege Sandhya Bikmal 919-485-5605 919-386-0502 csiege@rti org csiege@rti.org sbikmal@rti.org sbikmal@rti org 15 15 www.rti.org