IT ACTIVITIES ORIENTED TO THE DATA IT ACTIVITIES ORIENTED TO THE - PowerPoint PPT Presentation

IT ACTIVITIES ORIENTED TO THE DATA IT ACTIVITIES ORIENTED TO THE DATA PROCESS OPTIMIZATION IN THE PROCESS OPTIMIZATION IN THE SPANISH LFS SPANISH LFS Information and Communication Technologies Directorate Jorge Velasco May 2012

Background Background � The deadline of delivery of the quarterly LFS file to The deadline of delivery of the quarterly LFS file to � Eurostat is 12 weeks after the end of the reference is 12 weeks after the end of the reference Eurostat 1 . Background period. period. � Spanish Spanish National National Statistics Statistics Institute Institute (INE) (INE) publishes publishes 2. Data � Collection Stage the results results of of the the Spanish Spanish LFS a LFS a month month after after the the end end the of the the quarter quarter of 3. Data Process Stage 2

3 Timeliness Timeliness

Key points Key points � There are several factors that contribute to this short There are several factors that contribute to this short � time of data dissemination, and the optimization of the optimization of the time of data dissemination, and the 1 . Background technological processes is one amongst them: is one amongst them: technological processes � Commitment to do it Commitment to do it � 2. Data Collection Stage � Timing and organization of the fieldwork to ensure a Timing and organization of the fieldwork to ensure a � suitable pace in data collection suitable pace in data collection � Availability of population figures for weighting in time Availability of population figures for weighting in time � 3. Data Process Stage � ... ... � � Optimization of the technological processes Optimization of the technological processes � 4

Optimization of the technological Optimization of the technological processes processes � At the At the data collection stage data collection stage � 1 . Background � � � Different factors and actions from the Different factors and actions from the � technological viewpoint that allow the early early technological viewpoint that allow the 2. Data disposal with quality with quality of the data of the data at the next stage in at the next stage in disposal Collection Stage the survey process, the data process the survey process, the data process 3. Data Process � � � Leads to data process optimization Leads to data process optimization Stage � � � � Leads to short time of data dissemination Leads to short time of data dissemination � 5

Optimization of the technological Optimization of the technological processes processes � If the data is collected with the required quality and on If the data is collected with the required quality and on � time, the continuity of the survey process transfers to time, the continuity of the survey process transfers to 1 . Background having available a contrasted and fault tolerant Data Data having available a contrasted and fault tolerant Process Stage Process Stage 2. Data Collection Stage 3. Data Process Stage 6

7

2.Optimization of the technological 2.Optimization of the technological processes- processes - DATA COLLECTION STAGE DATA COLLECTION STAGE � Factors and activities at the Factors and activities at the data collection stage data collection stage : : � 1. Background � 2.1.Using an electronic questionnaire 2.1.Using an electronic questionnaire � � 2.2.Technological Processes 2.2.Technological Processes � 2 . Data Collection Stage � 2.3.Effective field work application. Organization and 2.3.Effective field work application. Organization and � monitoring of field work monitoring of field work 3. Data Process Stage � 2.4.Weekly download 2.4.Weekly download � � 2.5.Collection and data delivery schedule 2.5.Collection and data delivery schedule � 8

2.Optimization of the technological 2.Optimization of the technological processes- processes - DATA COLLECTION STAGE DATA COLLECTION STAGE � Factors and activities at the Factors and activities at the data collection stage data collection stage : : � 1. Background � 2.1.Using an electronic questionnaire 2.1.Using an electronic questionnaire � � 2.2.Technological Processes 2.2.Technological Processes � 2 . Data Collection Stage � 2.3.Effective field work application. Organization and 2.3.Effective field work application. Organization and � monitoring of field work monitoring of field work 3. Data Process Stage � 2.4.Weekly download 2.4.Weekly download � � 2.5.Collection and data delivery schedule 2.5.Collection and data delivery schedule � 9

2.1.Using an electronic questionnaire 2.1.Using an electronic questionnaire � CAPI method for the first interview and CATI for second CAPI method for the first interview and CATI for second � and subsequent and subsequent � The use of an electronic questionnaire ensures the The use of an electronic questionnaire ensures the 1. � Background quality of the information collected, because it includes quality of the information collected, because it includes online rules for inconsistency and flow validations while online rules for inconsistency and flow validations while collection. collection. 2 . Data Collection � � � data received for data process are already pre data received for data process are already pre- - Stage � depurated depurated � � � reduces data process time as there are fewer errors reduces data process time as there are fewer errors � 3. Data to be debugged to be debugged Process Stage 10

Collecting flow data Collecting flow data Provincial Delegations/ CATI Centers Provincial Delegations/ CAPI Centers 1. Background Delayed data transfer ADSL Real-time data transfer 2 . Data Collection Stage Intranet INE 3. Data Process Stage Centralized Treatment databases Headquarters for imputation (Consolidation databases) and debugging 11

The centralized data processing in the Labour Force Survey has two purposes: The centralized data processing in the Labour Force Survey has t wo purposes: � � a) Debug data Debug data . . a) � Debugging in some cases is to get to the truth in the correction Debugging in some cases is to get to the truth in the correction, as in the , as in the � case of certain demographic variables (eg age), as these data ar case of certain demographic variables (eg age), as these data are essential e essential for the proper performance of the survey. for the proper performance of the survey. � In other cases debugging purely searches to leave the data consi In other cases debugging purely searches to leave the data consistent of stent of � each dwelling and the persons who compose it, without trying to get to the get to the each dwelling and the persons who compose it, without trying to real correction. real correction. � It is divided into Manual and automatic debugging It is divided into Manual and automatic debugging � � � b) Obtain a final file Obtain a final file capable of being exploited. For that, we add to the original capable of being exploited. For that, we add to the original b) data all the necessary elements, such as raising factors, the digit of stratum, git of stratum, data all the necessary elements, such as raising factors, the di derived variables, etc.. derived variables, etc.. 12

Using an electronic questionnaire Using an electronic questionnaire 13

2.Optimization of the technological 2.Optimization of the technological processes- processes -DATA COLLECTION STAGE DATA COLLECTION STAGE � Factors and activities at the Factors and activities at the data collection stage data collection stage : : � 1. Background � 2.1.Using an electronic questionnaire 2.1.Using an electronic questionnaire � � 2.2.Technological Processes 2.2.Technological Processes � 2 . Data Collection Stage � 2.3.Effective field work application. Organization and 2.3.Effective field work application. Organization and � monitoring of field work monitoring of field work 3. Data Process Stage � 2.4.Weekly download 2.4.Weekly download � � 2.5.Collection and data delivery schedule 2.5.Collection and data delivery schedule � 14

2.2. Technological Processes Technological Processes 2.2. � Customized organization of the technological Customized organization of the technological � processes in the collection stage processes in the collection stage � The system ensures business continuity at a The system ensures business continuity at a 1. � Background � database database- -application application- -communications level communications level � � Security is ensured in several stages Security is ensured in several stages � 2 . Data � Login the collection application Login the collection application � Collection Stage � Login the interviewers Login the interviewers’ ’ tablets tablets � � Data sending Data sending � � Intranet Intranet � 3. Data Process Stage � Process and infraestructure are continously monitored Process and infraestructure are continously monitored � and there is a maintenance support and there is a maintenance support � Strict policy of backups, both in Delegation servers and Strict policy of backups, both in Delegation servers and � tablets and in Central Services tablets and in Central Services 15