Multinational cognitive interviewing project evaluating UNICEF - PowerPoint PPT Presentation

Multinational cognitive interviewing project evaluating UNICEF questionnaire J. Brent Vickers, PhD Behavioral Scientist, National Center for Health Statistics (NCHS) Collaborating Center for Question Design and Evaluation Research (CCQDER) DC AAPOR July 12, 2019

UNICEF Module for Inclusive Education Kazakhstan Cambodia

UNICEF Module for Inclusive Education  Universal, one set of questions for translation  3 domains • General attitudes (all respondents) • School Environment (respondents with children in school) • Out-of-school barriers (respondents with children out of school)

Cambodia  Country Country Respondents School-Environ. Out-of-School  Respondents Cambodia 69 46 23  In-School  Out-of-School  Cambodia  69  46  23  Kazakhstan  57  39  18

Kazakhstan Country Respondents School Environ. Out-of-School Cambodia 69 46 23 Kazakhstan 57 39 18

Issue 1: Confusing Question Structures A TTITUDES I WOULD LIKE TO ASK YOU SOME QUESTIONS ABOUT SCHOOLING . AT1. D O YOU BELIEVE THAT ALL CHILDREN HAVE THE Yes............................................................... 1 RIGHT TO GO TO SCHOOL ? No ................................................................ 2 DK ................................................................ 9 AT2. U NDER WHICH OF THE FOLLOWING CONDITIONS DO Yes No The child may be physically harmed YOU THINK IT IS ACCEPTABLE FOR A CHILD TO NOT ATTEND SCHOOL ? or teased at school or on the way to/from school …………………………………….. 1 2 1. 2 Questions per question The child may physically harm or tease other children at school……………….… 1 2 The child needs to work or help at home ……………………………………… 1 2 2. Question in negative The child is married/is getting married ..1 2 The child is too old ……………………… .1 2 manner The child has physical or learning needs that the school cannot meet ………… . …1 2 The child is unable to learn …………......1 2 Education is too costly ………….……… .1 2 Other ………………………………….… ...1 2 AT3. D O YOU THINK THAT CHILDREN WITH DISABILITIES Yes............................................................... 1 SHOULD ONLY GO TO SPECIAL SCHOOLS FOR THOSE WITH DISABILITIES ? It depends .................................................... 2 3  SE1 No ................................................................ 3 9  SE1 DK ................................................................ 9

Confused Respondents  This does happen to children AT2-2 UNDER WHICH OF THE FOLLOWING CONDITIONS DO YOU THINK IT IS ACCEPTABLE FOR A CHILD TO NOT ATTEND SCHOOL? The child may physically harm or tease other children at school Answer: YES Notes: Ch said that kids may have quarrel or fighting with their classmates

Confused Respondents  This happens to MY child AT2-2 UNDER WHICH OF THE FOLLOWING CONDITIONS DO YOU THINK IT IS ACCEPTABLE FOR A CHILD TO NOT ATTEND SCHOOL? The child may physically harmed or teased by children at school or on the way to or from school Answer : NO Notes: H says, " the school is 2 Km away from her home."

Revised Questions: Kazakhstan D O YOU THINK IT WOULD BE OK TO KEEP A CHILD FROM GOING TO SCHOOL … Direct and AT2. I F A CHILD MAY BE HARMED OR TEASED AT Yes .............................................................. 1 conversational SCHOOL ? No ................................................................ 2 DK / Not sure .............................................. 9 AT3. H OW ABOUT IF A CHILD MAY HARM OR TEASE Yes .............................................................. 1 OTHER CHILDREN AT SCHOOL ? No ................................................................ 2 DK / Not sure .............................................. 9 Single question AT4. W HAT ABOUT IF A CHILD NEEDS TO WORK OR HELP Yes .............................................................. 1 AT HOME ? No ................................................................ 2 structure DK / Not sure .............................................. 9 D O YOU THINK IT WOULD BE OK TO KEEP A CHILD FROM GOING TO SCHOOL … Yes .............................................................. 1 No ................................................................ 2 AT5. I F A CHILD IS MARRIED OR GETTING MARRIED ? DK / Not sure .............................................. 9 Positive manner AT6. H OW ABOUT IF A CHILD IS TOO OLD ? Yes .............................................................. 1 No ................................................................ 2 DK / Not sure .............................................. 9 AT7. W HAT ABOUT IF A CHILD IS UNABLE TO LEARN ? Yes .............................................................. 1 No ................................................................ 2 DK / Not sure .............................................. 9

Issue 2: Community-specific questions OS4. I T IS UNSAFE FOR (name ) TO BE IN SCHOOL Yes............................................................... 1 No ................................................................ 2 DK ................................................................ 9 OS5. S CHOOL IS TOO FAR AWAY Yes............................................................... 1 No ................................................................ 2 DK ................................................................ 9 OS6. N O ONE AVAILABLE TO TRAVEL WITH (name ) Yes............................................................... 1 TO / FROM SCHOOL No ................................................................ 2 DK ................................................................ 9 OS7. T RANSPORT SERVICES ARE INADEQUATE Yes............................................................... 1 No ................................................................ 2 DK ................................................................ 9 OS8. T HE SCHOOL DID NOT HAVE CAPACITY TO ACCEPT Yes............................................................... 1 MORE STUDENTS BECAUSE IT WAS FULL No ................................................................ 2 DK ................................................................ 9 OS9. S CHOOL ’ S APPROACH CONFLICTS WITH OUR Yes............................................................... 1 BELIEFS No ................................................................ 2 DK ................................................................ 9 OS10. T HERE ARE NO FEMALE TEACHERS AT SCHOOL Yes............................................................... 1 No ................................................................ 2 DK ................................................................ 9 OS11. W E CANNOT SEND ( name ) TO SCHOOL DUE TO Yes............................................................... 1 SOCIAL UNREST / INSTABILITY No ................................................................ 2 DK ................................................................ 9

Confused Respondents OS9. School’s approach conflicts with our beliefs Answer: Yes Notes: "Teachers don't pay much attention to the children. Some students transfer to other schools; some children fight each other. However, it is good to study at Preahdak primary school as there are many students studying there. One of my younger sister's child has just transferred to this school too." Answer: Yes Notes: It is strange what I believe with school because in that school beliefs with Buddhism.

Confused Respondents OS11. We cannot send (name) to school due to social unrest/instability Answer: No Notes: She said that teachers come to school in the morning and afternoon so there is no instability. Answer: DK Notes: She said that she does not know because she cannot take her kid to school every day Answer: Yes Notes: She answered "yes" but gave the explanation that her granddaughter is lazy, and that she cannot catch up with lessons. She did not relate this question to society unrest.