Based on the publication of the same name published in BMJ Global - PowerPoint PPT Presentation

Based on the publication of the same name published in BMJ Global Health. David Evans | 22 July 2020 | @DaveEvansPhD

• At its height, more than 1.5 billion learners affected by school closures. Source: UNESCO, “ COVID-19 Impact on Education ” David Evans | 22 July 2020 | @DaveEvansPhD

• At its height, more than 1.5 billion learners affected by school closures. • Even now, more than 1 billion learners continue out of school. Source: UNESCO, “ COVID-19 Impact on Education ” David Evans | 22 July 2020 | @DaveEvansPhD

Source: CGD COVID-19 Education Tracker David Evans | 22 July 2020 | @DaveEvansPhD

David Evans | 22 July 2020 | @DaveEvansPhD

Phone-based learning assessments in Botswana showed a similar distribution of skills to face-to-face assessments a few months earlier. David Evans | 22 July 2020 | @DaveEvansPhD

Face-to-face oral Piloting phone- Household assessments in based surveys in Botswana, the assessments in various Gambia, Botswana countries Kenya, Sierra Leone, etc. David Evans | 22 July 2020 | @DaveEvansPhD

1. Protect children. 2. Test the reliability and validity of your measures. 3. Keep instructions simple and use 4. Some assessments will be more practice items to ensure that respondents conducive to phone assessment than understand the exercise. others. 5. Keep it short. 6. Experiment with how to get people to pick up the phone. 7. Establish rapport with adult phone 8. Choose the most cost-effective owners and youth respondents. approach. 9. Account for sample bias. 10. Learn and document David Evans | 22 July 2020 | @DaveEvansPhD

Lesson 1: Protect Children Lesson 2: Test measures • • Consent Item analysis • • Low stakes Ideally validate against face-to-face measures • Supervise David Evans | 22 July 2020 | @DaveEvansPhD

Lesson 3: Simple instructions Lesson 4: Use what has the best chance of working • Phone assessments bundle • receptive language skills with Word problems from EGMA whatever you want to test have only oral stimuli • • Keep it simple Text something to students • Practice David Evans | 22 July 2020 | @DaveEvansPhD

Lesson 5: Keep it short Lesson 6: Get people on the phone • Early Grade Reading Assessment: 15 minutes • Text, then call: Botswana, India, • Botswana: 15-20 minutes Liberia • Half of that is logistics David Evans | 22 July 2020 | @DaveEvansPhD

Lesson 7: Establish rapport Lesson 8: Be cost-effective • • Advance call only with the Cheaper than face-to-face adult • Interactive voice response • Initial instructions through calls (IVR)? • caregiver Rapport • Logistics • Dependent on age and culture David Evans | 22 July 2020 | @DaveEvansPhD

Lesson 9: Beware of sample bias For the future: Learn and document • Document who responds • Many are trying phone-based • Find non-responders assessment creatively • This will be a massive waste if we don’t learn from it and document it David Evans | 22 July 2020 | @DaveEvansPhD

Available here Available here David Evans | 22 July 2020 | @DaveEvansPhD