RTI International What randomized controlled trials can (and can’t) tell us: Evidence from Egypt and Liberia International Literacy Day Sept 7, 2012 Amber Gove, PhD RTI International agove@rti.org www.rti.org RTI International is a trade name of Research Triangle Institute.
RTI International Program Overview: EGRP and EGRA Plus Component Egypt/GILO EGRP Liberia/EGRA Plus Arabic, attention to differences between English, reinforcement of teacher skills and Language of spoken and classical student oral vocabulary Instruction Instructional Assessment informed initial design, key Assessment informed initial design, gaps in all gap in phonics skills Design Texts and Teacher and student manuals and Teacher and student manuals and materials, materials, existing texts decodables for students to keep Materials Time on Task 25 mins per day (w/in 90 min block) 45 mins per day Initial 10 day training (4 EGRP), monthly Initial 5 day training, intensive monthly Teachers coaching support coaching support Parental education, community meetings Parental education and participation in home Community and literacy strategies, materials for read aloud (20 mins day), Community Support students to use at home meetings, reading competitions, radio shows Impact evaluation; scale up will include Impact evaluation, teacher-administered Assessment and teacher-administered classroom based classroom based assessments and reporting Tracking assessment, home and school context to parents, home and school context data. data, classroom observations for fidelity of Classroom observations for fidelity of implementation implementation
RTI International Results: G2 % Meeting Reading Benchmark Egypt Liberia Baseline Baseline Control Control Final Final Light Treatment Baseline Final Baseline Treatment Full Treatment Baseline Final Final 0% 5% 10% 15% 20% 25% 30% 35% 40% 0% 5% 10% 15% 20% 25% 30% 35% 40% Females Males Total Females Males Total
RTI International RCT or Not: Which aspect of reading improved most? 60 50 2009 Baseline Mean Score 40 2011 Final 30 20 10 0 Control Treatment Control Treatment Control Treatment Control Treatment Control Treatment CLPM CLSPM CWPM CNONWPM ORF
RTI International RCT or Not: Which component was the most effective? Ranking of Impact by Participants Component Ranking Lesson Plans 1 Coach Support 2 Teacher Training 3 Other Materials (books) 4 Reading Competitions 5 Student Report Cards 6 Radio Shows 7 School Report Cards 8
RTI International RCT or Not: Are there differences in coaching effects? Rcgain ORFgain Paula Ryan Michael Carmen Wilson Yasmine Elma Myron Tony Paul Erma Timothy Victoria Isaac Kevin -40 -20 0 20 40 60 80
RTI International Takeaway 2: Instructional Design RCT or Not: Which schools adhered to the program? 60 Oral Reading Fluency Gains 50 40 30 Sometimes 20 Frequently 10 Everyday 0 Repeated Sounded Students Retold a Reading Reading Sounds out words read story in class at home aloud
RTI International RCT or Not: Will the Minister take it to scale? Quality RCT Policy dialogue and • Clearly defined treatment advocacy ? • Representative sample • Transparent • Counterfactual worth testing • Public • Deep understanding of • Social treatment (and • Politically salient implementation variations) • Shared process • Qualitative follow-up and nuanced data Can, under the right conditions, provide a great deal information to inform decisions about scale up.
Recommend
More recommend
