1 st FLIP Event 18 th ‐ 19 th of June 2018 Paris
INTRODUCTION Thierry Rocher Office of Student Assessment, DEPP FLIP in brief • Participants • Agenda • Housekeeping • First FLIP Event 18 th ‐ 19 th of June 2018, Paris
Introduction: FLIP in brief Context: • Transition of national assessments from paper ‐ based to e ‐ assessment • Demand for very ‐ large ‐ scale assessments • Interest in technology enhanced assessments • Integration of assessment and learning ‘FLIP’ acronym: F rance ‐ L uxembourg ‐ I taly ‐ P ortugal 1st meeting: January 2017, Rome New member: CAEd from B razil Interest from: Sweden, Japan, Denmark, NY Dept of Education, Canada ‐ Québec, ... First FLIP Event 18 th ‐ 19 th of June 2018, Paris
Introduction: FLIP in brief A collaborative framework Three axes (SHARING): • Sharing knowledge and experiences in e ‐ assessment Sharing IT development costs Sharing content Two principles (OPEN): • Open ‐ source Open standards Event Goal: building collaboration and roadmap First FLIP Event 18 th ‐ 19 th of June 2018, Paris
Introduction: participants Country Institution Brazil Caed/Ufjf ‐ Centro de Políticas Públicas e Avaliação da Educação da Universidade Federal de Juiz de Fora Denmark Aarhus University Aalborg University France CCIP ‐ Chambre de Commerce et d’Industrie de Paris Idf Participants DSI Lille – Direction Service Informatique Lille DEPP ‐ Direction de l’évaluation, de la prospective et de la performance Germany IEA ‐ International Association for the Evaluation of Educational Achievement ‐ Data Processing Center Italy INVALSI ‐ Istituto nazionale per la valutazione del sistema educativo di istruzione e di formazione Japan NIER ‐ National Institute for Educational Policy Research NIAD ‐ QE ‐ National Institute for Academic Degree and Quality Enhancement of Higer Education First FLIP Event 18 th ‐ 19 th of June 2018, Paris
Introduction: participants Country Institution Kyrgyz Republic Ministry of education and science UNICEF Lithuania National Examination Centre Participants Luxembourg MENJE ‐ SCRIPT ‐ Service de Coordination de la Recherche et de l´Innovation pédagogiques et technologiques University of Luxembourg Morocco INE ‐ Institut national d’évaluation Norway Norwegian Directorate for Education and Training Portugal IAVE ‐ Instituto de avaliação educativa, I.P. UK NFER – National Foundation for Educational Research First FLIP Event 18 th ‐ 19 th of June 2018, Paris
Introduction: participants Country Institution Egypt Ministry of education Apologies Poland Educational Research Institute Canada ‐ Québec Ministère de l'Éducation et de l'Enseignement supérieur Sweden Skolverket United states New ‐ York City Department of Education First FLIP Event 18 th ‐ 19 th of June 2018, Paris
Introduction: participants Company Country representatives Cito Netherlands Corporate GERA solutions Lithuania IMS Sweden OAT Luxembourg Vretta Canada Wiqid France First FLIP Event 18 th ‐ 19 th of June 2018, Paris
Introduction: agenda First FLIP Event 18 th ‐ 19 th of June 2018, Paris
Introduction: agenda First FLIP Event 18 th ‐ 19 th of June 2018, Paris
Country report France First FLIP Event 18 th ‐ 19 th of June 2018, Paris
Summary • Student assessment in France • Transition to e ‐ assessment • Very ‐ large ‐ scale assessment • Innovative assessment • Contributions to FLIP First FLIP Event 18 th ‐ 19 th of June 2018, Paris
French Ministry of Education Primary & Secondary education • 1.1 million employees – Largest employer of France • Organized as 30 “académies” – 52,000 elementary schools – 11,000 secondary schools – 13 million students • Total budget of 93 billion EUR First FLIP Event 18 th ‐ 19 th of June 2018, Paris
DEPP and student assessment DEPP is the Department of Statistics of the Ministry of Education DEPP leads many standardised assessment programmes 3 levels – 3 Objectives Classroom Classroom to provide standardised tools to teachers in order to improve level level pedagogical interventions to provide indicators to educational Local level Local level managers in order to monitor pedagogical actions to provide national results, trends National National and international comparisons in order to evaluate the education level level system First FLIP Event 18 th ‐ 19 th of June 2018, Paris
Assessment Programmes National surveys CEDRE CEDRE Common Common Longitudinal Longitudinal Policy evaluation Policy evaluation Subjects Subjects Base Base Sample ‐ based Sample ‐ based subject ‐ Longitudinal surveys: 2017: class size competences based assessment school pathways and reduction policy assessment programme family resources in socio ‐ programme economic disadvantaged Grade 6 2007, Grade 1 Grades 3, 6 and 9 Grades 5 and 9 schools, grade 1 International surveys 2011, handicapped to 3 students (2005 & 2010) ‐ Common base ‐ French competences, ‐ Foreign languages Subjects and competences ‐ Socio ‐ cognitive ‐ History & Geography PISA PISA PIRLS PIRLS ICILS ICILS TIMSS TIMSS competences, ‐ Science ‐ 21 st century skills ‐ Mathematics (4C) Programme for Progress in International Computer Trends in International International International Reading and Information Mathematics and Student Assessment Literacy Survey Literacy Study Science Study Nation ‐ wide assessments 15 years ‐ old Grade 8 Grade 4 Grades 4, 8 and 12 Reading Literacy Grades 1 & 2 Grades 1 & 2 Grade 6 Grade 6 Grade 10 Grade 10 Army Day Army Day Reading Mathematics & Digital Literacy Mathematical Comprehension Computational thinking Science Literacy Scientific Literacy Illiteracy diagnostic Diagnostic Test Diagnostic test & Diagnostic monitoring test Early and mid 17 ‐ years old French Grade 1 Early Grade 10 Early grade 6 girls and boys Early Grade 2 French French Maths Reading French Maths Maths First FLIP Event 18 th ‐ 19 th of June 2018, Paris
Transition to e ‐ assessment Since 2015, transition from paper ‐ based assessment to e ‐ assessment: New opportunities : cost reduction, potential easiness to implement, in line with digital school, more engaging, … New features : multimedia, interactivity, simulated situations, 21 st century skills, adaptive testing, log ‐ data, ... New challenges : comparability PBA/eA, usability, equipment, security, confidentiality, … 2 axes as 2 added values of e ‐ assessment: 1. Very ‐ large ‐ scale assessment 2. Innovative assessment First FLIP Event 18 th ‐ 19 th of June 2018, Paris
E ‐ assessment in practice • Dependency on school equipment • Primary schools – Offline tablet solution (mobile classes) – Sample ‐ based programmes • Secondary schools – Online solution (schools’ computers) – Sample ‐ based and nation ‐ wide programmes Particular case: international assessments (USB sticks) First FLIP Event 18 th ‐ 19 th of June 2018, Paris
Tablet ‐ based assessment • Primary schools – Mobile App (D ‐ Tab) – Adapted to young children – E.g. : 30,000 grade 1 and grade 2 students longitudinal survey • Next step: nation ‐ wide? – September 2018: 1.7 millions grade 1 + 2 students, paper ‐ based App version available – Use of school tablets? First FLIP Event 18 th ‐ 19 th of June 2018, Paris
Very ‐ large ‐ scale assessment • Grade 6 Nation ‐ wide assessment (November 2017) – 830,000 students / 7,100 schools – First “pilot” in 2015: 160,000 students – French and Maths, adaptive (MST) – TAO full web • Feedback – Participation rate: 98% – Scalability: up to 50 000 simultaneous connections – Offline version in 2018 for schools with low bandwidth A successful very ‐ large scale assessment thanks to e ‐ assessment Yearly programme + extension to grade 10 (September 2018) First FLIP Event 18 th ‐ 19 th of June 2018, Paris
Item samples First FLIP Event 18 th ‐ 19 th of June 2018, Paris
Innovative assessment • Digital functionalities for better measurement Multimedia, time data, accessibility, adaptive procedures, interactivity, … • Illustration: Technology ‐ Enhanced Items (TEI) From simple animations to interactive items 1) To enrich “traditional subjects” assessments 2) To explore “new” competences (4C) First results from sample ‐ based assessment programmes First FLIP Event 18 th ‐ 19 th of June 2018, Paris
Technology Enhanced Items ChatBot Maths (with Luxembourg) Computational thinking Physics First FLIP Event 18 th ‐ 19 th of June 2018, Paris
Data Analytics • Log ‐ data analysis : strategies analysis + output automatic analysis Example: Math – May 2016 – 8,000 grade 9 students • First insights – Identification of students profiles by supervised classification First FLIP Event 18 th ‐ 19 th of June 2018, Paris
Perspectives General context: a growing demand for e ‐ assessment Contributions to FLIP so far: ‐ Sharing experience ‐ Contributing to IT development (e.g. offline, portals, etc.) ‐ Buidling tools (Chatbot, etc.) ‐ Developing contents (Math items, MathemaTIC) To continue supporting collaborative efforts in FLIP in all aspects First FLIP Event 18 th ‐ 19 th of June 2018, Paris
Roadmap discussions First FLIP Event 18 th ‐ 19 th of June 2018, Paris
Recommend
More recommend
