Over Ov ervi view of of NCE NCES a and U U.S. R Rol ole i e - PowerPoint PPT Presentation

NATIONAL CENTER FOR EDUCATION STATISTICS Over Ov ervi view of of ¡NCE ¡NCES ¡a ¡and ¡U ¡U.S. ¡R ¡Rol ole ¡i e ¡in ¡In ¡Inter ernaBon onal ¡ Assessmen Assessments ts ¡ ¡ ¡ Presenta>on for “Thinking Beyond Borders: The Future of Student Assessment” ¡ ¡ ¡ ¡ ¡ ¡ ¡ ¡ ¡ ¡ Pe Peggy G. Carr, Ph.D ¡ ¡ Ph.D., AcBng Commissioner, NaBonal Center for EducaBon StaBsBcs (NCES) ¡ ¡ ¡ ¡ ¡ ¡ ¡ ¡ ¡ November 17, 2017 ¡ ¡

Americans are spectacularly bad at answering even the most basic math Other Countries Learn From Smart Schools in What America Can Competitiveness Concerns International Math Exam, Raising U.S. Teenagers Lose Ground in science, reading flat on test Math a concern for US teens; Mixed, Math and Science Performance International Tests Show Rising, But We're Not As Good As We Think When It Comes To Tech Skills, Unequal, Bad at Math World: Expensive, American Schools vs. the Dropouts Countries' High School Graduates Look Like Other America's High School questions In the news: U.S. Headlines NCES.ED.GOV

Australian schools continue to fall behind in maths and science scores matter more than ever In this post-truth world, PISA Lenze aki su citatelia? Slovaci su narodom kniznic. superpower How Canada became an education en Matematicas entre chicos y chicas con mas diferencia de rendimiento Espana es el tercer pais de la OCDE as science and reading skills stagnate students are getting WORSE at math 'Everything is just going down': US dans la moyenne Enquete PISA: les eleves francais In the news: InternaJonal Headlines NCES.ED.GOV

INSTITUTE OF EDUCATION SCIENCES NATIONAL CENTER FOR EDUCATION STATISTICS Fiv Five th ¡ thin ings gs we’ ¡ e’ve ¡ learned learned

1. American students tend to struggle more in mathemaJcs than in reading or science.

U.S. rankings less favorable in mathemaJcs than other subjects Grade ¡ Grade ¡ Age 15 Adults (54) (43) (73) (22) (Total ¡EducaFon ¡Systems) ¡ 6 — 16 8 Reading 8 8 20 — Science 11 9 38 17 Math * Rank is the number of educaJon systems with significantly higher average scores than the United States +1. U.S. also performed not ¡measurably different ¡from countries (ranging from 1 to 14). Rankings based on most ¡recent ¡data ¡from PIRLS (grade 4 reading), TIMSS (grades 4 & 8 math and science), PISA (age 15 reading, math, and science), and PIAAC (adults).

2. We see stronger performance from our youngest ¡students.

U.S. rankings more favorable for younger students Grade ¡ Grade ¡ Age 15 Adults (54) (43) (73) (22) (Total ¡EducaFon ¡Systems) ¡ 6 — 16 8 Reading 8 8 20 — Science 11 9 38 17 Math * Rank is the number of educaJon systems with significantly higher average scores than the United States +1. U.S. also performed not ¡measurably different ¡from countries (ranging from 1 to 14). Rankings based on most ¡recent ¡data ¡from PIRLS (grade 4 reading), TIMSS (grades 4 & 8 math and science), PISA (age 15 reading, math, and science), and PIAAC (adults).

3. While other countries improve, the U.S. is losing ground.

U.S. 4 th grade TIMSS mathemaJcs scores have increased, but ¡not ¡ to the same extent ¡as some of our compeJtors Singapore 1995 +58 Hong Kong-­‑CHN 2015 Korea, Republic of Japan Ireland ¡ England-­‑GBR ¡ +99 Portugal UNITED STATES +21 Cyprus ¡ Slovenia ¡ Australia Ontario-­‑CAN Norway ¡(4) New Zealand Iran, Islamic Republic of 0 350 400 450 500 550 600 650 100 30% ¡ 35% ¡ 40% ¡ 45% ¡ 50% ¡ 55% ¡ 60% ¡ 65% ¡ 70% ¡ Average Score NOTE: Countries participating in TIMSS in 1995 and 2015 and with significant increase in average score shown. NCES.ED.GOV 10

U.S. 15-­‑year-­‑olds’ performance in mathemaJcs declining over Jme U.S. Ranking PISA ¡2015 28 35 MathemaFcs Results 2012 2015 7 that ¡were now ¡ Average score lower 2 that were now than in 2012 *Rankings are based on the 60 educaJon systems that ¡parJcipated in both PISA 2012 and PISA 2015 and are determined by calculaJng the highest ¡possible rank (number of educaJon systems performing higher plus one). NCES.ED.GOV 11

4. Our top performing states are among the best ¡educaJon systems in the world, but ¡our lowest ¡performing states struggle to be compeJJve globally.

MassachuseLs among the top educaJon systems in the world In 2011, scores on grade 8 TIMSS ranged from 466 in Alabama ¡to 561 in MassachuseLs. Alabama’s peers: MassachuseLs’s peer: • Ukraine • Japan • Dubai and the United Arab Emirates (MA only scored lower • Norway than Republic of Korea, • Armenia ¡ Singapore, Chinese Taipei, • Romania ¡ and Hong Kong) • Turkey NCES.ED.GOV 13

5. Millennials, the most ¡highly educated generaJon in U.S. history, have generally low skills compared with internaJonal peers.

U.S. adults ages 16-­‑65 average score on PIAAC 2012 Literacy not different from OECD 310 ¡ 500 300 Adults’ (16-­‑65) average score 290 Average Score 280 273 270 270 260 250 240 ¡ 0 EducaFon System NCES.ED.GOV 1 1 1 15

U.S. Millennials lower than internaJonal average in Literacy 500 310 ¡ 300 Millennials’ average score 290 282 Average Score 280 274 270 260 250 240 ¡ 0 EducaFon System NCES.ED.GOV 16 16 1 1

U.S. adults ages 16-­‑65 average score on PIAAC 2012 Problem Solving lower than internaJonal average 500 310 ¡ Adults’ (16-­‑65) average score 300 290 283 Average Score 277 280 270 260 250 240 ¡ 0 EducaFon System NCES.ED.GOV 17 1 1

U.S. Millennials rank near boLom on PIAAC 2012 Problem Solving 500 310 ¡ Millennials’ average score 300 295 290 284 Average Score 280 270 260 250 240 ¡ 0 EducaFon System NCES.ED.GOV 18 1 1

U.S. adults ages 16-­‑65 average score lower than internaJonal average on PIAAC 2012 Numeracy 500 310 ¡ 300 Adults’ (16-­‑65) average score 290 Average Score 280 269 270 260 253 250 240 ¡ 0 EducaFon System NCES.ED.GOV 19 1 1

U.S. Millennials Jed for the lowest average score on PIAAC Numeracy 2012 500 310 ¡ 300 Millennials’ average score 290 Average Score 27 280 270 260 255 250 240 ¡ 0 EducaFon System NCES.ED.GOV 2 2 2 2

NCE NCES’s ¡r ¡rol ole ¡i e ¡in ¡ in intern ernaB aBon onal al assessmen ¡ assessments ts

InternaJonal Assessments Process Reps from InternaFonal parFcipaFng Design Organizer countries (IEA/OECD) (NCES) Assessments Administered Countries’ StaFsFcal Agencies Data Analyzed InternaFonal (NC ES and Validated Organizer Countries’ (IEA/OECD) InternaFonal StaFsFca Organizer Agencies (IEA/OECD) Data Reported (NCES) NCES.ED.GOV 2 22

NCES administered assessments InternaJonal Assessments State Assessments NCES.ED.GOV 23

The U.S. system of assessments InternaJonal Assessments State Assessments NCES.ED.GOV 24

NAEP DNA in internaJonal assessments • PISA, TIMSS, etc. based on “long test, short ¡booklet” pioneered by NAEP in early 80s – Group, not ¡individual, scores – NAEP was first ¡large-­‑scale applicaJon of IRT—now used in most ¡large-­‑scale assessments • NAEP and internaJonal assessments share experts, best ¡ pracJces NCES.ED.GOV 25

Up Upcomin oming in ¡ intern ernaB aBon onal al ¡ assessmen assessment resu ¡ esults lts

Upcoming internaJonal assessment ¡results • December 5, 2017 • 4 th -­‑ grade reading assessment ¡ • First ¡ePIRLS administraJon Online informaJonal reading – – Computer-­‑based extension of PIRLS NCES.ED.GOV 27

Upcoming internaJonal assessment ¡results IELS 2017 2018 2020 2019 NCES.ED.GOV 28

NCES Conducted Assessments Across the Lifespan Adults High School Middle • Lit Liter eracy acy School • Nu Numer meracy acy • Re Reading • Pr Prob oblem ¡Solvin lem ¡Solving g Elementary • Ma Math themaB emaBcs cs Early ¡ • Ou Outcomes omes in ¡ ¡ in • Ma Math themaB emaBcs cs • Sc Scie ienc nce emp emplo loymen yment, t, ¡ Childhood • Sc Scie ienc nce in income, ome, ¡ • Fin Finan ancial cial lit ¡ liter eracy acy • Re Reading educaB ed aBon on, ¡h ¡healt ealth • Te Teachers and ¡ ¡ • Col Collabor oraBve ¡ e ¡ • Ma teaching te Math themaB emaBcs cs • Lit prob oblem ¡solvin lem ¡solving g Liter eracy acy • Comp • Sc Computer er an ¡ and ¡ Scie ienc nce • Nu • Ad Numer meracy acy Advanced ced ¡ in informaB ormaBon on ¡ • On • So Online ¡R e ¡Rea eading Social ¡ ial ¡Skills Skills ma math themaB emaBcs cs an ¡ and ¡ lit liter erac acy • Ex ph physics sics ExecuB ecuBve Fu ¡ FuncB cBon on IELS PIRLS, TIMSS, TIMSS, ICILS, PISA, TIMSS, PIAAC NAEP NAEP NAEP NCES.ED.GOV 30

InternaJonal Assessments Process Design Reps from parJcipaJng Assessments countries Administered Data Analyzed and Validated Data Reported NCES.ED.GOV 3 31

Five things we’ve learned

NCES’s role in internaJonal assessments

Upcoming internaJonal assessment ¡results