Gaining a Deeper Understanding of Student Progress Over Time and - PowerPoint PPT Presentation

Gaining a Deeper Understanding of Student Progress Over Time and Achievement Gaps based on the National Assessment of Educational Progress (NAEP) survey questionnaire data Ebony Walton, Jan Alegre, and Renee Savoie June 29, 2018

National Center for Education Statistics ✓ The primary federal entity for collecting and analyzing data related to education in the United States and other nations ✓ Provides statistical services for educators and education officials at the federal, State, and local levels; Congress ; researchers ; students ; parents ; and the media and the general public 2

National Assessment of Educational Progress (NAEP) Objective Means Ends Scale scores • To measure what Cognitive students know and Achievement • questions can do level percentages To provide contextual Percentages • Survey and descriptive Scale scores questionnaires • information related to Achievement (student, teacher, • academic school) level percentages achievement 4

Assessment areas and years Arts Civics Economics Geography Mathematics 08-16 98-18 06-12 94-18 90-17 Every 8 years Every 4 years Every 6 years Every 4 years Every 2 years Reading Technology and US History Writing Science 92-17 Engineering 94-18 11-17 09-15 Literacy Every 2 years Every 4 years Every 4-6 years Every 4 years 14-18 Every 4 years 5

NAEP Administration 6

Presentations today ❖ Ebony Walton, NCES: Changes in academic performance with shifts in educational landscapes and student attitudes from 2009-2015. ❖ Jan Alegre, ETS: A deeper look into achievement gaps based on NAEP survey data ❖ Renee Savoie, CT DeptEd: Potential uses of NAEP survey questionnaire data in practice for State level educational policy

What have we learned about student progress since 2009? 8

Grade 4 Changes in NAEP Score and Achievement Level Results: 2009-15 Group Math Reading Science Overall ↑ ↑ ↑ Lower- ↔ ↔ ↔ ↑ ↑ ↑ performing (10 th /25 th percentiles) Higher- performing ↑ ↑ ↑ ↑ ↑ ↑ (75 th /90 th percentiles) ↔ ↓ ↓ Below Basic 18% 33-31% 28-24% At or above ↔ ↑ ↑ Proficient 39-40% 33-36% 34-38% 9

Grade 8 Changes in NAEP Score and Achievement Level Results: 2009-15 Group Math Reading Science Overall ↔ ↑ ↑ Lower- ↔ ↓ ↔ ↔ ↑ ↑ performing (10 th /25 th percentiles) Higher- performing ↔ ↔ ↑ ↑ ↑ ↑ (75 th /90 th percentiles) ↑ ↔ ↓ Below Basic 27-29% 25-24% 37-32% At or above ↔ ↑ ↑ Proficient 34-33% 32-34% 30-34% 11

Grade 12 Changes in NAEP Score and Achievement Level Results: 2009-15 Group Math Reading Science Overall ↔ ↔ ↔ Lower- ↓ ↓ ↓ ↓ ↔ ↔ performing (10 th /25 th percentiles) Higher- performing ↔ ↔ ↔ ↔ ↔ ↔ (75 th /90 th percentiles) ↑ ↑ ↔ Below Basic 36-38% 26-28% 40% At or above ↔ ↔ ↔ Proficient 26-25% 38-37% 21-22% 13

Summary of national performance changes ✓ Improvement in math, reading, and science overall and for high-performing students at grade 4 ✓ Improvement in reading and science at grades 4 and 8 ✓ Stagnant performance at grade 12 overall ; lower-performing students decline in math and reading 15

Do shifts in contextual factors mirror changes in student performance? 16

Selected NAEP contextual questions related to positive student views Mathematics Reading Science G4 How often do you G4 How often do you G4 How often do you feel math is one of read for fun on your feel science is one of your favorite subjects? own time? your favorite subjects? G8 I like math. G8 Reading is one of G8 Science is one of my favorite subjects. my favorite subjects. G12 Mathematics is one of my favorite G12 Reading is one of G12 Science is one of subjects. my favorite activities. my favorite subjects. 17

Selected NAEP contextual questions related to student computer use Mathematics Reading G4; G8 In your mathematics G4; G8; G12 In your class this year, how often do reading/language arts class this your students use a computer … year, how often do your students to extend mathematics learning (or you) use a computer or other with enrichment activities on the technological resources computer? to…access reading -related websites ? 18

Selected NAEP contextual questions related to classroom instruction Mathematics Reading Science G4; G8 How much G4; G8; G12 When G4; G8 To what emphasis did you or reading a story with extent do you…teach will you give for your students (in your scientific methods? algebra and functions? English/language arts class), how often do G12 Which courses G12 Which courses you ask your students have you taken from have you taken from to (does your teacher eighth grade to the eighth grade to the ask you to)…interpret present? Biology, present? Calculus, Pre- the meaning of the chemistry and/or calculus, Trigonometry passage? physics or Algebra II, Geometry Algebra I or less 19

Grade 4 Changes in NAEP Score and Survey Questionnaire Results: 2009-15 Group Math Reading Science Overall ↑ ↑ ↑ ↑ ↑ ↓ ↑ ↑ ↑ ↑ ↓ ↔ ↔ ↔ ↑ ↑ ↑ Lower- performing (10 th /25 th percentiles) ↔ ↓ ↑ ↑ ↑ ↑ ↑ ↑ ↑ Higher- performing ↑ ↓ ↔ (75 th /90 th percentiles) Black arrows indicate score change. Blue arrows indicate positive views percentage change. Red arrows indicate computer use percentage change. Gold arrows indicate instruction percentage change. 20

Grade 8 Changes in NAEP Score and Achievement Level Results: 2009-15 Group Math Reading Science Overall ↔ ↑↑ ↑ ↑ ↔ ↑ ↑ ↑ ↑ ↓ ↔ ↓ ↔ ↔ ↑ ↑ Lower- performing (10 th /25 th percentiles) ↔ ↔ ↑ ↔ ↔ ↑ ↑ ↑ ↑ Higher- performing ↑ ↔ ↑ (75 th /90 th percentiles) Black arrows indicate score change. Blue arrows indicate positive views percentage change. Red arrows indicate computer use percentage change. Gold arrows indicate instruction percentage change. 22

Grade 12 Changes in NAEP Score and Achievement Level Results: 2009-15 Group Math Reading Science Overall ↔ ↑↑ ↔ ↔ ↑ ↑ ↔ ↑ ↑ ↓ ↓ ↓ ↓ ↔ ↔ Lower- performing (10 th /25 th percentiles) ↓ ↓ ↔ ↔ ↔ ↔ ↔ ↔ ↔ Higher- performing ↑ ↔ ↑ (75 th /90 th percentiles) Black arrows indicate score change. Blue arrows indicate positive views percentage change. Red arrows indicate computer use percentage change. Gold arrows indicate instruction percentage change. 24

Trend in percentage of students who reported they strongly agreed that math is one of their favorite subjects , by students’ performance level Grade 4 Grade 8 Grade 12 26

Trend in percentage of students whose teachers reported that they never or hardly ever access reading-related websites in reading class Grade 4 Grade 8 Grade 12 27

Trend in percentage of students by the extent to which teachers emphasize scientific methods in science class Grade 4 Grade 8 28

Percentage of twelfth-grade students assessed in NAEP science by the frequency with which they design a science experiment by science coursetaking 29

Summary of student views results ✓ At grade 4 , the pattern of scores and student views improving is the same for mathematics and science ✓ At grade 8 , the pattern of scores and student views improving is the same in science but not in mathematics and reading ✓ While reading performance improved at grades 4 and 8, less students like reading — particularly lower-performing students at grades 4 and 12 30

Summary of computer use results ✓ Students are using the computer more in mathematics and reading classes at all three grades ✓ Shifts in computer use appear to be more pronounced at grades 4 and 8 — where we see score improvements 31

Summary of classroom instruction results ✓ There is growth at all three grades in the percentages of students experiencing selected classroom instruction practices; however, mathematics scores improved only at grade 4 and reading scores improved at grades 4 and 8 ✓ Students receive less emphasis on scientific methods at grades 4 and 8; however, science scores have improved ✓ At grade 12, science scores are flat but students are taking more science courses 32

Please visit https://www.nationsreportcard. gov/sq_students_views_2015/ to view the first report in the 2015 NAEP Student Questionnaires series. Ebony Walton, Statistician National Center for Education Statistics Ebony.walton@ed.gov 33