Using NAEP Survey Data at the State-Level Rene A. Savoie - PowerPoint PPT Presentation

Using NAEP Survey Data at the State-Level Renée A. Savoie Connecticut NAEP State Coordinator renee.savoie@ct.gov NCSA 2018 – San Diego, CA 1

Survey Data Com plem ent Achievem ent Results  NCSA 2017 Session • Mathematics Course-taking Information o NAEP 2009 Grade 12 Student Questionnaires • Measuring Students’ Computer Access o NAEP 2015 Teacher and Student Questionnaires • Science-Related Career Aspirations o NAEP 2015 Science Student Questionnaires  NAEP 2017 results released on April 10, 2018 • Big Picture: No overall change for Connecticut • Reading performance stronger than mathematics • Many states outperform Connecticut in mathematics 2

Connecticut NAEP 2017 Performance Relative to Other States NAEP Reading Grade 4 ─ Overall Average Scale Score: 2017 Proficient Level (238) 240 MA Lower average scale score than CT DD 235 NJ Not significantly different from CT Higher average scale score than CT NH 230 CT FL VA WY VT IN MD OH UT MN PA CO NE NC KY 225 WA MO KS Average Scale Score RI MT ID NY SD ME ND DE IA NP IL GA WI TN 220 WV MI OR OK AL AR HI MS CA AZ NV TX 215 DC SC LA 210 NM AK 205 200 NOTE: The NAEP grade 4 reading scale ranges from 0 to 500.

Connecticut NAEP 2017 Performance Relative to Other States NAEP Mathematics Grade 4 ─ Overall 260 Average Scale Score: 2017 Lower average scale score than CT 255 Not significantly different from CT Higher average scale score than CT MA MN Proficient Level (249) 250 DD WY VA NJ IN FL NE NH ND 245 Average Scale Score IA UT WA PA SD OH KS MD MT NC CO VT TX WI ME MO ID NP CT KY 240 HI IL OK RI TN WV GA DE NY MI MS AZ AR SC 235 OR CA AL NV DC AK NM LA 230 225 220 NOTE: The NAEP grade 4 mathematics scale ranges from 0 to 500.

NAEP 2017 Student Group Results: Comparison of Connecticut to the Nation (NP) Grade 4 Grade 8 2017 CT 2017 NP 2017 CT 2017 NP CT CT Average Average Average Average Compared Compared Scale Scale Scale Scale to NP* to NP* Score Score Score Score All 228 221 ↑ 273 265 ↑ White 238 231 ↑ 283 274 ↑ Reading Black 210 205 = 249 248 = Hispanic 213 208 = 253 255 = NSLP 1 211 208 = 254 253 = All 239 239 = 284 282 ↑ White 249 248 = 295 292 ↑ Mathematics Black 222 223 = 258 260 = Hispanic 223 229 ↓ 263 268 ↓ NSLP 1 224 228 ↓ 264 267 ↓ NSLP 1 - NSLP is the National School Lunch Program. Eligibility is used as a proxy for measuring poverty. * An arrow is used when the difference between the scores is statistically significant.

Providing Context w ith NAEP  NAEP Questions Tool • Given our content standards, should students be able to answer the questions correctly? • What differences in subgroup performance do the item-level data reveal? • What items show large discrepancies in percent correct when compared to other states and the nation?

Grade 4 Student Questionnaire: Affective Disposition The percentage of Grade 4 students who report… No effort Very little Some Quite a bit Year Jurisdiction A lot of effort at all effort Effort of effort 2017 National public 1 3 11 27 57 2017 Connecticut 1 3 10 30 56 2017 Massachusetts 1 2 11 31 55

Grade 4 Teacher Questionnaire: Instructional Content and Practice The percentage of Grade 4 students with teachers who report… Year Jurisdiction < 5 hours 5 to <7 hours 7 or more hours 2017 National public 17 40 44 2017 Connecticut 15 55 30 2017 Massachusetts 12 45 43

Grade 4 Teacher Questionnaire: Preparation, Credentials and Experience During the last two years, did you participate in or lead any of the following professional development activities related to the teaching of mathematics? The percentage of Grade 4 students with teachers who report… College course related to the teaching Co-teaching or team teaching of mathematics taken after your first for math. certification. College College Co-teaching/ Co-teaching/ Course: Course: team teaching: team teaching: Year Jurisdiction Yes No Yes No National 2017 17 83 41 59 public 2017 CT 14 86 35 65 2017 MA 39 61 47 53

NAEP Data Supports a Sense of Urgency  Use NAEP data to highlight concerns of mathematics leaders in the coming school year  Special mathematics-focused edition of Performance Matters newsletter, June 2018  Redirect attention to the Report of the Commissioner’s Council on Mathematics  Examine policies and practices in other states