Relationship between EOC Assessments & ACT Subject Tests Karla L. Egan Center for Assessment NCSA, 2015
Guiding Questions • How do the Proficient cut scores compare to the ACT college readiness benchmarks? • What score on an EOC best predicts students’ reaching the ACT college readiness benchmark? • Does the predicted cut score vary by grade level? Page 2 • Egan• Presentation to NCSA, June 2015
Assessment Data • EOC – Administered since Fall 2008 • English II • Algebra I • Biology – Administered since Fall 2009 • English I • American History • Government • Algebra II • Geometry Page 3 • Egan• Presentation to NCSA, June 2015
Assessment Data: Graduating Cohorts EOC Subject Test 2014 2013 2012 English I 38808 37308 2101 English II* 61295 60866 61213 Algebra I* 59539 48087 22159 Algebra II 23508 23142 21436 Geometry 28539 26867 21029 American History 35129 33334 21226 Government* 62103 61317 44453 Biology* 60924 60251 50676 ACT 41564 40784 40535 Page 4 • Egan• Presentation to NCSA, June 2015
EOC to ACT EOC ACT Subject Area Test English I English English II* Algebra I* Mathematics Algebra II Geometry American History Reading Government* Biology* Science Physical Science Page 5 • Egan• Presentation to NCSA, June 2015
Matched Data 2014 2013 2012 Matched Assessments EOC English I 25005 24129 661 ACT English EOC English II* 40256 39469 38883 ACT English EOC Algebra I* 38834 28278 8837 ACT Math EOC Algebra II 19049 18411 16557 ACT Math EOC Geometry 20317 19209 13581 ACT Math EOC American History 22948 21654 13482 ACT Reading EOC Government* 40808 39863 27442 ACT Reading EOC Biology* 40057 39200 30634 ACT Science Page 6 • Egan• Presentation to NCSA, June 2015
Study 1: EOC Proficiency and ACT College Readiness • Methodology – Logistic Regression • Find EOC cut score that best predicts ACT College Readiness • Find ACT score that best predicts ACT proficiency – Borderline Groups • Find mean ACT score of students who are within one SEM of the EOC cut score • Find mean EOC score of students who are within one SEM of the ACT College Readiness benchmark Page 7 • Egan• Presentation to NCSA, June 2015
Choosing Cut Score • Accuracy rate: % of students correctly classified Page 8 • Egan• Presentation to NCSA, June 2015
Results • Similar Cut Scores Predicted in 2013 & 2014 • Similar Results between Borderline Groups and Logistic Regression • Accuracy rates very similar – Slightly better for Logistic Regression Page 9 • Egan• Presentation to NCSA, June 2015
Accuracy Rates, 2014 Only Current EOC BG LOG50 Cut Scores English I 80.2 77.7 80.3 English II 79.8 79.0 81.5 Algebra I 66.3 78.7 78.7 Algebra II 75.6 78.8 78.5 Geometry 67.4 77.2 76.5 American 70.8 72.4 72.2 History Government 70.5 74.2 74.2 Biology 62.8 74.4 74.8 Page 10 • Egan• Presentation to NCSA, June 2015
Results, 2014 Only Current EOC Cut BG LOG50 Score English I 200 204 197 English II 200 208 202 Algebra I 200 215 215 Algebra II 200 207 207 Geometry 200 210 211 American 200 204 205 History Government 200 209 209 Biology 200 213 216 Page 11 • Egan• Presentation to NCSA, June 2015
Study 2 • Does an EOC score that links with the ACT college readiness benchmark vary based on the grade level in which the student first took the EOC? • How do the EOC linking scores in this study compare with the EOC linking scores from Study 1? • Only use logistic regression for these analyses Page 12 • Egan• Presentation to NCSA, June 2015
Background • Students can take courses at any point in their high school career – Algebra I is often taken in Grade 8 • Course ‐ taking pattern – Grade 9: English I, Algebra I, American History – Grade 10: English II, Geometry, Biology – Grade 11: Algebra II, Government, American History Page 13 • Egan• Presentation to NCSA, June 2015
Accuracy Rates, 2014 Only Current EOC LOG50 By Grade Cut Scores English I 80.2 80.3 80.4 English II 79.8 81.5 81.6 Algebra I 66.3 78.7 81.3 Algebra II 75.6 78.5 80.1 Geometry 67.4 76.5 80.5 American 70.8 72.2 72.6 History Government 70.5 74.2 74.6 Biology 62.8 74.8 75.8 Page 14 • Egan• Presentation to NCSA, June 2015
Results, 2014 Only EOC LOG50 8 9 10 English I 197 196 206 English II 202 198 202 Algebra I 215 207 217 227 Algebra II 207 194 203 Geometry 211 187 200 213 American 205 201 205 History Government 209 204 206 208 Biology 216 210 216 Page 15 • Egan• Presentation to NCSA, June 2015
Results • Similar results between graduating cohorts • Predicted college readiness cut score increases by grade • Accuracy rates are similar to single cut score Page 16 • Egan• Presentation to NCSA, June 2015
Final Recommendations Page 17 • Egan• Presentation to NCSA, June 2015
For more information: Center for Assessment www.nciea.org Page 18 • Marion • Presentation to the NH Superintendents Association
Recommend
More recommend
