Image by Mrs. E Teaches Math www.mrseteachesmath.blogspot.com Virginia’s Perspective on Scoring for Technology Enhanced Items CCSSO National Conference on Student Assessment 22 June 2016 1
Online Testing in Virginia 3000000 2656010 2661406 * 2489170 2427599 2500000 2216690 2000000 1908970 1652680 1418250 1500000 1333150 924050 1000000 579000 500000 265000 76000 1700 8500 0 Fall Spr Spr Spr Spr Spr Spr Spr 2001 2003 2005 2007 2009 2011 2013 2015
Background Beginning in the Spring of 2011, Virginia began field testing Technology Enhanced Items (TEIs) as part of the Standards of Learning (SOL) assessments TEIs now make up 15-20% of the items on all of the SOL tests Currently students are awarded either full credit (1 point) or no credit (0 points) for both multiple choice items and TEIs Recent interest from the SOL Innovation Committee has encouraged consideration of offering partial credit for TEIs 3
Background The Standards of Learning Innovation Committee was created by HB 930 in the 2014 legislative session. Purpose of the Committee is to provide the Board of Education and General Assembly with suggestions on changes to the SOL assessments, authentic individual student growth measures, alignment between the Standards of Learning and assessment, and ideas on innovative teaching in the classroom. 4
Background SOL Committee Recommendation (2015): “…all assessments should be scored fairly and accurately, with partial credit being awarded for assessment items that require multiple responses.” 5
Partial Credit Scoring and TEIs Seems like a logical recommendation 6
Partial Credit Scoring and TEIs However…implementation is more complex than it might seem with lots of decisions to be made about how and when to award partial credit 7
Audience Participation Section
Example 1: Drag and Drop with 2 Bays 9
Example 1: Drag and Drop with 2 Bays Full Credit 10
Example 1: Drag and Drop with 2 Bays Partial Credit? 11
Example 2: Drag and Drop with 2 Bays 12
Example 2: Drag and Drop with 2 Bays Full Credit 13
Example 3: Drag and Drop with 8 Bays 14
Example 3: Drag and Drop with 8 Bays Full Credit 15
Example 3: Drag and Drop with 8 Bays Partial Credit? 16
Example 4: Drag and Drop with Order 17
Example 4: Drag and Drop with Order Full Credit 18
Example 4: Drag and Drop with Order Partial Credit? 19
Example 4: Drag and Drop with Order Partial Credit? 20
Example 4: Drag and Drop with Order Partial Credit? 21
Example 5: Hot Spot 22
Example 5: Hot Spot Full Credit 23
Example 5: Hot Spot Partial Credit? 24
Example 5: Hot Spot Partial Credit? 25
Example 5: Hot Spot Partial Credit? 26
Example 6: Bar Chart 27
Example 6: Bar Chart Full Credit 28
Example 6: Bar Chart Partial Credit? 29
Example 6: Bar Chart Partial Credit? 30
Example 6: Bar Chart Partial Credit? 31
Example 7: Line Graph 32
Example 7: Line Graph Full Credit 33
Example 7: Line Graph Partial Credit? 34
Example 7: Line Graph Partial Credit? 35
Example 8: Fill-in-the-Blank 36
Example 8: Fill-in-the-Blank Full Credit 37
Take-Aways 1) Are there some items for which partial credit should not be offered even when there are multiple responses? 2) Are there some response patterns which should receive partial credit and others which should not? 3) How many points of partial credit should each response pattern be worth? 4) Does order of responses matter in awarding partial credit? 38
Recommend
More recommend
