DMAC Users Meeting – Data, the Building Blocks of Instructional Planning Dr. Rebeca Cooper Longview Independent School District, Assistant Superintendent Research Accountability and Planning
Goal: To improve student achievement by strategically using data to target instructional interventions and classroom instruction.
4 Performance Indexes – Why? Only 1 of the indexes is based on “passing” Address 4 statutory and policy goals (Index 1 and it is at Phase 1!) Index 1. Improving student achievement at all levels in core subjects 1 2. Ensuring progress of all students toward Advanced Academic Index Performance (STAAR Level III) 2 3. Closing Advanced Academic Performance Gaps among groups Index (STAAR Level III) 3 50% of the Indexes (Index 2 and Index 4. Rewarding excellence based indicators other than state 3) are grounded on Index assessment results STAAR Level III 4
Index 1 – The foundation
STAAR performance categories and the Level II Phase-in Satisfactory Satisfactory Advanced Advanced Level III Level I Level II Advanced Unsatisfactory Satisfactory 3 1 2 Academic Academic Academic Performance Performance Performance Final NEW Phase 3 NEW 2021-22 2018-19 Phase 2 2019-20 Phase 1 2015-16 2020-21 2011-12 2016-17 2012-13 2017-18 2013-14 2014-15
Aligning Data…. Going beyond the canned reports
What do I want to know… • Students who were on the campus last year. • Took the test in grade 4. • Who were African American.
What about this year • Students who are currently on the campus. • Took the test in grade 3 who are currently in grade 4. • Who were African American.
STAAR performance categories and the Level II Phase-in Satisfactory Satisfactory Advanced Advanced Level III Level I Level II Advanced Unsatisfactory Satisfactory 3 1 2 Academic Academic Academic Performance Performance Performance Final NEW Phase 3 NEW 2021-22 2018-19 Phase 2 2019-20 Phase 1 2015-16 2020-21 2011-12 2016-17 2012-13 2017-18 2013-14 2014-15
NEW Phase In for Level II - Satisfactory NEW NEW Final Reading Items Phase 1 (Recommended) Phase 2 Phase 3 Scale Raw %age Scale ≈ Raw ≈ %age Scale ≈ Raw ≈ %age Scale Raw %age Grade 5 46 1458 25 54% 1495 28 61% 1545 32 70% 1582 35 76% OLD Phase In for Level II - Satisfactory Final Phase 2 Phase 1 Reading Items (Recommended) Scale Raw %age Scale Raw %age Scale Raw %age Grade 5 46 1458 25 54% 1520 30 65% 1582 35 76%
STAAR Progress Measure • 2013 - 4 th Grade Reading, barely passed at phase 1, raw score 24, scale score 1422 • 2014 – 5 th grade Reading, barely passed at phase 1, raw score 25, scale score 1458
STAAR Progress Measure • From 4 th to 5 th grade – each time barely passed at phase 1, only required 1 more question. Scale score 1458 – 1422 = 36 scale score points. • Only needed 32 more scale score points to meet progress.
What’s Your Growth Number…
STAAR Progress Measure • Look at the range for growth… • How many points did you leave on the table…
What’s Your Growth Number…
STAAR Progress Measure • Look at the range for growth… • How many points did you leave on the table…
Is it really harder to show growth at Level III Advanced Academic Performance? 2013 Grade 4 Reading 2014 Grade 5 Reading • How many Questions are there in grade 4? Grade 5? • How many questions do you have to answer correctly to score Advanced Academic Performance in grade 4? Grade 5?
Is it really harder to show growth at Level III Advanced Academic Performance? 2013 Grade 4 Reading 2014 Grade 5 Reading • 2013 Grade 4, Raw Score 38 Scale Score 1633 • 2014 Grade 5, Raw Score 40 Scale score 1667 • From advanced Academic Performance Grade 4 to AAP Grade 5, 2 raw score points 1667 – 1633 = 34 Scale Score points. Only 32 Scale Score points needed to show growth.
What do I want to know… • Which AA students met or exceeded growth and passed or scored commended. • Students who were on the campus last year. • Took the test in grade 4. • Who were African American.
What do I need to show growth the next year? Only Scratched The Surface
Take the same data from the search we originally did…
Add what it takes to meet growth to your number…
So now you know your growth number, how do you monitor growth throughout the year?
This data is only effective if the Instruction and Assessment data is accurate
Out of 50 questions, the mean (avg.) was a Raw Score of 33 or 66% SD 10.28 = 68% of the populations falls between 23 questions and 43 questions.
Mean
ALPHA Alpha ( the rigor of the test ) .922 SEM SEM ( the validity of the test ) 2.88 SEM on any given day the students are likely to score ± 3 questions.
• If the Alpha is .922, how rigorous is the assessment? - The closer the number gets to 1 the more rigorous.
• If the SEM is 2.88, how valid is the assessment? – SEM = On any given day, without any further instruction, how closely aligned is the raw score. – The closer to 0 the more valid the assessment.
Report from DMAC
Export and paste into Excel Use “Find and Replace” feature to turn responses into 0 and 1
Recommend
More recommend
