New York State School Boards Association August 8, 2014 Data Use for Accountability and Student Achievement From School Performance to Teacher Growth Scores Fred Cohen, Nassau BOCES Data Warehouse Consultant IDW@mail.nasboces.org 608-6640
First, a quick question. Which is correct? The data for the 2013-2014 assessments (is, are) now available! Robert E. Lupinskie Center for Curriculum, Instruction and Technology One Merrick Ave · Westbury, New York 11590 (516) 608-6640 · Fax: (516) 608-6616
Now that I know that “data” is usually considered plural, what do I do with “these” data? Robert E. Lupinskie Center for Curriculum, Instruction and Technology One Merrick Ave · Westbury, New York 11590 (516) 608-6640 · Fax: (516) 608-6616
Here’s an idea suggested by Robert Burn’s 1786 poem, “The Louse” “And if some Power this small gift give us To see ourselves as others see us! It would from many a blunder free us….” (modern translation) Robert E. Lupinskie Center for Curriculum, Instruction and Technology One Merrick Ave · Westbury, New York 11590 (516) 608-6640 · Fax: (516) 608-6616
Or, in the immortal words of New York City’s three -time mayor, Ed Koch How ‘m I doin’? Mayor Ed Koch
But before we can decide what data to use in our self-reflection, some guidelines developed over the past 48 years Robert E. Lupinskie Center for Curriculum, Instruction and Technology One Merrick Ave · Westbury, New York 11590 (516) 608-6640 · Fax: (516) 608-6616
There are four parts to any self-reflection or data analysis • Trends — compare yourself to yourself. • The competition — compare yourself to everyone else ( especially those most similar to you ). • Benchmarks — compare yourself to state or national benchmarks, targets, or expectations. • Disaggregate the data — break down the data into subgroups and other meaningful divisions. Robert E. Lupinskie Center for Curriculum, Instruction and Technology One Merrick Ave · Westbury, New York 11590 (516) 608-6640 · Fax: (516) 608-6616
How is each separate school and each subgroup population doing? • Overall, our students are doing quite well. • But what if district scores soar while one school lags far behind? • And what if special education students, students of limited English proficiency, low income students, or other subgroups are failing? Robert E. Lupinskie Center for Curriculum, Instruction and Technology One Merrick Ave · Westbury, New York 11590 (516) 608-6640 · Fax: (516) 608-6616
Data savvy people are aware of this additional obligation to “Disaggregate the data!” • It is not sufficient to achieve overall success. (“Our school/district is performing well.”) • Every distinct population must also perform well. Robert E. Lupinskie Center for Curriculum, Instruction and Technology One Merrick Ave · Westbury, New York 11590 (516) 608-6640 · Fax: (516) 608-6616
That makes four questions which must be answered to begin a true data analysis. Robert E. Lupinskie Center for Curriculum, Instruction and Technology One Merrick Ave · Westbury, New York 11590 (516) 608-6640 · Fax: (516) 608-6616
Four Key Issues to Consider Trends — how did my district do compared to last year? 1. (and the year before) The overall competition — how are other districts, 2. especially similar districts, doing? (in the county, state) State targets — what benchmarks or expectations have 3. been set by the State and Federal Government? ( Adequate Yearly Progress or AYP ) 4. When we disaggregate our data, how are each of our subgroups doing? (both genders, all ethnicities, special ed, limited English proficient, and impoverished students). Also disaggregate by school and teacher. Robert E. Lupinskie Center for Curriculum, Instruction and Technology One Merrick Ave · Westbury, New York 11590 (516) 608-6640 · Fax: (516) 608-6616
What follows are samples of Nassau BOCES Instructional Data Warehouse Reports that Offer these Insightful Reflections Robert E. Lupinskie Center for Curriculum, Instruction and Technology One Merrick Ave · Westbury, New York 11590 (516) 608-6640 · Fax: (516) 608-6616
Compare to last year Compare to everyone else The Snapshot Report — A Simple Performance Compare to state targets Disaggregate the data Level Comparative Analysis Disaggregate by school Robert E. Lupinskie Center for Curriculum, Instruction and Technology One Merrick Ave · Westbury, New York 11590 (516) 608-6640 · Fax: (516) 608-6616
The Trends Analysis — A Longitudinal Perspective Compare to last year Compare to everyone else Compare to state targets Disaggregate the data Robert E. Lupinskie Center for Curriculum, Instruction and Technology One Merrick Ave · Westbury, New York 11590 (516) 608-6640 · Fax: (516) 608-6616
The Subgroup Analysis Report — Disaggregating Results by Subgroup Compare to last year 91% 72% Compare to everyone else Compare to state targets The purpose of disaggregation 87.1% Robert E. Lupinskie Center for Curriculum, Instruction and Technology One Merrick Ave · Westbury, New York 11590 (516) 608-6640 · Fax: (516) 608-6616
The Gap Report — A Question by Question Comparison to the Nassau County Region Robert E. Lupinskie Center for Curriculum, Instruction and Technology One Merrick Ave · Westbury, New York 11590 (516) 608-6640 · Fax: (516) 608-6616
2013 Math 6 Assessment Compare to last year Compare to everyone else Compare to state targets Disaggregate the data Robert E. Lupinskie Center for Curriculum, Instruction and Technology One Merrick Ave · Westbury, New York 11590 (516) 608-6640 · Fax: (516) 608-6616
Robert E. Lupinskie Center for Curriculum, Instruction and Technology One Merrick Ave · Westbury, New York 11590 (516) 608-6640 · Fax: (516) 608-6616
Robert E. Lupinskie Center for Curriculum, Instruction and Technology One Merrick Ave · Westbury, New York 11590 (516) 608-6640 · Fax: (516) 608-6616
The Gap Report for Released Questions — A Question by Question Comparison to the Nassau County Region with links to actual questions released by SED Robert E. Lupinskie Center for Curriculum, Instruction and Technology One Merrick Ave · Westbury, New York 11590 (516) 608-6640 · Fax: (516) 608-6616
Robert E. Lupinskie Center for Curriculum, Instruction and Technology One Merrick Ave · Westbury, New York 11590 (516) 608-6640 · Fax: (516) 608-6616
Robert E. Lupinskie Center for Curriculum, Instruction and Technology One Merrick Ave · Westbury, New York 11590 (516) 608-6640 · Fax: (516) 608-6616
The Wrong Answer Summary Analysis (Released Questions) — A Summary of the Wrong Answers Chosen by Students Robert E. Lupinskie Center for Curriculum, Instruction and Technology One Merrick Ave · Westbury, New York 11590 (516) 608-6640 · Fax: (516) 608-6616
Robert E. Lupinskie Center for Curriculum, Instruction and Technology One Merrick Ave · Westbury, New York 11590 (516) 608-6640 · Fax: (516) 608-6616
Robert E. Lupinskie Center for Curriculum, Instruction and Technology One Merrick Ave · Westbury, New York 11590 (516) 608-6640 · Fax: (516) 608-6616
Teacher by Teacher Analysis (Disaggregate the data) Teacher # Students % Correct B % Distractor D A 82 59% 33% B 87 52% 40% C 101 66% 27% D 76 49% 40% E 97 44% 42% F 71 73% 15% Teachers must have access to their released question data, as soon after their September return to school, as possible. Robert E. Lupinskie Center for Curriculum, Instruction and Technology One Merrick Ave · Westbury, New York 11590 (516) 608-6640 · Fax: (516) 608-6616
Time for a musical interlude! Robert E. Lupinskie Center for Curriculum, Instruction and Technology One Merrick Ave · Westbury, New York 11590 (516) 608-6640 · Fax: (516) 608-6616
I adapted the following statement about Elvis from “Naked Scientists Podcasts” as reported by Free Movement Magazine , November 13, 2007 Robert E. Lupinskie Center for Curriculum, Instruction and Technology One Merrick Ave · Westbury, New York 11590 (516) 608-6640 · Fax: (516) 608-6616
• The number of Elvies Presley impersonators has reached an all-time record high – there are now at least 85,000 Elvis’s around the world, compared to only 170 in 1957 when Elvis died. At this rate of growth, experts predict that, by 2019, Elvis impersonators will make up a third of the world population. Robert E. Lupinskie Center for Curriculum, Instruction and Technology One Merrick Ave · Westbury, New York 11590 (516) 608-6640 · Fax: (516) 608-6616
Mistakes Made on the this Slide • Elvies’ name is incorrectly spelled. • Elvis died in 1977 not 1957. • The data analysis predicting the trend is meant to be comically absurd. • Therefore, each of us should look at all data conclusions with skepticism, and each of us should do our own analyses of all data conclusions. Robert E. Lupinskie Center for Curriculum, Instruction and Technology One Merrick Ave · Westbury, New York 11590 (516) 608-6640 · Fax: (516) 608-6616
Overall Best Source for School Data • 2012-2013 School and District Report Cards • https://reportcards.nysed.gov/ • Or go to www.nysed.gov and search for “2012 - 13 school report cards” Robert E. Lupinskie Center for Curriculum, Instruction and Technology One Merrick Ave · Westbury, New York 11590 (516) 608-6640 · Fax: (516) 608-6616
Recommend
More recommend
