New York State School Boards Association August 14, 2015 Data Use for Accountability and Student Achievement From School Performance to Teacher Growth Scores Fred Cohen, Nassau BOCES Data Warehouse Specialist fcohen@mail.nasboces.org 608-6640
First, a quick question. Which is correct? Data for the 2014-2015 assessments (is, are) now available! Robert E. Lupinskie Center for Curriculum, Instruction and Technology One Merrick Ave · Westbury, New York 11590 (516) 608-6640 · Fax: (516) 608-6616
Now that I know that “data” is usually considered plural, what do I do with “these” data? Robert E. Lupinskie Center for Curriculum, Instruction and Technology One Merrick Ave · Westbury, New York 11590 (516) 608-6640 · Fax: (516) 608-6616
Here’s an idea suggested by Robert Burn’s 1786 poem, “The Louse” “And if some Power this small gift give us To see ourselves as others see us! It would from many a blunder free us….” (modern translation) Robert E. Lupinskie Center for Curriculum, Instruction and Technology One Merrick Ave · Westbury, New York 11590 (516) 608-6640 · Fax: (516) 608-6616
Or, in the immortal words of New York City’s three -time mayor, Ed Koch How ‘m I doin’? Mayor Ed Koch
But before we can decide what data to use in our self-reflection, some guidelines developed over the past 49 years Robert E. Lupinskie Center for Curriculum, Instruction and Technology One Merrick Ave · Westbury, New York 11590 (516) 608-6640 · Fax: (516) 608-6616
There are four parts to any self-reflection or data analysis • Trends — compare yourself to yourself. • The competition — compare yourself to everyone else ( especially those most similar to you ). • Benchmarks — compare yourself to state or national benchmarks, targets, or expectations. • Disaggregate the data — break down the data into subgroups and other meaningful divisions. Robert E. Lupinskie Center for Curriculum, Instruction and Technology One Merrick Ave · Westbury, New York 11590 (516) 608-6640 · Fax: (516) 608-6616
How is each separate school and each subgroup population doing? • Overall, our students are doing quite well. • But what if district scores soar while one school lags far behind? • And what if special education students, students of limited English proficiency, low income students, or other subgroups are failing? Robert E. Lupinskie Center for Curriculum, Instruction and Technology One Merrick Ave · Westbury, New York 11590 (516) 608-6640 · Fax: (516) 608-6616
Data savvy people are aware of this additional obligation to “Disaggregate the data!” • It is not sufficient to achieve overall success. (“Our school/district is performing well.”) • Every distinct population must also perform well. Robert E. Lupinskie Center for Curriculum, Instruction and Technology One Merrick Ave · Westbury, New York 11590 (516) 608-6640 · Fax: (516) 608-6616
That makes four questions which must be answered to begin a true data analysis. Robert E. Lupinskie Center for Curriculum, Instruction and Technology One Merrick Ave · Westbury, New York 11590 (516) 608-6640 · Fax: (516) 608-6616
Four Key Issues to Consider Trends — how did my district do compared to last year? 1. (and the year before) The overall competition — how are other districts, 2. especially similar districts, doing? (in the county, state) State targets — what benchmarks or expectations have 3. been set by the State and Federal Government? ( Adequate Yearly Progress or AYP ) 4. When we disaggregate our data, how are each of our subgroups doing? (both genders, all ethnicities, special ed, limited English proficient, and low income students). Also disaggregate by school and teacher. Robert E. Lupinskie Center for Curriculum, Instruction and Technology One Merrick Ave · Westbury, New York 11590 (516) 608-6640 · Fax: (516) 608-6616
What follows are samples of Nassau BOCES Instructional Data Warehouse Reports that Offer these Insightful Reflections Robert E. Lupinskie Center for Curriculum, Instruction and Technology One Merrick Ave · Westbury, New York 11590 (516) 608-6640 · Fax: (516) 608-6616
The Snapshot Report — A Simple Performance Level Comparative Analysis Compare to last year Disaggregate 2014/2015 Compare to everyone else by school Compare to state targets Disaggregate the data Robert E. Lupinskie Center for Curriculum, Instruction and Technology One Merrick Ave · Westbury, New York 11590 (516) 608-6640 · Fax: (516) 608-6616
The Trends Analysis — A Longitudinal Perspective 69.0 Compare to last year Compare to everyone else Compare to state targets Disaggregate the data Robert E. Lupinskie Center for Curriculum, Instruction and Technology One Merrick Ave · Westbury, New York 11590 (516) 608-6640 · Fax: (516) 608-6616
The Subgroup Analysis Report — Disaggregating Results by Subgroup Compare to last year Compare to everyone else Compare to state targets The purpose of disaggregation 2014-2015 89.2% 69.1% 84.5% Robert E. Lupinskie Center for Curriculum, Instruction and Technology One Merrick Ave · Westbury, New York 11590 (516) 608-6640 · Fax: (516) 608-6616
The Gap Report A Question by Question Comparison to the Nassau County Region Robert E. Lupinskie Center for Curriculum, Instruction and Technology One Merrick Ave · Westbury, New York 11590 (516) 608-6640 · Fax: (516) 608-6616
Grade 3-8 Assessments and Regents Assessments Compare to last year Compare to everyone else Compare to state targets Disaggregate the data Robert E. Lupinskie Center for Curriculum, Instruction and Technology One Merrick Ave · Westbury, New York 11590 (516) 608-6640 · Fax: (516) 608-6616
Robert E. Lupinskie Center for Curriculum, Instruction and Technology One Merrick Ave · Westbury, New York 11590 (516) 608-6640 · Fax: (516) 608-6616
Robert E. Lupinskie Center for Curriculum, Instruction and Technology One Merrick Ave · Westbury, New York 11590 (516) 608-6640 · Fax: (516) 608-6616
The Gap Report for Released Questions — A Question by Question Comparison to the Nassau County Region with links to actual questions released by SED Robert E. Lupinskie Center for Curriculum, Instruction and Technology One Merrick Ave · Westbury, New York 11590 (516) 608-6640 · Fax: (516) 608-6616
Robert E. Lupinskie Center for Curriculum, Instruction and Technology One Merrick Ave · Westbury, New York 11590 (516) 608-6640 · Fax: (516) 608-6616
Robert E. Lupinskie Center for Curriculum, Instruction and Technology One Merrick Ave · Westbury, New York 11590 (516) 608-6640 · Fax: (516) 608-6616
The Wrong Answer Summary Analysis (Released Questions) — A Summary of the Wrong Answers Chosen by Students Robert E. Lupinskie Center for Curriculum, Instruction and Technology One Merrick Ave · Westbury, New York 11590 (516) 608-6640 · Fax: (516) 608-6616
Robert E. Lupinskie Center for Curriculum, Instruction and Technology One Merrick Ave · Westbury, New York 11590 (516) 608-6640 · Fax: (516) 608-6616
Robert E. Lupinskie Center for Curriculum, Instruction and Technology One Merrick Ave · Westbury, New York 11590 (516) 608-6640 · Fax: (516) 608-6616
Teacher by Teacher Analysis (Disaggregate the data) Teacher # Students % Correct B % Distractor D A 82 59% 33% B 87 52% 40% C 101 66% 27% D 76 49% 40% E 97 44% 42% F 71 73% 15% Teachers must have access to their released question data, as soon after their September return to school, as possible. Robert E. Lupinskie Center for Curriculum, Instruction and Technology One Merrick Ave · Westbury, New York 11590 (516) 608-6640 · Fax: (516) 608-6616
Even the Most Ardent Critics of Current NY Test Policy Support This Test Analysis • From Carol Burris’ Hechinger Report blog: “I am not discounting the importance of using student achievement in assessing teacher quality and in helping teachers improve. Prior to the mandated use of scores, I used achievement results to help guide my observations, review teacher lesson plans and design professional development.”
Time for a musical interlude! Robert E. Lupinskie Center for Curriculum, Instruction and Technology One Merrick Ave · Westbury, New York 11590 (516) 608-6640 · Fax: (516) 608-6616
I adapted the following statement about Elvis from “Naked Scientists Podcasts” as reported by Free Movement Magazine , November 13, 2007 Robert E. Lupinskie Center for Curriculum, Instruction and Technology One Merrick Ave · Westbury, New York 11590 (516) 608-6640 · Fax: (516) 608-6616
• The number of Elvies Presley impersonators has reached an all-time record high – there are now at least 85,000 Elvis’s around the world, compared to only 170 in 1967 when Elvis died. At this rate of growth, experts predict that, by 2019, Elvis impersonators will make up a third of the world population. Robert E. Lupinskie Center for Curriculum, Instruction and Technology One Merrick Ave · Westbury, New York 11590 (516) 608-6640 · Fax: (516) 608-6616
Recommend
More recommend
