Science Accessibility for Students with Visual Impairments - PowerPoint PPT Presentation

Science Accessibility for Students with Visual Impairments Presenters: Linda M. Hooper James P. Rice Danielle Guzman-Orth Discussant: Cary A. Supalo National Conference on Student Assessment San Diego, California June 27, 2018

Presentations and Discussion  California Science Test (CAST) Overview  CAST: Applying Twinning for Students with Visual Impairments  CAST Cognitive Lab Study for Students with Visual Impairments  Multisensory Learning for Students Who Are Blind or Visually Impaired in the 21 st Century 2 California Department of Education

CAST Overview 3 California Department of Education

CAST: Summarized  The CAST is part of the California Assessment of Student Performance and Progress (CAASPP) System.  The CAST is administered to all students in grades five and eight and once in high school (i.e., grades ten, eleven, or twelve).  Once a high school student takes the CAST, that student may not take the test again.  CAST field testing began April 2, 2018. As of June 20, approximately 1.5 million students had completed the assessment. 4 California Department of Education

CAST Key Events: How We Got Here January – February CA NGSS Framework Focus Groups & Public Comment November We March – May March 2017 – November 2018 SBE adopts the K – 8 Science Instructional Science Leadership are Science Team develops State Materials Review Curriculum here Implementation Framework Plan for CA NGSS September California July January – July March State Board Begin Science April – July March – July CAST SBE adopts the of Education Assessment CAST Field Operational CAST Pilot Test CAST (SBE) adopts Stakeholder Test Test CA NGSS Meetings 2013 2014 2015 2016 2017 2018 2019 Board Legend: Testing Planning Action 5 California Department of Education

CAST Background: Blueprint  The CAST blueprint was approved by the State Board of Education ( SBE) on November 8, 2017.  The blueprint reflects the complexity of the California Next Generation Science Standards (CA NGSS) and their multidimensional aspects.  The CAST includes three science domains (Physical Science, Life Science, and Earth and Space Science). • Engineering, Technology, and Application of Science domain will be incorporated into the three science domains. 6 California Department of Education

CAST Background: Reporting  The CAST student score reporting structure was approved by the SBE in November 2017 and includes an overall scale score and the three-dimensional (3-D) domains of Life Science, Physical Science, and Earth and Space Science. 3-D Overall Scale Score four achievement levels 3-D Physical 3-D Earth and Space 3-D Life Science Science Science 7 California Department of Education

CAST Background: General Achievement Levels  The CAST general achievement level descriptors (ALDs) provide generic descriptions of student performance level expectations across four levels.  The general ALDs will be used to set grade- level-specific ALDs and will be used to develop reporting ALDs that describe levels of performance to educators, students, and parents. 8 California Department of Education

CAST General ALDs (1) Level Description The student has exceeded the performance expectations of the CA NGSS by demonstrating a thorough understanding of the CA 4 NGSS and a thorough ability to apply his or her knowledge and skills through the CA NGSS Science and Engineering Practices, Disciplinary Core Ideas, and Crosscutting Concepts. The student has met the performance expectations of the CA NGSS by demonstrating an adequate understanding of the CA 3 NGSS and an adequate ability to apply his or her knowledge and skills through the CA NGSS Science and Engineering Practices, Disciplinary Core Ideas, and Crosscutting Concepts. 9 California Department of Education

CAST General ALDs (2) Level Description The student has nearly met the performance expectations of the CA NGSS by demonstrating a partial understanding of the CA 2 NGSS and a partial ability to apply his or her knowledge and skills through the CA NGSS Science and Engineering Practices, Disciplinary Core Ideas, and Crosscutting Concepts. The student has not met the performance expectations of the CA NGSS by demonstrating minimal understanding of the CA NGSS 1 and a minimal ability to apply his or her knowledge and skills through the CA NGSS Science and Engineering Practices, Disciplinary Core Ideas, and Crosscutting Concepts. 10 California Department of Education

CAST High-level Test Design 11 California Department of Education

CAST Design Goals  Promote improvements to teaching and learning.  Incentivize science instruction in every grade.  Measure the range and depth of CA NGSS.  Provide models of high-quality assessment items that reflect the fidelity to the CA NGSS.  Minimize testing time and costs.  Accessibility for all California students. 12 California Department of Education

CAST Operational Test Design (1) Assessment Assessment Assessment Assessment Characteristics Segment A Segment B Segment C Grade 5: G3 – 5 PEs* Grade 5: G3 – 5 PEs* Grade 5: G3 – 5 PEs* Performance Grade 8: G6 – 8 PEs Grade 8: G6 – 8 PEs Grade 8: G6 – 8 PEs expectations (PEs) measured by Grades 10, 11, or 12: Grades 10, 11, or 12: Grades 10, 11, or 12: G9 – 12 PEs G9 – 12 PEs G9 – 12 PEs grade/ grade span Broad and deep — full Deep measurement Measures a broad Scope and depth of of a targeted sample range of measurement sample of measurement of a few PEs provided of PEs for each grade CA NGSS PEs in item sets span. Contributes to student Contributes to student Contributes to group Reporting level and group scores and group scores scores *Includes the foundational concepts introduced in K – grade 2 13 California Department of Education

CAST Operational Test Design (2) Assessment Assessment Assessment Assessment Characteristics Segment A Segment B Segment C Two Performance Includes selected- Tasks (PTs) — Includes selected- response, includes selected- response, technology-enhanced response, Type of items technology- items (as with technology- enhanced, machine- segment A) or a enhanced, and scorable items single PT (as with constructed response segment B) items One PT with four to 32 to 34 Number of Two PTs with four to seven items or six discrete (stand- items six items each to seven discrete alone) items (stand-alone) items 14 California Department of Education

CAST Operational: Segment A Segment A is a two-stage adaptive segment. • Segment A combines technology-enhanced, machine-scorable, short answer, and selected response items that cover a very broad range of the CA NGSS performance expectations. • Segment A contributes to student and group scores. Mix of Stage 1: Difficulty First set of items Levels Stage 2: Easy Medium Hard Difficulty Difficulty Difficulty Second set of Level Level Level items 15 California Department of Education

CAST Operational: Transition from Segment A to Segment B Transition Example Segment A:  Performance in Segment All science domains A can guide the selection via discrete items of science domains presented in Segment B . Physical Earth and Science  The assignment of the Space Science Engineering, science domains in Technology, and Life Science Segment B will be random Applications of Science unless performance on a particular science domain Screener in Segment A is Segment B: significantly weak. Selected science domains via PTs 16 California Department of Education

CAST Operational: Segment B Segment B includes PTs that require students to solve a series of complex problems set in domain- specific contexts, which deeply measure a student’s command of selected CA NGSS performance expectations. • PTs consist of four to six items within a science domain. • Segment B contributes to student and group scores. 17 California Department of Education

CAST Operational: Segment C Segment C includes a range of items that, collectively, broadly and deeply measure the CA NGSS performance expectations associated with the tested grade span. • Encourages the teaching of science at all grade levels • Contributes to group-level scores 18 California Department of Education

CAST Student Accessibility 19 California Department of Education

How to Get Involved in the Development of the CAST Opportunities for California educator involvement may include:  Item writing  Item review  Scoring  Data review  Range finding To get involved, complete the content reviewer application at http://caaspp.org/reviewers.html. 20 California Department of Education

For Further Information CDE CAASPP Office 916-445-8765 caaspp@cde.ca.gov California Department of Education CAASPP Web page https://www.cde.ca.gov/ta/tg/ca/ CalTAC Assistance 800-955-2954 caltac@ets.org Join the CAASPP listserv for weekly updates! Send a blank e-mail to subscribe-caaspp@mlist.cde.ca.gov. 21 California Department of Education

California Science Test (CAST): Applying Twinning for Students with Visual Impairments James Rice Presentation for the Council of Chief State School Officers National Conference on Student Assessment June 2018 22

Overview (1)  Background  Introduce twinning  Application  Next steps 23