Comparing NAEP and the Next Generation Science Standards (NGSS) Teresa Neidorf, Yan Wang, Alka Arora, and Kim Gattis American Institutes for Research June 24, 2015 – CCSSO/NCSA – San Diego, CA
The NGSS and NAEP Frameworks K-12 Framework (NRC 2012) NAEP NAEP NAEP Mathematics Science TEL Framework Framework Framework NGSS (Lead States 2013)
Overview of the Session I. Introduction Goals of the study Overview of NGSS and NAEP frameworks II. Methods I. Results Science comparisons TEL comparisons Mathematics comparisons II. Summary and Implications 3
Goals of the Framework Comparison Study Determine the extent of alignment between the NGSS and the NAEP STEM frameworks • NAEP Science • NAEP Technology and Engineering Literacy (TEL) • NAEP Mathematics (supplements the science and TEL comparisons) Provide evidence of where NAEP includes measures of the student understandings described in the NGSS Identify areas where NGSS and NAEP differ in content coverage • Inform ongoing discussions of NAEP’s role in emerging national and state systems of STEM assessments
Dimensions of the NGSS and NAEP Frameworks NGSS NAEP Science NAEP TEL Disciplinary Core Ideas (DCIs) Content Areas Assessment Areas (Content Domains) Scientific & Engineering Practices Science Practices TEL Practices Crosscutting Concepts NGSS Peformance Expectations integrate all 3 dimensions NGSS: - Describe what ALL students should know and be able to do across grades K-12 NAEP Frameworks: - Guide development of assessments at grades 4, 8 and 12 - Provide a measure of student proficiency (across achievement levels) 5
Example NGSS Performance Expectation Table 6 Source: NGSS lead states (2013)
Comparing the Content Dimension NGSS NAEP Science NAEP TEL Content Domains Content Areas Assessment Areas Physical Sciences Physical Science Life Sciences Life Science Earth & Space Sciences Earth & Space Sciences Engineering, Technology, and Design & Systems Applications of Science (ETS) Technology & Society - Engineering Design Information & - Links Among Engineering, Technology, Science, & Society Communication Technology (ICT)
Organization of Content NGSS NAEP Science NAEP TEL Content Domain Content Area Assessment Area Core Idea Topic Subarea Component Idea Subtopic Performance Expectation Content Statement Assessment Target (PE) Lower Elementary (grades K ‐ 2) Lower Elementary (grades K-2) Upper Elementary (grades 3 ‐ 5) Upper Elementary (grades 3-5) Grades 4, 8 and 12 Grades 4 & 8 Middle School (grade 8) Middle School (grade 8) High School (grade 12) High School (grade 12) 8
Organization of Science Content NAEP NGSS Content Domain Earth & Space Content Area Earth & Space Sciences Sciences Core Idea Earth’s place in the Topic Earth in space and time universe Component Idea Earth and the solar Subtopic Objects in the universe system MS ‐ ESS1 ‐ 2: Develop and E08.02: Gravity is the force Performance Content use a model to describe that keeps most objects in Expectation Statement the role of gravity in the the solar system in regular motions within galaxies and predictable motion. and the solar system. Those motions explain such phenomena as the day, the year, phases of the moon, and eclipses. 9
Comparing the Practices Dimension NGSS NAEP Science & TEL Scientific & Engineering Practices Practices 1. Asking questions (science) and defining NAEP Science problems (engineering) 1. Identifying science principles 2. Developing and using models 2. Using science principles 3. Planning and carrying out investigations 3. Using scientific inquiry 4. Analyzing and interpreting data 4. Using technological design 5. Using mathematics and computational thinking NAEP TEL 6. Constructing explanations (science) and 1. Understanding technological principles designing solutions (engineering) 2. Developing solutions and achieving 7. Engaging in argument from evidence goals 8. Obtaining, evaluating, and communicating 3. Communicating and collaborating information 10
Research Questions 1. Science : How similar (or different) are the NGSS performance expectations in physical sciences, life sciences, and Earth and space sciences to the content and practices in the NAEP science framework at the corresponding grade levels? 2. TEL : How similar (or different) are the NGSS performance expectations in engineering, technology, and applications of science to the content and practices in the NAEP technology and engineering literacy framework at the corresponding grade levels? 3. Mathematics : To what extent are the mathematics-related NGSS performance expectations and practices aligned with the content and skills specified in the NAEP mathematics framework, and at which grade (s)? 11
Methods – Science & TEL 1. Content mapping (AIR research team) • Grouped relevant portions of the NGSS performance expectations (PEs) with NAEP science and TEL framework objectives that covered related content at the corresponding grade level • Identified non-grouped NGSS PEs and NAEP objectives 2. Expert panel review and ratings (7 members) • Content similarity • Grade level alignment (science only) • Practices alignment 3. Aggregation & Analysis (quantitative and qualitative)
Content Mapping Example (Physical Sciences) NGSS NAEP HS-PS2-4 P12.22 Use mathematical representations of Gravitation is a universal attractive force that Newton’s Law of Gravitation and Coulomb’s each mass exerts on any other mass. The Law to describe and predict the gravitational strength of the gravitational force between two and electrostatic forces between objects. masses is proportional to the masses and inversely proportional to the square of the distance between them. --- P12.23 Electric force is a universal force that exists between any two charged objects. Opposite charges attract while like charges repel. The strength of the electric force is proportional to the magnitudes of the charges and inversely proportional to the square of the distance between them. Between any two charged particles, the electric force is vastly greater than the gravitational force. 13
Example Non-Grouped Science Objectives NGSS NAEP 4-LS1-2 None Use a model to describe that animals receive different types of information through their senses, process the information in their brain, and respond to the information in different ways None E08.07 The atmosphere is a mixture of nitrogen, oxygen, and trace gases that include water vapor. The atmosphere has a different physical and chemical composition at different elevations. 14
Expert Panel Ratings • Content Similarity - Each NGSS/NAEP grouping of objectives at the corresponding grade was reviewed and compared for similarity of content using a 4-point scale. 4 = Exactly or almost the same 3 = Quite similar, but with some differences 2 = Quite dissimilar, but with some overlap 1 = Substantially or wholly different • Grade Level Alignment (science only) - Panelists identified alternative objectives at other grade levels that covered similar content. • Practices Alignment – Each NGSS performance expectation was rated for alignment with a NAEP practice (primary/secondary)
Example NGSS/NAEP Science Ratings DCI NGSS NAEP Content NAEP Performance Content Rating Science Expectation Statement (1, 2, 3, 4) Practices P8.8 Energy MS-PS3-1 2 ISP Objects and Construct and interpret substances in graphical displays of USP motion have data to describe the kinetic energy relationships of kinetic USI energy to the mass of an object and to the UTD speed of an object. ISP Identifying Science Principles USP Using Science Principles USI Using Scientific Inquiry UTD Using Technological Design
Results • Content Overlap – NGSS and NAEP objectives judged as covering related content at the corresponding grade level (final groupings determined by expert panel) • Content Alignment – NGSS and NAEP objectives rated as “similar” (two-thirds or more of panelists assigned a rating of 3 or 4) • Practices Alignment – NGSS performance expectations whose associated practices were aligned to a NAEP practice (most frequently identified by panelists as the “primary” practice)
Science Comparison Results 18
Content Overlap of NGSS Performance Expectations and NAEP Science Content Statements NGSS NAEP 100% 88% 84% 84% 80% 74% 64% 60% 40% 29% 20% (33) (55) (43) (67) (49) (14) 0% Grade 4 Middle School High School 19
Alignment by Content Area NGSS Performance Expectations Aligned to NAEP Science Overall Physical Sciences Life Sciences Earth & Space Sciences 100% 80% 60% 54% 53% 50% 48% 47% 46% 42% 42% 42% 40% 40% 36% 29% 20% 0% Grade 4 Middle School High School 20
Examples of Similar Content in Science Grade 4 Middle School High School Forms of energy Evidence of chemical Patterns in the periodic reactions table Structures & functions in organisms Particulate nature of Nuclear fission & fusion matter Effects of weathering & Gravitational & electric erosion Organs & organ systems forces Human use of natural Interactions in ecosystems Role of DNA resources Natural selection Energy flow through trophic levels Model of the solar system Natural selection & Lithospheric plate evolution movement Big Bang theory Plate tectonics 21
Recommend
More recommend
