Simula'onBasedAssessments UtahsPerspec've InterestinEAGpar'cipa'on - PowerPoint PPT Presentation

Simula'on
Based
Assessments
 Utah’s
Perspec've


Interest
in
EAG
par'cipa'on
 • To
Contribute
 • To
Learn
 • To
Extend
our
own
work
 • To
Extend
educator
prac'ce


Related
Ac'vi'es
 • Computer
Based
Tes'ng
is
the
model
in
Utah
 • Computer
Innova've
/
Technology
Enhanced
 Item
Development
 • Forma've
Assessment
literacy
work
 • Forma've
Assessment
tools
(UTIPS)


Related
Ac'vi'es 
 Computer
Based
Summa've
Tes'ng
in
Utah 
 • ALL
Summa've
Assessments
are
available
via
 computer
(except
for
ELP)
 • 80%
of
administra'ons
were
delivered
via
CBT
 in
2010
(up
from
8%
in
2006)


Related
Ac'vi'es 
 Forma've
Assessment
Support 
 • Forma've
Assessment
Prac'ces
Professional
 Development
 • Forma've
Assessment
Tools
(UTIPS)
 – Statewide
Online
system
that
provides
Utah
DoE
 endorsed
(and
aligned)
Items
for
teacher
use
 • MC,
CR,
Performance
Task,
etc.
 – Provides
repor'ng
and
data
manipula'on
 capabili'es


Related
Ac'vi'es 
 CII/TE
Item
Work 
 • Purpose
 – To
achieve
greater
validity
and
engagement
as
 compared
to
mul'ple
choice
items
 • Characteris'cs
 – Computer‐delivered
item
 – Student
interac'vity
 – Cannot
be
easily
translated
to
paper
 – New
item
formats
beyond
mul'ple‐choice


~Major
func'onal
parts
of
items
 • Hot
spot
 • Click
and
drag
 • Mul'ple
selec'ons
 • Item
adjustment
dependent
on
part
of
 response


~Background of CII: Searching the Literature • Applies
universal
design
( Mul'ple
means
of
 representa'on,
expression,
engagement)
 • Assesses
learning
not
measurable
using
 tradi'onal
formats
 • Measures
broader
range
of
KSA
 • Simulates
real‐life
situa'ons
 • Requires
higher
cogni've
demand
 • Reduces
effects
of
successful
guessing
 • Prompts
memory
by
providing
visual
support
 • Engages
the
student
on
a
more
personal
level
 • Reduces
reading
load


~Tenta8ve 8meline of CII in Utah: • 2008:
Began
Development
 • 3
–
8/09:
Development
of
Graphics,
Storyboards,
 Technical
requirements
 • 1/10:
Teacher
Review
 • 3/10:
Cogni've
lab
with
four
items
 • 5
–
6/10:
Item
tryout
with
200‐300
students
of
20
items
 • Summer
2010:
Expansion
of
CII
to
ELA/Math
 development
 • Spring
2011:
State‐wide
pilot
of
CII
items
 • 2012:
Some
Science
CII
become
opera'onal
 • and
beyond
.
.
.

 • Fold
into
Consor'um
development


~As
part
of
a
comprehensive
 assessment
system
 • Items
are
currently
being
developed
through
a
 summa've
perspec've
 • Intended
to
support
classroom
focus
on
the
 curriculum
 • Intended
to
support
classroom
assessment
 efforts
 • Models
will
be
available
for
classroom
use
as
well
 as
summa've
assessment
 • Items
will
curb
the
tendency
to
solely
focus
on
 recall
mul'ple
choice
instruc'on


Thoughts
on
Parts
of
the
Project
 • Planning
and
involvement
of
state
partners
 – Prepara'on
and
review
of
materials
 • Teacher
Training
 • Classroom
Implementa'on
 • ~Cogni've
Lab
work


Role
of
Project
in
the
Future
 • Comprehensive
Assessment
System
Vision
 – Statewide
 – Consor'um
 • Close
rela'onship
between
statewide
summa've
 tes'ng
and
classroom
instruc'on
 • Posi've
influence
on
classroom
instruc'on
 – Related
to
statewide
summa've
tes'ng
 – Related
to
forma've
assessment
prac'ces
 • Science
is
where
it
begins,
but
not
where
it
ends.