Computer Adaptive Testing Lawrence M. Rudner Consultant Paper - PowerPoint PPT Presentation

Computer Adaptive Testing Lawrence M. Rudner Consultant

Paper & Pencil 1.00 0.75 Easiness 0.50 0.25 0.00 0 5 10 15 20 Item Order

Hard Ability Wrong Level Wrong Right Wrong Item Difficulty Right Right Right Right Right Easy 1 2 3 4 5 6 7 8 9 10 11 12 From http://www.rasch.org/memo69.pdf

1.00 0.75 Easiness 0.50 0.25 0.00 0 5 10 15 20

IRT Approach 1 1 Prob of a correct response Prob of a correct response 0.8 0.8 0.6 0.6 0.4 0.4 0.2 0.2 0 0 -3 -2 -1 0 1 2 3 -3 -2 -1 0 1 2 3 Ability Ability

Multi-Stage Approach

-3 -2 -1 0 1 2 3

Decision Theory Approach Test Taker 111 [1,1,1,1,1,1,1,1,0,1] 1.0 1.0 Master 0.9 Non-master 0.9 0.8 0.8 0.7 lity 0.7 obabili Probabi 0.6 0.6 0.5 0.5 0.4 0.4 0.3 0.3 0.2 0.2 0.1 0.1 0.0 1 3 5 7 9 1 3 5 7 9 0.0 Item Response onse Probabilit abilitie ies non-master master

Advantages Disadvantages • Shorter tests • Big bank • Better precision • Pretested items • Security ? • Good item statistics • Retesting • Over exposure - ? • Computer capabilities • Security - ? • Examinee experience • No review ? • Motivation • Customer Care