Properties and Applications of Wrong Answers in Online Educational - PowerPoint PPT Presentation

Properties and Applications of Wrong Answers in Online Educational Systems ı ˇ Radek Pel´ anek, Jiˇ r´ Rih´ ak Masaryk University Brno

Wrong answer Wrong answer Learner input to wrongly answered question ı ˇ Radek Pel´ anek, Jiˇ r´ Rih´ ak Wrong Answers

Wrong answers Feedback for teachers common mistakes of a class ı ˇ Radek Pel´ anek, Jiˇ r´ Rih´ ak Wrong Answers

Wrong answers Detecting level of knowledge 5 × 5 � = 30 5 × 5 � = 24 5 × 5 � = 17 ı ˇ Radek Pel´ anek, Jiˇ r´ Rih´ ak Wrong Answers

Wrong answers Question construction ı ˇ Radek Pel´ anek, Jiˇ r´ Rih´ ak Wrong Answers

Wrong answers Problem in user interface ı ˇ Radek Pel´ anek, Jiˇ r´ Rih´ ak Wrong Answers

Wrong answers . . . and much more ı ˇ Radek Pel´ anek, Jiˇ r´ Rih´ ak Wrong Answers

Systems matmat.cz outlinemaps.org practiceanatomy.com basic arithmetic geography human anatomy elementary school high school university ı ˇ Radek Pel´ anek, Jiˇ r´ Rih´ ak Wrong Answers

Systems simple tasks adaptivity - selection of questions > 200 000 answers ı ˇ Radek Pel´ anek, Jiˇ r´ Rih´ ak Wrong Answers

Wrong Answers - Geography ı ˇ Radek Pel´ anek, Jiˇ r´ Rih´ ak Wrong Answers

Common Wrong Answers Countries common border, similar size, same first latter importance of practice context - Madagascar ı ˇ Radek Pel´ anek, Jiˇ r´ Rih´ ak Wrong Answers

Common Wrong Answers - Geography Romania Norway Sweden ... ı ˇ Radek Pel´ anek, Jiˇ r´ Rih´ ak Wrong Answers

Confusion Graph ı ˇ Radek Pel´ anek, Jiˇ r´ Rih´ ak Wrong Answers

Item Clustering ı ˇ Radek Pel´ anek, Jiˇ r´ Rih´ ak Wrong Answers

Cross-system Comparison ı ˇ Radek Pel´ anek, Jiˇ r´ Rih´ ak Wrong Answers

Categories of Wrong Answers TopWA - most common wrong answer CWA - other common wrong answers - > 5% Other Missing - question skipped by learner ı ˇ Radek Pel´ anek, Jiˇ r´ Rih´ ak Wrong Answers

System comparison Basic Arithmetic Geography Human Anatomy frequency CWA Other T opWA Missing ı ˇ Radek Pel´ anek, Jiˇ r´ Rih´ ak Wrong Answers

System comparison - Response time Basic Arithmetic Geography Human Anatomy Correct CWA Other T opWA Missing ı ˇ Radek Pel´ anek, Jiˇ r´ Rih´ ak Wrong Answers

System comparison - Probability of Leaving Basic Arithmetic Geography Human Anatomy Correct T opWA CWA Other Missing ı ˇ Radek Pel´ anek, Jiˇ r´ Rih´ ak Wrong Answers

System comparison - Future Success future success Basic Arithmetic Geography Human Anatomy Correct T opWA CWA Other Missing ı ˇ Radek Pel´ anek, Jiˇ r´ Rih´ ak Wrong Answers

Categories of Wrong Answers TopWA , CWA , Other , Missing equally distributed linear behaviour similar behaviour in different domains good measure of wrongness - interval variable ı ˇ Radek Pel´ anek, Jiˇ r´ Rih´ ak Wrong Answers

Wrong Answers Wrong answers are easy to collect has many applications : question and hint construction, feedback and inspiration, . . . Contributions item clustering measure of wrongness ı ˇ Radek Pel´ anek, Jiˇ r´ Rih´ ak Wrong Answers