Teacher-sourcing semantic information in a Physics blended-learning environment Elad Yacobson Asaf Bar Yosef Eliran Hen Giora Alexandron
לחץלקבלתהצעותלפעילויות המשך
Overall rationale
Generating Semantic metadata • Conservative approach: Expert tagging • Limitations: • Doesn’t Scale • Content and context are dynamic
Our approach – Crowdsourcing • Crowdsourcing from teachers and learners ( teacher/learner-sourcing ) • Can (potentially) address all the limitations just mentioned • Challenges: • Accuracy • Motivation • Coverage [how do we cover all the aspects that we need] • Design research: How to optimize accuracy, incentives, and coverage
Example of one unit – Magnetism Developing the Level 4 taxonomy + tagging the content took a few months !!!
Pilot Experiment: Teacher-sourcing A question on Magnetism Tag Yes/No 4 Possible tags
RESULTS - Experiment #1 8 teachers, 8 items
RESULTS - Experiment #2 7 teachers, 2 items
Pilot study – Lessons Learned • High agreement between experts and teachers (Cohen Kappa 0.56) • Teachers were able to tag questions without full knowledge of the taxonomy from which the tags were taken • Teachers needed to solve the questions in order to tag them • Teachers’ motivation affected accuracy of tagging • Contribution to teachers’ Professional Development? • Next step: a pop-up survey to collect metadata @scale
Research Team Elad Yacobson Asaf Bar Yosef Eliran Hen Giora Alexandron Thanks for listening!
Recommend
More recommend
