10/7/19 SIG FEEDBACKFRUITS VU NT&L / BETA OCTOBER 7TH, 2019 1 Intro: Danny Scholten • 2008-2013: PhD & PD in Medicinal Chemistry SIG FeedbackFruits • 2014-Now: Teacher Pharmaceutical Sciences – Focus on educational innovation – Initiator of FeedbackFruits @ BETA • “Innovations in Human Health & Life Sciences” – Prof.dr. Jacqueline van Muijlwijk • Contact details – 020 59 3918 – danny.scholten@vu.nl 2 1
10/7/19 Why FeedbackFruits? • Active learning works* – Focus on: student activity, (peer) feedback SIG FeedbackFruits • Plethora of tools to support active learning – Many not directly available in canvas • Barrier to incorporate proven innovations – E.g. Staff workload * Freeman S, et al., PNAS. 2014 , 111, 8410 * Schneider, M., & Preckel, F., Psych. Bulletin. 2017 , 143 (6), 565-600 3 FeedbackFruits: a solution? • Integrated in canvas • User-friendly & consistent interface SIG FeedbackFruits • Facilitates active learning 4 2
10/7/19 The Long and Winding Road Evaluations NT&L June 2018 Dec 2018 Sep-dec 2019 June 2019 SIG FeedbackFruits Presentation FbF Order of First Multiple licence pilot pilots BETA agrees to Fac. licence IT testing ü Safety ü Functionality Data Processing ü Canvas integration Agreement Start of Rollout over DPIA (privacy) Licence BETA faculty � Feb-Mar 2020 Feb 2019 Technical assessment (IT) 5 Interactive documents SIG FeedbackFruits 6 3
10/7/19 Interactive video SIG FeedbackFruits 7 Overview for the teacher SIG FeedbackFruits 8 4
10/7/19 Feedback tools • (Peer) Feedback including reflection + Critical thinking & self-reflection SIG FeedbackFruits + Students can learn from each other’s work + Improve quality of final draft • Feedback plugins + Simple interface + Process guidance & automation + Group & individual assignments 9 First Pilot FeedbackFruits • Project Modern Developments in Pharmaceutical Sciences (6 EC) SIG FeedbackFruits – 2nd year, period 6 – Focus on academic skills in context – Assignments in groups of 3 students – Teachers: Danny Scholten & Anneke Vuuregge • Group literature review on a drug • Peer review is done for a few years now – Group A gives feedback on B, B on C, etc. – Feedback quality can be improved – Organizing all logistics is quite labor-intensive – No good overview of the process us as teachers 10 5
10/7/19 First Pilot FeedbackFruits • Major aims of improvement with FbF – More overview of the peer review process SIG FeedbackFruits – Less time spent on logistics – Higher-quality feedback reports • Setup of pilot – 44 students; groups of 3 – Group literature review on drug (unchanged) – Individual students review the draft – Each group receives 3 reviews • Reflect on reviews and make a plan for improvement – The final version is graded by us using same criteria 11 Results Pilot FeedbackFruits • Overall positive! – Assignments and rubrics can be easily copied – Deadlines can be applied to each step (canvas agenda) SIG FeedbackFruits – FbF distributes the reviews fairly to all students – Feedback process takes less time – Students can only submit review after meeting criteria – Feedback is directly linked to grading criteria – Students generally take it seriously – Students are generally satisfied with the system – All steps of the process can be monitored – Feedback quality seems to have improved 12 6
10/7/19 Results Pilot FeedbackFruits • Downsides – 2 major crashes during pilot (quickly & permanently fixed by FbF) – Canvas student view does not work (inherent to external tool) SIG FeedbackFruits – Some small issues with feedback editor (fixed) – Did not spend less time yet… but expect to next time! 13 Addendum • Assignment Feedback is a module similar to Peer Feedback – Uses the same structure, incl. rubrics and feedback editor/view SIG FeedbackFruits – However, only teachers can review 14 7
10/7/19 FeedbackFruits in action: Demo SIG FeedbackFruits Want a demo for your own group/program? Contact: danny.scholten@vu.nl 15 8
Recommend
More recommend