Evaluating Your Medical Education Gretchen Guiton Director of Evaluation Jennifer Gong Assistant Director of Evaluation Susan Claxon Evaluation Specialist Susan Peth Evaluation Specialist August 2013 - co 2017
Purpose of Presentation Describe changes in the evaluation system and procedures Review evaluation responsibilities and policies Discuss FIRECRACKER Discount (optional) August 2013 - co 2017
Evaluation Changes Decrease evaluation burden Balance assignment to Block or Longitudinal courses Reduce number of lecturer evaluations in Block Eliminate most required comments Change evaluation program Fewer evaluation notices Less confusion (“fingers crossed”) August 2013 - co 2017
Evaluation Process Evaluations will allow completion in “real time” – open at beginning of block All evaluations close on the same day – 10 business days after final exam for Block To reduce burden, class is randomly divided into 2 groups to complete either Block or Longitudinal course evaluations August 2013 - co 2017
ALL STUDENTS Randomize into 2 groups Essential Core Block Longitudinal Courses Evaluate Evaluate Course Block Lecturers & Facilitators in Lecturers (70%) Foundations of Doctoring Threads Small Group Facilitators MSA Evaluate PBL Complete Other Questionnaires August 2013 - co 2017
Evaluation Assignment Based on actual count of numbers of lecturers and facilitators Group A Group B Nervous System Longitudinal during Longitudinal during Nervous System Infectious Diseases DEMS DEMS Life Cycle Life Cycle Infectious Diseases August 2013 - co 2017
Email Notice of Evaluation E-mail notifications will be sent: when evaluations open at beginning of Block (next Friday for NS Block) with completion status one week before final exam if not complete one week prior to close August 2013 - co 2017
Link to Evaluations on Homepage
Sorting Assigned Evaluations Rotation Name is your clue!
“ NETing ” Facilitator Evaluations
“ NETing ” Facilitator Evaluations
Facilitator Evaluation August 2013 - co 2017
Lecturer Evaluation August 2013 - co 2017
Save vs. Submit • Use Save Draft until your evaluation is complete. • Evaluation is not complete until you Submit Final. August 2013 - co 2017
Checking Completed Evaluations • Change Department (top right hand corner of webpage) • Click link – Completed Evaluations (about me and by me) • This will provide you with a list of the evaluations you have completed August 2013 - co 2017
Evaluation Responsibilities and Policies August 2013 - co 2017
Your feedback … Informs curriculum decisions and improvements Motivates faculty to keep and improve teaching Enables you to provide and practice feedback August 2013 - co 2017
How can these be made better? I do not relate to Dr. Xs lecturing style and found the presentation confusing. Knowledgeable, but a little bit difficult to follow. August 2013 - co 2017
What is “good feedback”? Appropriate scope and tone Specific Describes observable behaviors Objective Modifiable Timely Selective Suggests ways to improve/ Reinforces positive August 2013 - co 2017
The impact you intend? Dr. X was the poorest lecturer of the unit. The lectures were poorly organized and the lecture notes were almost impossible to follow. This material should be simplified because the truth is you can just memorize a flow chart and understand everything in under an hour but the lectures made it seem like this was rocket science . August 2013 - co 2017
Let’s talk about your experience … Lectures presenting clinical scenarios were absolutely amazing. Incredibly clear on the presentation of diseases and how to approach using the knowledge we've learned. Which is why it was a surprise as to how unclear the initial Y lecture was. On first pass, both pre-reading and listening to lecture, I was unable to grasp the Y and feel as though the majority of the class feels the same way. Had to use additional, external resources to learn. However, the lecture and handouts were very useful for review once Y was learned and the Z lecture was very clear on how to differentiate the different diseases . August 2013 - co 2017
Evaluation Responsibilities and Policies August 2013 - co 2017
Your Feedback is Confidential Confidential means that your responses can be linked to you Only members of Evaluation Office can view link Data always reported in aggregate form If “anonymous” or “optional” we will inform you August 2013 - co 2017
Evaluations are Required Because your feedback is critical to the on-going monitoring, improvement, and accreditation of the educational program, the Curriculum Steering Committee has made participation in the evaluation system mandatory. Evidence suggests that failure to complete evaluations in medical school is indicative of future professionalism problems in medical school* and in practice.** *Stern, D.P., M, The Developing Physician — Becoming a Professional. New England Journal of Medicine, 2006 **Papadakis, et al. Disciplinary Action by Medical Boards and Prior Behavior in Medical School. New England Journal of Medicine, 2006 . August 2013 - co 2017
Policy on Fulfilling Your Obligation Failure to complete an evaluation on time . results in referral to the Professionalism Committee. Procedure : Evaluation Office notifies the Asst. Dean of the Essentials Core (i.e., Dr. Taylor). 1 st Time 2 nd Time 3 rd Time •Ass’t Dean files • 2 nd Form filed • Meet w/ form w/ Assistant Dean • Professionalism Professionalism Cmte may Committee meet to review August 2013 - co 2017
Firecracker CU SOM Discount
Discount Available to MS2s In the interest of our partnership, we want to give your students ~50% off an 8th month plan That's $88 for 8 months (Sept-April)
In Return, we ask that you Agree to have us receive your use data directly from company so that we can assess the value of Firecracker as a resource. With your approval, the Evaluation Office will receive identifiable information on number of items, frequency of review, and item performance linked to your name. Data analyzed and reported in aggregate to evaluate effectiveness value over and above other study methods. Potential value to future classes studying for Step I, your future board study behaviors, integration of practice tests with Essential Core.
Process Must sign form agreeing to release of information to Evaluation Office Must complete form and turn in to Evaluation Office by Friday September 6 th . We’ll send a link to sign up for Firecracker that will allow you to receive discount. Must access link using your UCDENVER email to receive discount Check out Firecracker at : http://www.youtube.com/watch?v=VNLn dG__YZU
Contact Us! Susan Claxon Susan Peth Jennifer Gong Gretchen Guiton Evaluation Email: SOM.Evaluations@ucdenver.edu Evaluation Website: http://www.ucdenver.edu/academics/colleges/me dicalschool/education/degree_programs/MDProgr am/administration/evaluation/Pages/default.aspx August 2013 - co 2017
Recommend
More recommend