Resident Selection Sharing experiences from using selection science to find the best surgical trainees Brian J. Dunkin, MD, FACS TSDA General Session
Disclosure • Not a selection scientist
Disclosure • I found someone with whom to collaborate! Aimee Gardner, PhD Assistant Dean of Evaluation & Research School of Health Professions Associate Professor, Health Professions & Surgery Baylor College of Medicine Houston, Texas
Disclosure • Ownership interest in SurgWise
Let me tell you a story …
Typical file • USMLE • ABSITE • MIS Case Numbers • Unstructured letters of recommendation • Unstructured personal statements • Unstructured CV
Assessment Tools
USMLE / ABSITE / GRADES
Assessment Tools
We do lots of interviews
Assessment Tools
How could we do this better?
Job Analysis
Job Requirements Competencies
Competencies Assessments
Situational Judgment Tests (SJTs)
Personality Profile • Agreeableness • Extraversion • Emotional Stability • Openness to new experiences • Conscientiousness Gardner AK, Dunkin BJ. JAMA Surgery 2017
Course Topic Delivery Method Other Active Case-based Small Group Didactics Role Play Learning Review Discussion Strategies Part I: Background Structured Interview Basics x x Question Development x x x x Biases in Interviews Part II: Asking Questions x x Getting Complete Responses Types of Interviewing Questions x x Unacceptable & Illegal Questions x x x x Taking Notes x x Part III: Assessment x x x x Assigning Ratings x x Motivational Fit x x Integrating Data Part IV: Putting it All Together Interview Day Basics x Review x x
Technical Skills • Fast-paced program • High complexity • Time-compressed environment
Gardner AK, Dunkin BJ. Annals of Surgery 2018
Could Fit But … Great Fit Not A Good Fit
Gardner AK, Dunkin BJ. Annals of Surgery 2018
Structured Interviews Skills Testing
Information on MIS Candidates for Ranking • SJT • 26 questions • 130 unique data points • Personality profile • 9 competencies interviews • 3 competencies group • Technical skills
Results
Gardner AK, Dunkin BJ. Annals of Surgery 2018
Gardner AK, Dunkin BJ. Annals of Surgery 2018
Gardner AK, Dunkin BJ. Annals of Surgery 2018
55 applicants invited to take online assessment 50 (91%) completed 42 minutes
80% 45% 45% increase in improved higher in how knowledge of agreement to avoid illegal how to conduct among questions structured interviewers interviews
Over 50% less interviews
Success!
Competency-based Selection Aimee K. Gardner, PhD
Recommend
More recommend