MEDICAL EDUCATION RESEARCH & SCHOLARSHIP Ulemu Luhanga, PhD - PowerPoint PPT Presentation

MEDICAL EDUCATION RESEARCH & SCHOLARSHIP Ulemu Luhanga, PhD – Education Researcher (GME) Linda Orkin Lewin, MD – Education and Professional Development Consultant

Overview • Introductions • Clinical vs Education Research • Medical Education Research & Scholarship • Research & Education Development Cycles • Activity & Real World Examples

Types of Research Clinical Research Education Research • Study of health and illness • Study of education and in people learning processes • How to prevent, diagnose, • Describe, understand, and treat illness and explain how learning takes place • Controlled settings (Protocols) • Naturalistic & (Semi- controlled) settings • Scientific approach • Social Science & Scientific approach

Medical Education Research & Scholarship • What (Purpose) – Contribute new, peer-reviewed resources and outcomes that advance the field of medical education • Why (Goal) – Improve educational outcomes & (indirectly) improve clinical & patient outcomes Patient Outcomes Clinical Outcomes Educational Outcomes

Research & Development Cycles Development Cycle Research Process (Curriculum, Assessment, & Instruction) Research Problem Question Identification Literature Evaluation & Needs Dissemination Review Feedback Assessment Data collection Goals and Study Design Implementation & analysis Objectives Logistics & IRB Educational Approval Strategies See: Curriculum Development in Medical Education by David E. Kerns et al

Medical Education Research Development Cycle Problem Identification Research Question Needs Evaluation & Feedback Assessment Literature Dissemination Review Data collection Study Design & analysis Goals and Implementation Objectives Logistics & IRB Approval Educational Strategies

ACTIVITY Think about an educational dilemma in your life…

Step 1: Problem Identification • PICO • P opulation, I ntervention, Problem C omparator/Control, O utcome Identification • PICO – quantitative Research Question • PO – qualitative / descriptive Needs Evaluation & Feedback Assessment Literature Dissemination • Kirkpatrick's Four-Level Training Review Evaluation Model Data Study Design collection & • Reaction - perceptions of analysis Goals and Implementation Objectives training Logistics & • Learning - change in knowledge IRB Approval (educational outcomes) Educational Strategies • Behavior - change in actions • Results – clinical/patient outcomes

Step 1: Example • What would be your research question? May start with a thought and refine question as Problem Identification you go … Research Question Needs Evaluation & • Ours was “Does a 2 hour Feedback Assessment Literature workshop using the 5 Cs Dissemination Review model improve pediatric Data residents’ skill in Study Design collection & analysis Goals and communicating with Implementation Objectives consultants ?” Logistics & IRB Approval Educational • Kirkpatrick level? Ours was Strategies change in action – but using simulation

Step 2: Targeted Needs Assessment • What is already known about the your topic of interest? Problem • Search engines: PubMED, Web Identification of Science, EBSCOhost*, ERIC, Research etc. Question Needs Evaluation & Feedback Assessment • Who is the targeted learner Literature Dissemination Review group? Data • Ideal and actual characteristics of Study Design collection & analysis Goals and the group? Implementation Objectives • Ideal and actual characteristics of Logistics & IRB Approval their environment? Educational Strategies

Step 2: Example • What is known and who are you targeting? Problem Identification • In our example – communication Research skills specifically targeted in Question Needs Evaluation & competencies; documented poor Feedback Assessment Literature PC-specialist communication in Dissemination Review peds; validated tool created for Data ED use Study Design collection & analysis Goals and Implementation Objectives Logistics & IRB Approval Educational Strategies

health.library.emory.edu

Step 3: Goals and Objectives • Quantitative Methodology • Describe, explain, predict • Identify relationships (variables) • Test theory Problem Identification • Approaches: Cross-sectional, Research Cohort, Case-Control, Randomized Question Control, etc. Needs Evaluation & Feedback Assessment Literature • Qualitative Methodology Dissemination Review • Explore, discover, construct • Identify patterns (themes) Data Study Design collection & • Increase understanding; Build theory analysis Goals and Implementation Objectives • Approaches: Ethnography, Logistics & Phenomenology, Grounded Theory, IRB Approval Case Study Educational Strategies • Survey Methodology* • Describe

Step 3: Example Problem • How would you study your Identification question? Research Question Needs Evaluation & • For us – performance before and Feedback Assessment Literature after intervention Dissemination Review Data Study Design collection & analysis Goals and Implementation Objectives Logistics & IRB Approval Educational Strategies

Step 4: Educational Strategies • Content • What do you need to run your intervention? Problem Identification • What does your data collection instrument need to measure? Research Question • Is there an existing tool you can Needs Evaluation & Feedback Assessment use? Literature Dissemination Review • Methods Data Study Design collection & • Who will conduct data collection? analysis Goals and Implementation • Who will conduct data analysis? Objectives Logistics & IRB Approval • Logistics & IRB Educational • Who are the participants? Strategies • Where is the study going to take place? • Who needs to approve the study?

Step 4: Example Problem Identification • What is your intervention and what Research Question approvals do you need? Needs Evaluation & Feedback Assessment Literature Dissemination • Intervention is 2 hour workshop Review based on 5 Cs. Got exemption from Data IRB. Also needed to create “test” by Study Design collection & analysis Goals and Implementation writing and piloting 2 cases. Objectives Logistics & IRB Approval Educational Strategies

irb.emory.edu

Step 5: Implementation • Quantitative Methodology • Describe, explain, predict • Identify relationships (variables) • Test theory Problem Identification • Methods : Tests, Assessments, Research Question Questionnaires (Surveys*), Rating Needs Evaluation & Feedback Assessment Scales, etc. Literature Dissemination Review • Qualitative Methodology Data Study Design collection & • Explore, discover, construct analysis Goals and Implementation • Identify patterns (themes) Objectives • Increase understanding; Build theory Logistics & IRB Approval Educational • Methods : 1-1 Interviews, Focus Strategies Groups, Observations, etc. • Survey Methodology • Methods : Questionnaires, Interviews

Step 5: Example Problem • How would you analyze your data? Identification Research • Did ratings of simulated consult Question Needs Evaluation & calls before and after workshop. Feedback Assessment Literature Also looked for inter-rater reliability Dissemination Review to strengthen results, as well as Data time of consult calls. Study Design collection & analysis Goals and Implementation Objectives Logistics & IRB Approval Educational Strategies

Step 6: Evaluation and Feedback • Conferences • AAMC – Research In Medical Problem Education (RIME) Identification • ACGME Research Question • AMEE (Association for Medical Needs Evaluation & Education in Europe) Feedback Assessment Literature Dissemination • CCME (Canadian Conference on Review Medical Education) Data Study Design collection & • Resource Publications analysis Goals and Implementation Objectives • MedEdPORTAL Logistics & • Journal Publications IRB Approval • Academic Medicine Educational Strategies • Medical Education • Teaching & Learning in Medicine

Step 6: Example Problem • How would you disseminate this? Identification Research Question • Ours was presented at several Needs Evaluation & national meetings – ESPR, APPD, Feedback Assessment Literature and a manuscript has been Dissemination Review submitted (and so far rejected) Data Study Design collection & analysis Goals and Implementation Objectives Logistics & IRB Approval Educational Strategies