Making our work rapid, relevant, & rigorous: How we do it - PowerPoint PPT Presentation

1 Making our work rapid, relevant, & rigorous: How we do it through common measures Sara J. Landes, PhD Behavioral Health QUERI, Central Arkansas Veterans Healthcare System University of Arkansas for Medical Sciences

2

3 • Kathy Dollar • JoAnn Kirchner • Susan Jegley • Geoff Curran • Jan Lindsay • Mark Bauer • Nyssa Curtis • Taren Swindle • Karen Drummond • Chris Miller • Brandy Smith • Ben Teeter • Jennifer Sullivan • Bo Kim • Jack Woods • Jeremy Thomas • Jacob Painter • Dave Oslin • Traci Abraham • Eva Woodward • Jeff Pitcock • Laura Wray • Mary Bollinger • Sacha McBain • Kate Iverson • Richard Goldberg • Kate Comtois • Sonia Singh • Samantha Connolly • Matt Chinman • Bridget Matarazzo • Cindy Moseley • Krissi Morris • Mona Ritchie • Mark Reger • Melissa Zielinski • James Townsend • Jeff Smith • Barbara Johnson • John Areno • Rosemary Nabaweesi

4 • Operational & clinical partners • VA Office of Mental Health and Suicide Prevention • VA Office of Connected Care • VA VISN 16 • Central Arkansas Veterans Healthcare System • Funding • VA HSR&D SDR 16-195 (Landes) • VA QUERI PII 18-195 (Landes) • VA QUERI QUE 15-289 (Kirchner) • NIH NCATS UL1 TR003107 (James)

Partnered research & measurement across a healthcare system 5

Poll: Do you ask your clinical stakeholders what they would 6 like to measure? (aka what keeps you up at night?)

Measurement needs vs. reporting needs of partners 7 (one size doesn’t fit all)

8

Using measures that already exist in healthcare settings 9

Using common measures across projects allows us to 10 synthesize data

How do we maximize this as a field? Share our tools! 11

12

Facilitator Time & Activity Log Ritchie et al., 2019

Key Events Template 14 Personnel Facilitator Broader Clinic Events Changes Activities Context Events Implementation Planning Leaders Communicating with Regional Events (e.g., large Event Staff (formally or informally) initiative roll out) Staff Added/Lost General Education About an Intervention Physical Space Changes (e.g., Organizational Events (e.g., moving locations, equipment new VA secretary) installed) Mentoring of Providers on the Intervention (e.g., coaching and supervision) Leadership Turnover External Events (e.g., political (lost/added) Referral Process Changes changes, impactful current (formal or informal) Data Gathering and Feedback events) Woodward et al., 2016

iPARIHS Codebook 15

SIRC Instrument Repository 16 • Enhanced systematic review and synthesis of D&I instruments (Lewis et al., 2018) • Centers on Proctor’s implementation outcomes framework and CFIR constructs • This work was funded by NIMH R01MH106510 (Lewis) • Current state of the repository: • Revisions to the evidence-based assessment criteria & a new name: Psychometric And Pragmatic Evidence Scale (PAPERS)

SIRC Instrument Repository 17 • Rating psychometric properties : • and pragmatic qualities : • internal consistency, • cost, • convergent validity, • accessibility of language, • discriminant validity, • assessor burden (training), • known-groups validity, • assessor burden (interpretation), and • predictive validity, • length of each measure • concurrent validity, • structural validity, • responsiveness, and • norms

18

THANK YOU! 19 Sara J. Landes, PhD • Behavioral Health QUERI, Central Arkansas Veterans Healthcare System • University of Arkansas for Medical Sciences @SJLandes sara.landes@va.gov & sjlandes@uams.edu Society for Implementation Research Collaboration • www.societyforimplementationresearchcollaboration.org @ImplementCollab sircimplementation@gmail.com