Collecting Post-Discharge Outcome Data : Using Data to Inform Practice Improvement and Results from the BBI Feasibility Pilot Presented By: Gary Blau : Child, Adolescent and Family Branch, SAMHSA (MD) Madge “Pat” Mosby: BBI Consultant (MD) Bob Lieberman : BBI Consultant; Lieberman Group, Grants Pass (OR) July 25, 2018 BBI Pre-Institute, University of Maryland Training Institutes
BBI MEASUREMENT PRODUCTS BBI Documents: 1. BBI: Instructional Guide – Strategies for Completion of the Building Bridges Initiative 2. Self-Assessment Tool (SAT) – also available in Spanish 3. BBI SAT for Youth and Families – also available in Spanish 4. BBI SAT for Residential and Community Staff and Advocates 5. BBI SAT Glossary – also available in Spanish 6. BBI: Outcome and Performance Measures for Residential: Building Consensus on Residential Measures for Outcomes and Performance Measures 7. BBI Post-Residential Outcomes Pilot Survey Webinars: 1. BBI Web-based Training: BBI: Successful Strategies for Tracking Long-term Outcomes (1 CEU) 2. Best Practices in Using Data to Inform Practice and Tracking Long-term Outcomes for Residential Programs and their Community Counterparts Article: Levison-Johnson, J., Kohomban, J.C., Blau, G., Caldwell, C., Dougherty, R., & Warder. R. (Spring, 2012). Keep Your Eyes on the Prize: Defining and Tracking What’s Important in Residential Care. Teaching Family Association Newsletter, 1 (38), 1-8. Book: Blau, G., Caldwell, B., & Lieberman, R.E. (2014). Residential interventions for children, adolescents and families: A best practice guide . New York, NY: Routledge.
Context for the BBI Pilot Efforts are occurring to demonstrate effectiveness of residential • interventions, but only recently have the efforts to assess post-discharge outcomes taken a broad national focus. • Two uses for post-discharge data: correlate with process and experience indicators for quality improvement purposes; assess impact of the overall residential intervention. • A variety of concerns, at varying levels, about feasibility and utility of collecting and accurately using post-discharge data. Discussion: Identify concerns you can imagine or have heard.
BBI Pilot Study • A pilot study was designed to assess the feasibility of collecting post-departure follow-up data. This focused on addressing a variety of concerns regarding the feasibility and utility of doing so. • Practitioners, researchers, family members, and policy makers collaborated in the development of a survey of post-discharge function in five domains: living situation, school/education, risk factors, community engagement and support, and access to services • This pilot was not about obtaining actual outcome data – it was a test of the process of collecting data with the tool • Residential providers in three states were recruited to follow a set protocol in collecting follow-up data
Family Voice/Recommendations What are families looking for with data measures and post- discharge outcomes for themselves and their children?
BBI Pilot Findings: Successes and Barriers Successes Providers were able access contact information from existing • records Contact data was fairly up-to-date and few refusals to participate • Caregivers seemed to be comfortable answering questions • Caregivers provided positive feedback on survey • Barriers • Some caregivers were difficult to reach • Some providers did not allocate sufficient resources • Some providers had much smaller response rates Discussion: How might you address the perceived and actual barriers in your state or community?
BBI Pilot Findings: Resources Needed • Strong organizational commitment to collecting follow-up data • Adequate staff resources • Flexible call times • Additional possibilities An incentive for caregivers to participate Stratification designs to yield representative responses Response/non-response analysis to test for biased responses
BBI Next Steps: Full-Scale Effort to Measure the Impact of Residential Interventions • Post-discharge data is one component in quantifying the long-term impact of residential interventions • Measure organizational capacity and readiness: this is needed to identify resources and barriers to successful provider engagement and implementation • Use a methodologically sound longitudinal design to separate out the impact of context on functional outcomes Discussion point: Immediate thoughts about next steps?
In the Meantime: Using Data to Inform Practice Improvement • It is possible to obtain follow-up data • Accurate contact information is essential, but this typically already exists in organizational information systems • The BBI survey is available and offers a uniform tool for collecting post-discharge data (click here). • Correlate aggregated post-discharge data with the degree of family-driven, youth-guided, culturally and linguistically competent, trauma-informed, and/or transformational type practice strategies provided.
Residential Program Examples of f Using Post- Dis ischarge Data to In Inform Practice Im Improvement CHILDREN’S VILLAGE/NY • Identified an increase in post-discharge problems correlated to less work with families during the residential intervention; • Combined MST with residential for families with multiple and complex challenges DAMAR/IN • Changed business model to serving families within 45 miles so could increase work with families • Practice model now includes all staff disciplines working in homes and communities (i.e. schools) BOYS TOWN/NE • Years of post-discharge data inform ongoing practice improvements YOUTH VILLAGES/TN • Put a primary focus on working with families and communities Responded to data by shifting away from points and levels to trauma-informed • practices
Family Voice/Recommendations What do you want attendees to consider and take back with them as they improve their focus on using data to inform practice improvement – both during the residential intervention and post-residential intervention?
THE JOURNEY TO OUTCOMES Wherever you are in measuring and collecting data, you can jump in and use it to improve practice.
SMALL GROUP ACTIVITY Next steps with measuring outcomes and using data to inform practice in your organization, community and/or state.
CONTACT INFORMATION Madge “Pat” Mosby: BBI Consultant MMosby@mcfof.org Robert E. Lieberman, M.A., LPC lieberbob@yahoo.com Gary M. Blau, Ph.D. Gary.Blau@samhsa.hhs.gov
Taking BBI back to your Program, Community and State • End of day activity • Customized action plan
Recommend
More recommend
