EVALUATION SUMMARY DECEMBER 11, 2014 Click to edit Master text - PowerPoint PPT Presentation

FY14 HeLP ANNUAL EVALUATION SUMMARY DECEMBER 11, 2014 • Click to edit Master text styles – Second level • Third level – Fourth level » Fifth level

EVALUATION COMPONENTS • Professional Education Survey • Referral Provider Surveys • Click to edit Master text styles • HeLP Legal Services Clinic Student Satisfaction – Second level Survey • Third level • HeLP Health Law Advocacy Student Survey – Fourth level • HeLP Clinic Case Rounds Survey » Fifth level • Fundamentals of Medicine Student Survey • Resident Longitudinal Survey • Client Surveys • Administrative Claims Analysis

PROFESSIONAL EDUCATION EVALUATION • Suspended in FY13 and FY14 for curriculum • Click to edit Master text styles development – Second level • Only offered to New Residents at Hughes • Third level Spalding – Fourth level » Fifth level • 16 residents completed survey post education seminar

OUTCOME INDICATORS • 94% affirmed they are more likely to advocate • Click to edit Master text styles on their patient’s behalf after attending HeLP – Second level seminar • Third level • Satisfaction with the education seminar was – Fourth level » Fifth level rated high among all respondents • All respondents reported they would recommend participation in the education seminars to their colleagues.

REFERRING PROVIDER SURVEY HeLP's Ability to Assist Client with Referred Problem Percent Rated Excellent or Good • 45 survey completed / 90% • Click to edit Master text styles 82% 77% 150 disseminated = 80% 74% – Second level 69% 70% Response rate of 30% 61% • Third level 60% • Respondents represent 50% – Fourth level Physicians (60%) and 40% » Fifth level Social Workers (40%) 30% • Top 5 Problems/Topics 20% 10% for referral: SSI/Disability, 0% Family Law, Housing, Education & Public Benefits

OUTCOME MEASURES Percent of Referring Providers who Responded Affirmatively • Click to edit Master text styles 100% 89% 87% 90% – Second level 80% • Third level 70% 60% – Fourth level 50% » Fifth level 40% 28% 30% 19% 19% 20% 10% 0% Positive Impact on Reduce ED Visits Reduce Hospital Reduce Hospital LOS Perceptions of Working Patient Health Readmits w Legal Community

PROCESS INDICATORS Percent of Referring Providers who Report Excellent or Good 90% • Click to edit Master text styles 79% 80% 68% – Second level 70% 65% 62% 61% 60% • Third level 53% 50% – Fourth level 40% » Fifth level 30% 20% 10% 0% Commuication w Communication w Communication w Provide Info. on Quality of Response Response Time to Clients Health Care Social Workers Services Calls Providers

OPPORTUNITIES FOR IMPROVEMENT • Mechanism to provide feedback to providers • Click to edit Master text styles regarding HeLP referral – Second level • Third level • Opportunities to demonstrate program – Fourth level effectiveness to referring providers » Fifth level • Mechanism to capture referring provider contact information for survey administration

HeLP CLINIC PARTICIPANT STUDENT SURVEY HeLP's Ability to Assist Client with Legal Problem • 17 surveys completed of Percent Rated Excellent or Good • Click to edit Master text styles 100% 100% 100% 34 disseminated = 95% 93% – Second level 92% Response rate = 50% 90% 90% • Third level • Respondents represented 85% 80% – Fourth level law (94%) and social work 75% » Fifth level (6%) students 70% • Top case types for 65% 60% students include: 55% SSI/Disability, Housing, 50% Education, Wills/AD & Public Benefits

OUTCOME INDICATORS • All respondents rated HeLP’s ability to meet • Click to edit Master text styles the legal needs of clients as Excellent or Good – Second level • Third level • 94% reported learning better professional – Fourth level skills through their experience » Fifth level • 82% reported they are Definitely Likely or Likely to remain involved in public services activities based on HeLP experience

PROCESS INDICATORS Percent who Report Excellent or Good • Click to edit Master text styles Provide Referral Resources 82% – Second level • Third level Provide Legal Resources 100% – Fourth level Student Understanding of HeLP » Fifth level 94% Education of Health Care and Social Services Staff 88% Client Understanding of HeLP 83% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%

OPPORTUNITIES FOR IMPROVEMENT • Greater involvement of medical interns and • Click to edit Master text styles increasing their involvement with the program – Second level • Third level • Identify opportunities to increase survey – Fourth level » Fifth level participant response rate

HEALTH LAW ADVOCACY SURVEY • Pre/Post-survey non-comparative design • Click to edit Master text styles – Pre-survey: 6/9=67% response rate. Designed to – Second level gather qualitative information on participant • Third level expectations of class – Fourth level » Fifth level – Post-survey: 7/9=78% response rate. Designed to gather qualitative information on impact of class participation on knowledge, skills and perceptions

OUTCOME INDICATORS • 86% reported high levels of satisfaction with • Click to edit Master text styles the course & all indicated it exceeded – Second level expectations • Third level • All reported the course helpful to developing – Fourth level » Fifth level &/or enhancing professional skills • All found the course staff as helpful in addressing questions and providing support in working with community partners

PROCESS INDICATORS • Respondents reported that the legislation • Click to edit Master text styles proposed by the community partners was important to lawmakers. – Second level • Students noted that the public was interested in • Third level the proposed legislation and two-thirds felt – Fourth level efforts to increase public support for the issues » Fifth level were effective. • Respondents noted that community partners could have been more influential in impacting the attitudes and beliefs of policymakers and the public.

MEDICAL EDUCATION SURVEYS • HeLP Legal Services Clinic Case Rounds • Click to edit Master text styles (Case Rounds) – Second level • Third level – Fourth level • Fundamentals of Medicine III (FOM III) » Fifth level • Resident Longitudinal Study (Resident Study)

HeLP CASE ROUNDS • 21 resident participants in 7 Case Rounds • Click to edit Master text styles • Respondents: – Second level – 41% 1 st yr. residents • Third level – 23% 2 nd yr. residents – Fourth level – 36% 3 rd yr. residents » Fifth level • Case Round attendance: – 48% attended 1x – 28% attended 2x – 24% attended 3x

OUTCOME INDICATORS • 95% or more reported high and moderate levels of • Click to edit Master text styles awareness of how SEDH may effect low-income patients – Second level • 81% reported that incorporating lawyers on the • Third level treatment team can be Extremely or Very Influential to – Fourth level providing patient care » Fifth level • 61% reported they are Very Likely or Likely to ask patients if they are experiencing a legal problem • 52% of respondents reported they are Very Likely or Likely to refer patient to legal resource

OUTCOME INDICATORS Percent Very Likely or Likely to Screen for Problems 100% • Click to edit Master text styles 95% 95% 90% 81% 81% – Second level 80% 76% 71% • Third level 70% 64% 60% – Fourth level 49% 50% » Fifth level 40% 30% 20% 10% 0% Education Income Medicaid/CHIP Health Public Benefits Housing Family Law SSI/Disability Insurance

OUTCOME INDICATORS • 90% of respondents indicated that participation • Click to edit Master text styles in Case Rounds was Very Important or – Second level Moderately Important to their clinical education • Third level experience – Fourth level • 62% agree that Case Round participation » Fifth level positively affected their perception of interdisciplinary collaboration and practice • 86% agree that participation helped to develop interdisciplinary skills

FOMIII SURVEY • Pre-/Post-Survey Design • Click to edit Master text styles – Second level • Response Rate: • Third level – Pre: 34/59 = 58% – Fourth level – Post:30/59 = 48% » Fifth level • Cohort level comparison

OUTCOME INDICATORS Pre-/Post Survey Percentage Point Increase in Awareness 40% • Click to edit Master text styles 34% 35% – Second level 30% • Third level 25% 22% – Fourth level 20% » Fifth level 14% 15% 11% 10% 8% 7% 5% 0% Public Benefits Transportation Health Insurance Income Family Stability Housing/Utilities

OUTCOME INDICATORS Pre/Post Survey Percentage Point Increase in Likeliness to Screen 30% • Click to edit Master text styles 27% 25% – Second level 20% • Third level 20% – Fourth level 16% 16% 15% » Fifth level 11% 10% 5% 0% Public Benefits SSI/Disability Education Family Law Income