Measuring for Success Northwestern Mutual Partner Retreat - PowerPoint PPT Presentation

Measuring for Success Northwestern Mutual Partner Retreat Evaluation and Survey Results Kathleen Pritchard, PhD Data You Can Use 1:30 – 2:30 Oct 11, 2018

Measuring for Success ❑ Ten top tips from evaluation practice ❑ Outcome funnels and red flags ❑ Survey Results ❑ Possibilities and Implications of Shared Measurement

“ We value what we measure and measure what we value.”

10. Evaluate no program before it its tim ime .

9. Determine what success lo looks lik like.

8. Get in input fr from others.

7. Don’t limit your thinking to what you thin ink you can measure.

6. Th Thin ink about what you can reasonably ly control.

5. Know when to get help lp.

4. . Less is is more

3. Tell the story

2. Use th the data

1. Start all ll over

PROGRAM LOG OGIC MOD ODEL Ou Outcomes Activ ctivities or or Inp nputs Outp utputs ts Longer-term rm Strategies Str Init Initial Interm rmediate Easier to Measure Harder to Measure

Levels of Outcomes Community Wide Conditions Cross System Shared Outcomes Harder to measure System Outcomes Agency Outcomes Program Outcomes Client Outcomes

OUTCOME FUNNEL for Jobs Program Milestones for residents: 1. Learn of the project (2000) 2. Decide to get involved (400) 3. Attend first session (300) 4. Retain information from first session (200) 5. Attend remaining sessions (100) 6. Retain information from remaining sessions (100) 7. Start at the job site (80) 8. Perform adequately on the job (60) Which outcome(s) 9.Stay on the job would you report on? for 6 months (50) Adopted from Outcome Funding

Focus a areas 12 7 3 Healthy & Thriving Children and Safe Neighborhoods Strong families Youth 12 3 7

Neig ighborhoods 15 15 11 Amani Metcalfe Park Muskego Way Series5 15 15 11

Data Provid ided 21 20 14 2015 2016 2017

• Safe Neighborhoods • Increased resident engagement • Meeting basic needs • Increased knowledge and skills, (home buyers, neighborhood resources, legal What are assistance) Healthy and Thriving Children & Youth some • Teens mentor youth outcomes in • Grads are hired Amani? • Youth increase understanding of economy/business/finance • Youth are involvement in programs that promote academic achievement Strong Families • Families are connected to resources

Safe Neighborhoods • Meeting basic needs • Neighbors connect to resources • Residents increase knowledge and skills • Access to Legal assistance What are • Increased openness re police and residents some Healthy and Thriving Children & Youth Teens mentor youth outcomes in • Youth are hired • Youth increase understanding of econ, biz. finance Metcalfe • Youth are involved in programs that promote Park? academic achievement • Youth increase knowledge and skills Strong Families • Parents are connected to resources • Parents advocate for youth

Safe Neighborhoods • Residents are engaged • Residents have access to services • Residents increase knowledge and skills • Residents become leaders What are some Healthy and Thriving Children & Youth outcomes in • Youth set goals • Youth increase knowledge and skills Muskego Way? Strong Families • Parents are connected to resources • Parents can advocate for youth • Parents become leaders

ROUGHLY*HOW many residents were “touched” annually? 2015 2016 2017 2018 “More” AMANI 4,241 5,919 5,262 Pop 8,369 “More “ Metcalfe Park 4,901 1,636 6,285 Pop 8,994 “More” Muskego Way 2,078 3,748 7,095 Pop 36,274 ???? NM 11,220 11,303 18,642 Neighborhoods Pop 53,636

How are we partnering?

Satisfaction with Measurement and Partnership Relationships s not satisfied somewhat dissatisfied neutral somewhat satisfied very satisfied 0% 10% 20% 30% 40% 50% 60% partnerships measuring outcomes

Common agenda Why does Shared measurement measurement Mutually reinforcing activities matter with Continuous communication Backbone place based efforts? organization

• Different neighborhoods • Different populations Why can’t we • Different levels of outcomes all measure • Different organizational capacity the same • AND – in collective impact- the idea is thing? that many organizations are needed to do complementary ---not the same --- things.

• An unbelievable number • Duplication within organizations as well Why can’t we as across • Different levels of outcomes just add it all • Different levels of capacity up? • Different stages of development • Different bases of data – ZIP, PD,

Safe neighborhoods • Increasing resident engagement (42%) • Other (33%) • Creating safe spaces (25%) Themes • Promoting civic engagement (0) consistent Strong Families with the • Family support services (100%) • Community trauma (0) Revitalization • Workforce development/ education (0) Plans Healthy and Thriving Children and Youth • Youth Development (57%) • Youth leadership (29%) • Other (14%)

Thank you!!! Katie Pritchard Katie@datayoucanuse.org