TRANSFORMING THE BUSINESS MODEL – APRIL 30, 2014
Jim Sullivan TRANSFORMING YOUR BUSINESS THROUGH IMPACT EVALUATION
How does LEO work? Rigorous research Randomized controlled trials (RCTs) Natural Experiments Connecting service providers with researchers
How evaluation can transform your business?
How evaluation can transform your business? Identify the best programs and demonstrate their impact Make effective programs better Enable replication and scale-up Increasingly required by funders
Demand for concrete evidence is growing Gates foundation “…once we’ve made a grant, we expect the grantee to measure progress and report on the results…We aspire to measure the … ultimate impact of our work” W.H. Kellogg Foundation “Our goal is to improve the well -being of people. Evaluation furthers this goal by providing ongoing, systematic information that strengthens projects during their life cycle, and ….assess the extent of change.”
What is evaluation?
An evaluation framework Needs Input Output Outcome Impact Long-term (Primary Goal Outcome) What the What What What is the What is the What is the intervention resources go changes as a main effect of problem that ultimate does? Who into the result of the the needs to be impact? does it reach? intervention? intervention? intervention? addressed? Needs Assessment Process Evaluation Impact Evaluation Program Evaluation
What is impact evaluation? Impact Intervention Primary Outcome Impact Time
Impact evaluation The key to impact evaluation: knowing the counterfactual What would outcomes be in the absence of the program? Problem – we do not observe the counterfactual Ways to construct a counterfactual The gold standard: randomized controlled trials (RCTs) Natural experiments
Evaluation Naysayers Not enough resources We don’t want to deprive the most needy of help I don’t need statistics to tell me I’m making a difference
Impact Evaluation: Getting Started Start small Systematically measure inputs, outputs, and outcomes Identify comparison groups Practice evidence-based program design
The KaBOOM! Influence Strategy Danielle Marshall Director Community Engagement dmarshall@kaboom.org
We have always been a champion for play KaBOOM! has been a powerful champion for play for the past 18 years. Together with our partners, we have built, improved and opened more than 15,000 playgrounds, engaged more than 1,000,000 volunteers and served more than 6,600,000 children. However, while our presence and impact have grown, so have the problems facing our nation’s children.
Play is disappearing Currently, only one in four children gets 60 minutes of physical activity or active play every day. Play is on the decline .
Our kids are in trouble Children are missing out on the childhood they deserve. America’s children are increasingly unhappy, unhealthy and falling behind. • 1 in 3 are obese or overweight • 1 in 5 have a mental illness • The U.S. ranks #31 internationally in math scores
Play is a solution Research confirms that play – physically active, imaginative and interactive play – is a powerful solution to these problems because play benefits the whole child. Play can transform children – from sedentary to physically active, bored to mentally active and solitary to socially active.
Our bold goal drives us toward play as a solution All children get the balance of active play they need…to grow up to be healthy and successful adults. Particularly the 16 million children growing up in poverty.
We need to spark behavior and societal norm change to achieve our bold goal Behavior change means that children will actually play more, actively and in a balanced way. Societal norm change means that society will reinforce the expectation that children play actively every day.
Societal-level change requires an Influence Strategy To achieve our bold goal, we must mobilize many people to promote and protect play. Studies indicate that while many parents, caregivers and city leaders are aware that play is important, this awareness does not translate into action.
Our Influence Strategy is key to our success We will focus on moving key audiences from awareness to taking action toward the result of all children getting the play they need to thrive: UNDERSTANDING RESPONSIBILITY ACTION AWARENESS that play helps solve urgent to create more play RESULTS to protect problems affecting children but for the children I care in all children getting that play has critical and promote that children aren't getting the about and those who the play they need* benefits for children play play they need need it most
Key audience #1: Grassroots Grassroots influencers include parents, caregivers and community members who take action to protect and promote play. Wanda Quon, an elementary school principal in Jackson, Miss, built a playground with KaBOOM! at her school in 2006 and has since become an exemplary advocate protecting and promoting play in her community. Wanda went on to build a walking track and fitness zone at her school open to the community, to host play days and family wellness events, and to integrate play into her school's curriculum. Cynthia Gentry of Atlanta, Ga., a mother, grandmother, and lifetime child advocate, exemplifies a grassroots innovator: a play advocate that takes action and inspires others. As a leader in changing the state of play in her community, Cynthia founded the Atlanta Task Force for Play , leads a Playground Design Competition (Playable10), and advocates for play by writing articles in Atlanta Magazine on the need to save recess.
Mobilizing the Grassroots To inspire grassroots action, we will: • Shine a spotlight on relatable, everyday heroes who are promoting and protecting play in their communities. • Drive digital engagement that successfully converts passive web visitors into people engaged in the cause of play. • Incentivize grassroots individuals to promote and protect play.
Key audience #2: Grasstops Grasstops influencers are municipal officials, corporate leaders, leading non-profit institutions, philanthropists and other key city- wide influencers who take action to promote and protect play. Mayor Chip Johnson of Hernando, Miss., has met with First Lady Michelle Obama to discuss active play, fitness, and health, and has been featured in magazines advocating for Playful City USA. He has organized play activities for hundreds of kids and adults in Hernando, and now, his mission is for “ all cities in Mississippi to be a Playful City USA communities.”
Mobilizing the Grasstops We will encourage and empower a small number of innovative, leading cities by incentivizing comprehensive city-wide action in support of play. We will publicly recognize these shining examples in order to inspire a growing number, or ‘domino effect,’ of cities who emulate the shining examples. We will prioritize comprehensive cross-sector partnerships to ensure that the city’s programming, infrastructure and policies support play.
What success looks like Cities -- where innovation and commitment to play are taking hold -- will have stepped forward to take comprehensive action for play because play will be seen as a critical solution to pressing problems related to education, physical health, mental wellness, and urban renewal. In these cities, grassroots advocates inspired by everyday heroes like Cynthia Gentry and Wanda Quon will hold grasstops leaders accountable for making play a priority. At the same time, city leaders such as Mayor Chip Johnson will be working on infrastructure, policies and programming to protect play – not alone but in cross-sector partnerships with other elected officials, business leaders and influential community leaders.
Measuring our progress We will measure our near-term progress toward the goal of generational norm change by monitoring the diffusion of ideas, actions taken by individuals and cities, and results across cities. Short-Term Mid-Term Long-Term Ultimate Year 1-3 Year 3-5 Year 5-10 Generational Mobilizing the Developing Reversing the Changing the Base Proof Points Decline in Play Societal Norm
Advancing our Influence Strategy We will support our Influence Strategy with efforts in: • Thought Leadership • Research • Strategic Communications
Together, when we are successful… • All children will get the childhood they deserve . • Their lives will be filled with the joy of play. • They will grow up to be healthy and successful adults.
WILL DEKREY, MANAGER OF NETWORK & KNOWLEDGE, COMMUNITY WEALTH PARTNERS
10 Insights on Social Transformation Be bold & Create shared Change the Open your circle believable leadership conversation Communications Build public Experiment, learn Discipline is key is strategy support & evolve Live in the Build culture, market intentionally
Bold goals often spark and/or guide business model transformation. 35 LSA Proprietary & Confidential
Recommend
More recommend
