Beverly Parsons • bparsons@insites.org • www.insites.org
Basic Definition of a System A system is an interconnected set of elements that is coherently organized in a way that achieves something. Meadows, D. (2008) . Thinking in systems . White River Junction, VT: Chelsea Green Publishing Company.
Key Systems-Oriented Evaluation: Message From Afterthought to Forethought 3 Beverly Parsons • bparsons@insites.org • www.insites.org
Our Then: Stable, limited Changing connections World Now: Social Complex, connected, Systems dynamic 4 Beverly Parsons • bparsons@insites.org • www.insites.org
Our Then: Individual programs, Changing policies World Now: System Multi-faceted, Interventions overlapping, dynamic 5 Beverly Parsons • bparsons@insites.org • www.insites.org
Our Then: Formative and Changing Summative World Now: Evaluation Developmental with Approach Nested Formative and Summative 6 Beverly Parsons • bparsons@insites.org • www.insites.org
Beverly Parsons • bparsons@insites.org • www.insites.org
Beverly Parsons • bparsons@insites.org • www.insites.org
Beverly Parsons • bparsons@insites.org • www.insites.org
Traditional Establish goals Strategy Develop action plan Approach Implement plan Evaluate results 10 Beverly Parsons • bparsons@insites.org • www.insites.org
Evaluation and Strategy Repositioned and Redesigned Adaptive STRATEGY Developmental EVALUATION Beverly Parsons • bparsons@insites.org • www.insites.org
Developing Step 1. Articulate Fundamental System Change an Using Existing Evidence Evaluation Step 2. Identify Points of Framework Systemic Influence Step 3. Weave Strategy and Evaluation with System Change Step 4. Identify Indicators of System Benefit 12 Beverly Parsons • bparsons@insites.org • www.insites.org
Framework for Systems-Oriented Evaluation ____________________ (Initiative) _________________________ (initiative) Tipping Point Sustainable Adaptive Balancing Trying Out Points of Interventions Baseline Understanding Systemic To what extent: Influence (Individual/ relationship) (Community: informal) (Community: formal) (Societal — City, state, national) (Learning & Capacity Building) (Networks/ Partnerships) bparsons@insites.org • www.insites.org
Value of the Link strategy and evaluation Evaluation Framework 14 Beverly Parsons • bparsons@insites.org • www.insites.org
Value of the Link strategy and evaluation Evaluation Framework See the big picture 15 Beverly Parsons • bparsons@insites.org • www.insites.org
Value of the Link strategy and evaluation Evaluation See the big picture Framework Map actions among partners 16 Beverly Parsons • bparsons@insites.org • www.insites.org
Value of the Link strategy and evaluation Evaluation See the big picture Framework Map actions among partners Be transparent 17 Beverly Parsons • bparsons@insites.org • www.insites.org
Value of the Link strategy and evaluation Evaluation Framework See the big picture Map actions among partners Be transparent Map progress over time 18 Beverly Parsons • bparsons@insites.org • www.insites.org
Articulate Desired System Change 19 Beverly Parsons • bparsons@insites.org • www.insites.org
Concrete Support in Times of Need Children’s Social/Emotiona l Competence Center for the Study of Social Policy (www.cssp.org)
Adams Arapahoe Jefferson Denver
Identify Points of Systemic Influence First: Identify Relevant Domains of the Social Ecology 25 Beverly Parsons • bparsons@insites.org • www.insites.org
26 Beverly Parsons • bparsons@insites.org • www.insites.org
27 Beverly Parsons • bparsons@insites.org • www.insites.org
Identify Points of Systemic Influence First: Identify Relevant Domains of the Social Ecology Second: Identify Potential Levers for Change 28 Beverly Parsons • bparsons@insites.org • www.insites.org
Beverly Parsons • bparsons@insites.org • www.insites.org
Beverly Parsons • bparsons@insites.org • www.insites.org
Framework for Systems-Oriented Evaluation Theory of Change in Complex Systems Strengthening Families Initiative _________________________ (initiative) Tipping Point Sustainable Adaptive Balancing Trying Out Points Interventions Baseline Understanding of Systemic To what extent: Influence Caregiver- Child-Family Neighborhood/ Community Organizations, Providers (Norms, infrastructures, policy) Societal Actors (State & national) (Norms, policies, infrastructures) Stakeholder Learning & Capacity Building Networks/ Partnerships bparsons@insites.org • www.insites.org
Syste Identify Actors within the Domains of Social Ecology
Syste Identify Actors within the Domains of Social Ecology
Framework for Systems-Oriented Evaluation Theory of Change in Complex Systems ____________________ (Initiative) _________________________ (initiative) Tipping Point Sustainable Adaptive Balancing Trying Out Interventions Points of Baseline Understanding Systemic To what extent: Influence (Individual/ relationship) (Community: informal) (Community: formal) (Societal — City, state, national) (Learning & Capacity Building) (Networks/ Partnerships) bparsons@insites.org • www.insites.org
Developing Step 1. Articulate Fundamental System Change an Using Existing Evidence Evaluation Step 2. Identify Points of Framework Systemic Influence Step 3. Weave Strategy and Evaluation with System Change 35 Beverly Parsons • bparsons@insites.org • www.insites.org
Weave strategy & evaluation with system change over time Beverly Parsons • bparsons@insites.org • www.insites.org
Assessing Where We Are in relation to our vision Beverly Parsons • bparsons@insites.org • www.insites.org
Trying Out Interventions within & across system domains, dimensions, and across time Beverly Parsons • bparsons@insites.org • www.insites.org
Reaching a Tipping Point: Activities are clearer, scaled up, and crossing more parts of the system Beverly Parsons • bparsons@insites.org • www.insites.org
Sustainable Adaptive Balancing: We are here, new things happen, system changes, and we are able to adapt Beverly Parsons • bparsons@insites.org • www.insites.org
Eventually the cycle begins again with a new paradigm shift. Beverly Parsons • bparsons@insites.org • www.insites.org
Weave strategy & evaluation with system change over time Beverly Parsons • bparsons@insites.org • www.insites.org
Framework for Systems-Oriented Evaluation Theory of Change in Complex Systems ____________________ (Initiative) _________________________ (initiative) Tipping Point Sustainable Adaptive Balancing Trying Out Interventions Points of Baseline Understanding Systemic To what extent: Influence (Individual/ relationship) (Community: informal) (Community: formal) (Societal — City, state, national) (Learning & Capacity Building) (Networks/ Partnerships) bparsons@insites.org • www.insites.org
Developing Step 1. Articulate Fundamental System Change an Using Existing Evidence Evaluation Step 2. Identify Points of Framework Systemic Influence Step 3. Weave Strategy and Evaluation with System Change Step 4. Identify Indicators of System Benefit 44 Beverly Parsons • bparsons@insites.org • www.insites.org
Framework for Systems-Oriented Evaluation Theory of Change in Complex Systems Strengthening Families Initiative _________________________ (initiative) Tipping Point Sustainable Adaptive Balancing Trying Out Points Interventions Baseline Understanding of Systemic To what extent: Influence Caregiver- Child-Family Neighborhood/ Community Organizations, Providers (Norms, infrastructures, policy) Societal Actors (State & national) (Norms, policies, infrastructures) Stakeholder Learning & Capacity Building Networks/ Partnerships bparsons@insites.org • www.insites.org
Who: Process for Developing Leadership Team an Evaluation Evaluator Framework Stakeholders When: Near beginning Review, revise, adapt 46 Beverly Parsons • bparsons@insites.org • www.insites.org
Framework for Systems-Oriented Evaluation Theory of Change in Complex Systems Framework for Social Innovation Evaluation F ramework of Social Innovat ion S t rategy and E Step 1 Strengthening Families Innovation Initiative _________________________ (initiative) Strengthening Families Example Trying Out 3 S t e p Interventions Points Baseline Understanding of Systemic To what extent: Families test use of protective Influence factors and determine changes in relationships and boundaries in d daily life. Families learn to self- a n o f e w a r a e s m i l i a e f A r D o ? r s c t o assess use of protective factors. f a v e c t i o t e p r n g Caregiver- c i c t i p r a d a n d z e a n i r g h o o t b u s e s e n t a r p Child-Family s ? m i c n a d y e t i v a p a d ties pilot •
Recommend
More recommend
