PROPOSITION 64 GRANT Data Collection and Evaluation December 1, - PowerPoint PPT Presentation

PROPOSITION 64 GRANT Data Collection and Evaluation December 1, 2020

W HAT WE WILL DISCUSS Local Evaluation Plan (LEP) Local Evaluation Report (LER) Collection of Race and Ethnicity Data Optional LEP Webinar Evaluation Tips and Suggestions Quarterly Progress Reports (QPR) 2

W HY ARE E VALUATIONS I MPORTANT ? Why are evaluations important to you? 3

W HY ARE E VALUATIONS I MPORTANT ? Demonstrate the effectiveness of the project Provide accountability for the use of grant funds Add to the body of knowledge about the issue 4

W HY ARE Q UALITY LEP S AND LER S I MPORTANT ? Communicate effectiveness of funded projects A good evaluation starts with a good plan Having an evaluation plan is a ‘best practice’ 5

A BOUT O UTSIDE E VALUATORS Benefits: Provide evaluation expertise Can guide local evaluation throughout project May improve evaluation objectivity Additional resource for planning and data analysis If hiring an evaluator is a viable option for you, we encourage you to do so at the earliest stage possible! 6

L OCAL E VALUATION P LAN Purpose: Ensure projects funded by the BSCC can be evaluated. Due by Friday, February 26 th , 2021 Minimum Requirements: Cover Page Project Background Process Evaluation Method & Design Outcome Evaluation Method & Design Project Logic Model Appendices (if applicable) 7

L OGIC M ODEL A visual representation of the project depicting the logical relationships between the inputs/resources, activities, outputs, and outcomes/impacts of a project. http://mrsc.org/Home/Stay-Informed/MRSC-Insight/September-2018/Planning-with- Logic-Models.aspx. 8

D OES NOT NEED TO BE TOO COMPLEX https://bmcmedresmethodol.biomedcentral.com/articles/10.1186/s12874- 019-0701-4 9

L OCAL E VALUATION R EPORT Purpose: document results and overall impact. Based on the original Local Evaluation Plan. Due by March 31, 2024 Minimum Requirements: Cover Page Evaluation Results Executive Summary Discussion of Results Project Background Current Logic Model Process Evaluation Grantee Highlight Method & Design Appendices Outcome Evaluation Method & Design 10

C OLLECTION OF E THNIC O RIGIN , E THNICITY , OR R ACE D ATA GC 8310.5 – Required Separate collection categories Asian – Chinese, Japanese, Filipino, Korean, Vietnamese, Asian Indian, Laotian, Cambodian, and Other Pacific Islander – Native Hawaiian, Guamanian, Samoan, and Other 11

C OLLECTION OF E THNIC O RIGIN , E THNICITY , OR R ACE D ATA GC 8310.9 Number or Percent of individuals who identify with each category: Alone and not in combination with any other designation Alone or in combination with other designations Multiple designations Required starting January 1, 2022 – you will be expected to report in this manner within the LER! 12

13

O PTIONAL LEP W EBINAR Date: Januar ary 1 y 13 th th , 2 , 2021 1 Watch for an email with more details soon! Will cover more in-depth information on what we’re looking for in your LEPs and will go over more resources we have for you Will include a Q&A period 14

T IPS AND S UGGESTIONS ( SEE HANDOUTS ) LEP Rubric Evaluator Roles and Responsibilities Data Collection Tips Evaluation Resources http://www.bscc.ca.gov/s_evaluatio nresources/ 15

Local Evaluation Plan and Report Questions? 16

Quarterly Progress Report 17

O VERVIEW Purpose Development Process QPR Documents Technical Assistance 18

P URPOSE OF THE Q UARTERLY P ROGRESS R EPORTS Provide regular detailed updates on project implementation and outcomes for monitoring purposes Provide cumulative outcomes of all projects Results will generalize across projects Rely on aggregate participant and outcome data 19

D EVELOPING THE Q UARTERLY P ROGRESS R EPORT Reviewed proposals Identified commonalities and points of crossover Created two program-wide logic models Created the QPR Form Feedback 20

P ROP 64 P ROGRAM -W IDE L OGIC M ODEL Y OUTH TH C AN ABIS U SE SE : P : P REVEN AND I NTER ANNABI ENTI TION ON AN ERVEN ENTI TION ON Inputs Activities Outputs Outcomes Impact Funding Public Health Awareness Increase youth perception of # of Youth Participating in and Education in Schools harmfulness of cannabis use Activities and Community Partnership Decreased # / rate of drug- related youth arrests / Staff/Volunteers Decrease cannabis use citations Training Case Management # of Enrolled Youth Reduce contact with justice system Referrals Programming Increase treatment services # of Youth Receiving Case Youth Development Management Activities Data Collection Decrease # / rate of youth Improve school attendance cannabis-related suspensions/expulsions Quality Assurance # of Youth receiving SUD Staff Training Improve family treatment Social Media Marketing support/relationships 21

P ROP 64 P ROGRAM -W IDE L OGIC M ODEL C AN ABIS C OM AND E NFORCEME ANNABI OMPL PLIANCE AN EMENT Inputs Activities Outputs Outcomes Impact Funding Increase retailor awareness # of cannabis retailor of youth cannabis use and education/outreach/trainings Cannabis Operations: illicit cannabis Partnership held Education and Information Decrease environmental Improved surveillance Staff/Volunteers impacts systems # of compliance monitoring/inspections Training Compliance Activities Increase # of identified (retail, delivery, permitted illegal/unlicensed cannabis cultivators) cultivation sites Referrals Increase volume of code Programming enforcement cases # of unlicensed cultivation Enforcement Activities sites identified Data Collection Decrease unlawful Increase penalties collected marijuana cultivation Quality Assurance # of unpermitted plants Improve # of permitted Law Enforcement Staff Training eradicated operations in compliance activities/services with codes & regulations 22

Q UARTERLY P ROGRESS R EPORT Collects quarterly updates on grant spending and overall progress Collects quarterly evaluation data Implementation of Inputs Description of project activities Outputs of project activities Participant outcomes First QPR due: May 15 th , 2021 23

24

25

26

27

28

29

30

31

32

T ECHNICAL A SSISTANCE Email questions, concerns and/or edits by December 15 th , 2020 to: Prop64_Grant@bscc.ca.gov QPR Webinar February 2021 Watch for an email with RSVP info! 33

Quarterly Progress Report Questions 34