11/9/2018 Please pull up Please pull up your Ci3T your Ci3T Implementing Implementation Manual Implementation Manual Comprehensive, Integrated, Three-Tiered (Ci3T) Models: Planning for Success: Monitoring and Communication Ci3T Implementation: Session 2 Welcome, School Teams! Ci3T Implementers! • We are excited to welcome you to the second session of the Ci3T implementation professional learning series. • Your dedication to systems change for helping all students succeed academically, behaviorally, and socially is appreciated! Agenda • Welcome • Preparing to Collect Social Validity & Treatment Integrity Data • Using Screening Data to Inform Instruction • Facilitating Clear Communication with Stakeholders • Preparing Implementation Reports to Support Data-informed Decision Making: Technology Training Part 2 – A sneak preview! • Wrapping Up and Moving Forward 1
11/9/2018 Upcoming Professional Development Sep Oct Nov Dec Jan Feb Mar Apr May KU Ci3T KU Ci3T KU Ci3T KU Ci3T KU Ci3T KU Ci3T Day 1 Day 2 Day 3 Day 4 Day 5 Day 6 KU Ci3T KU Ci3T TRAINING TRAINING 11/13/18 12/05/18 01/15/19 02/12/19 04/03/19 05/09/19 5:00- 8:00AM- 5:00- 8:00AM- 5:00- 8:00AM- 7:00PM 4:00PM 7:00PM 4:00PM 7:00PM 4:00PM KU Ci3T KU Ci3T KU Ci3T KU Ci3T KU Ci3T KU Ci3T KU Ci3T IMP IMP IMP IMP IMP IMPLEMENTATION IMPLEMENTATION Day 1 Day 2 Day 3 Day 4 Day 5 5:00-7:00 PM 5:00-7:00 PM 09/19/18 11/14/18 01/16/19 03/19/19 04/02/19 Technology Technology Training Training Day 1 Day 2 09/20/18 11/28/18 9:00AM- 5:00- 12:00PM 7:00PM TOT TOT TOT TOT TOT TOT TOT TOT Trainer of Trainer of Coaching Coaching Coaching Coaching Coaching Coaching Coaching Coaching Trainers Trainers Call Call Call Call Call Call Call Call Coaching Calls Coaching Calls Session 1 Session 2 Session 3 Session 4 Session 5 Session 6 Session 7 Session 8 4:00-5:30 PM 4:00-5:30 PM 09/20/18 11/16/18 12/07/18 01/17/19 02/13/19 03/21/19 04/04/19 05/03/19 KU Project KU Project KU Ci3T KU Ci3T KU Ci3T KU Ci3T KU Ci3T EMPOWER EMPOWER EMPOWER EMPOWER EMPOWER EMPOWER EMPOWER Session 1 Session 2 Session 3 Session 4 Session 5 5:00-7:00 PM 5:00-7:00 PM 10/03/18 11/15/18 01/24/19 03/20/19 04/17/19 Wrap Up and Preview Last Session Review Today’s Preview • Gained an understanding • Prepare to collect social of validity and treatment • long-range planning integrity data • conducting effective • Use screening data to meetings inform instruction at Tier • communicating with 1, Tier 2, and Tier 3 stakeholders • Communication with all • Reviewed rollout of and implementation stakeholders: procedures for • District • teaching, reinforcing, and • Ci3T Leadership Team monitoring the academic, • Faculty and staff behavior, and social skills • Students, parents, components of your Ci3T community model of prevention Log on to dropbox.com OPEN: • IM18 Ci3T Leadership Team Meeting Agenda TEMPLATE 1. Click the file to start a preview 2. Click “Open” in the top right corner, which allows multiple people to edit together online 2
11/9/2018 Using Dropbox As you work on documents from Dropbox today : o Edit files in Word Online for simultaneous collaboration with your team o Copy and rename files so your school initials are at the beginning and today’s date is at the end of the file name. XXES IM18 Ci3T Leadership Team Meeting Agenda YYYY MM DD.docx Welcome Please pull up your Ci3T Implementation Manual 2018-2019 IM18 Ci3T Leadership Team Meeting Agenda TEMPLATE Predictability 3
11/9/2018 Comprehensive, Integrated, Three-Tiered Model of Prevention (Lane, Kalberg, & Menzies, 2009) Goal: Reduce Harm Specialized individual systems for students with high risk Goal: Reverse Harm Specialized group systems for students at risk Goal: Prevent Harm School/classroom-wide systems for all students, staff, & settings Academic Behavioral Social ◇ ◇ Validated Curricula PBIS Framework Validated Curricula Preparing to Collect Social Validity & Treatment Integrity Data 4
11/9/2018 Essential Components of Primary Prevention Efforts Social Validity Treatment Integrity Systematic Screening Academic Behavior Ci3T Primary Plan Procedures for Monitoring: Elementary Social Validity 5
11/9/2018 Social Validity: Primary Intervention Rating Scale Ensure all faculty and staff receive an emailed link to Qualtrics for the PIRS and TSR surveys Social Validity: PIRS Results Year of Fall Spring Implementation n % ( SD ) n % ( SD ) 2017-2018 39 92.41 (8.46) 37 92.92 (7.53) Social validity refers to the level of: • Social significance of intervention goals • Social acceptability of intervention procedures • Social importance of intervention outcomes (Wolf, 1978) Treatment Integrity 6
11/9/2018 Is Ci3T Being Implemented as Planned? Three measures of treatment integrity: 1. Ci3T Treatment Integrity: Teacher Self-Report (Ci3T TI: TSR) 2. Ci3T Treatment Integrity: Direct Observation (Ci3T TI: DO) 3. School-wide Evaluation Tool (SET) CC0 No rights reserved Teacher Self-Report (Ci3T TI: TSR) Faculty and staff receive an emailed link to a Qualtrics survey Ci3T Treatment Integrity: Teacher Self-Report (Ci3T TI: TSR) • 38-item checklist with procedures for o Teaching o Reinforcing o Monitoring • Timepoint: beginning of the year until current date • Likert-type scale ranging from • 0 = no, not at all ○ 1 = yes, some of the time • 2 = yes, most of the time • 3 = yes, all of the time • Comments 7
11/9/2018 Ci3T Treatment Integrity Direct Observation (Ci3T TI: DO) • Subset of Ci3T TI: TSR • 13 procedures for teaching • 8 procedures for reinforcing • Stratified, random selection of educators • Personnel who directly instruct students • Observers trained to criterion • 30-min observations • Teacher perspective • Observer perspective CC0 No rights reserved Treatment Integrity: Teacher Self-Report and Direct Observation Results 2018-2019 Treatment Teacher Self-Report Direct Observation Direct Observation Integrity Mean ( SD ) Fall 2018 Spring 2019 Procedures Mean ( SD ) Mean ( SD ) Fall Spring Educator Observer Educator Observer 2018 2019 n = 13 n = 13 n = 10 n = 13 n = 39 n = 38 85.08% 90.21% 91.07% 89.41% 90.03% 87.30% Teaching (11.21) (8.54) (7.81) (7.48) (6.13) (8.84) 84.70% 86.58% 87.86% 64.87% 82.97% 61.37% Reinforcing (12.65) (10.89) (10.55) (18.19) (16.81) (18.38) 79.01% 87.84% Monitoring - - - - (21.35) (13.20) 83.09% 88.47% 90.16% 81.62% 87.86% 79.42% Total (12.68) (7.73) (8.28) (8.80) (8.13) (9.13) Note. Monitoring procedures are not observed. A subset of observable teaching and reinforcement procedures are identified for observation. (-) = not applicable. Treatment Integrity: School-wide Evaluation Tool (SET; Version 2.0) (Todd, Lewis-Palmer, Horner, Sugai, Sampson, & Phillips, 2012) • Measures 7 subscales representing core components of school-wide positive behavioral interventions and supports (PBIS) • Scores reported in each subscale and an overall total score. • Includes the collection of products as well as brief interviews with administrator, faculty & staff, and students. 8
11/9/2018 Administering the SET • Interviews • Administrator • 10-15 randomly selected staff • A minimum of 3 Ci3T Leadership Team members • 15 Randomly selected students • Observations/Walk-through • School rules posted in 10 locations • Crisis procedure posted in 7 locations • Permanent products Download SET Manual and SET training at pbis.org (http://www.pbis.org/evaluation/evaluation-tools) Treatment Integrity: SET Results – Lincoln Elementary School Total Category Total Points Earned Points % Earned Possible Fall 2017 Spring 2018 Fall 2017 Spring 2018 Expectations Defined 3 4 4 75 100 Behavioral Expectations 8 10 10 80 100 Taught On-going System for Rewarding Behavioral 5 6 6 83.33 100 Expectations System for Responding 5 6 8 62.50 75 to Behavioral Violations Monitoring & Decision- 8 8 8 100 100 Making Management 15 14 16 93.75 87.50 4 4 4 100 100 District-Level Support Goal: 80% on Behavioral Expectations 84.94 94.64 TOTAL SCORE Taught and Overall Scores 9
11/9/2018 Treatment Integrity: SET Results Percentage of Points Earned 0 20 40 60 80 100 Expectations Defined Behavioral Expectations Taught On-going System for Rewarding Behavioral Expectations System for Responding to Behavioral Violations Fall 2017 Spring 2018 Monitoring & Decision-Making Management District-Level Support Total Score Schoolwide Universal Behavior Sustainability Index: School Teams (SUBSIST) • 50 item self-report • Ci3T Leadership Team members complete the measure 2x per year (during treatment integrity window) • Scores predict fidelity and sustainability of implementation of tiered models • Available from pbis.org Data to support sustainability of system change Sharing Data with Faculty and Staff 10
Recommend
More recommend
