Tiered Fidelity Inventory Us Using t g the he TFI f for r Beha - PowerPoint PPT Presentation

Tiered Fidelity Inventory Us Using t g the he TFI f for r Beha ehavio vioral Da Data-Based Deci d Decision n Making Dr. Bert Eliason, University of Oregon Celeste Rossetto Dickey, University of Oregon

Session Objectives  Understand why the TFI was developed and be informed about the reliability and validity  How to prepare teams to be ready for the assessment at each tier completing the TFI  How to view reports and use the reports for data-based decision making  Learn about one school & district’s action planning

Purpose of the TFI The purpose of the School- wide PBIS Tiered Fidelity Inventory is to provide an efficient and valid index of the extent to which PBIS core features are in place within a school.

PBIS Applications Website: www.pbisapps.org Free Fidelity and Outcome Assessments are available for schools and districts!

Why Use the TFI?  The TFI w was d developed t to provide one a assessment acr cross a all three t tiers t that could b be used for progress m monitoring and annual e evaluation  Three separate s studies s show  Relia iabilit ility: Consistent results among raters  Valid lidit ity: Significant correlation with other measures (BoQ, TIC, SAS, and BAT)  Usability ty: Teams reported the TFI as efficient & useful for decision making

Why another fidelity measure? ISSET BAT MATT Tiered Fidelity Phases of Inventory Implementation (POI) (TFI) SET TIC BoQ SAS

TFI Assesses All Three Tiers SWPBIS Tiers: 1.Universal (Tier 1) 2.Targeted (Tier 2) 3.Intensive (Tier 3) TFI – Tier 1 TFI – Tier II TFI-Tier III ALL Tiers

Assessing All Tiers T ie r III: Inte nsive SWPBIS F e atur e s inte nsive , individua lize d suppo rts • 1-5% o f stude nt po pula tio n • T ie r II: T ar ge te d SWPBIS F e atur e s ta rg e te d , sma ll g ro up suppo rts • 5 -15% o f stude nt po pula tio n • T ie r I: Unive r sal SWPBIS F e atur e s prima ry pre ve ntio n • 80% o f stude nt po pula tio n •

SWPBIS Tiered Fidelity Inventory (TFI)

Resources on www.p .pbisapps.o .org  SWPBIS Tiered Fidelity Inventory 2.1  TFI Action Plan Template  TFI Videos  Preparation  Completing and Recording  Reviewing and Analyzing the Reports  Action Planning

Resources on www.pbis.org Tiered Fidelity Inventory  SWPBIS Tiered Fidelity Inventory V2.1 (revised on Feb 16, 2017)  SWPBIS Tiered Fidelity Inventory Walkthrough Tool  SWPBIS TFI Tier III Support Plan Worksheet  Tiered Fidelity Inventory Training Power Point

PBIS Cultural Responsiveness Field Guide Available at: http://www.pbis.org/school/equity-pbis Section II: TFI Cultural Responsiveness Companion

Prep epar aration on for the T e TFI

Preparing to Complete the TFI Comp mplete t the T TFI C Comp mpanion Tools befo fore the me meeting o Tier I: TFI Walkthrough (Appendix A) Can be o Tier II: Targeted Interventions Reference Map (Appendix B) completed by small sub- o Tier III Support Plan Worksheet (Appendix C) group  Us Use e the r he res esults t s to ans nswer t the s he spec pecified ques questions o s of the T he TFI FI  Be Be ab able t to access do ess docum umentation t to assi ssist w with c compl pleting the he TFI FI  Electronically  Hard copy

TFI Team Meeting Time & Place  Schedule a time and place to complete the TFI without interruptions  Allow approximately 30 minutes per tier Team Members & Coach  Be sure the correct team members are present and the coach is available  Considerations:  How are the teams organized?  One team for all tiers?  A Tier I and Tier II-III team?  Separate Tier I, Tier II, and Tier III teams?

TFI Companion Tools Complete the TFI Companion Tools before the meeting.  Tier I: TFI Walkthrough  Appendix A  Tier II: Targeted Interventions Reference Map  Appendix B  Tier III: Support Plan Worksheet  Appendix C

TFI Walkthrough: Appendix A (pages 27-28)

Appendix A: p. 27 Walkthrough Overview Who completes the Walkthrough? It is recommended that a person external to the school complete the Walkthrough Tool. Use this form to interview a random selection of staff (at least 10% of staff or at least 5 for smaller schools) and students (minimum 10). Staff Interview Questions: 1. What are the _________________(school rules/expectations/“bees,” etc.)? 2. Have you taught the school rules/expectations this year? 3. Have you given out any ________________ (rewards, acknowledgements) in the past two months? Student Interview Questions: 1. What are the _________________(school rules/expectations/“bees,” etc.)? 2. Have you received any ________________ (rewards, acknowledgements) in the past two months?

Appendix A: p. 28 Walkthrough Tool Use this form to write the information about the expectations and acknowledgement system. Use the chart at the bottom to keep track of the answers. Calculate the number of responses.

Tier II: Targeted Interventions Reference Guide Appendix B Pages 29-30

Targeted Interventions Reference Guide Appendix B The targeted interventions used at the example school are listed across the top. In each column, either a “yes” or “x” is added if the intervention meets the criteria.

Tier III: Support Plan Worksheet: Appendix C Page 31

Preparation • Complete Appendices A, B, and/or C before the meeting. • Use the results to answer the specified questions of the TFI. • Be able to access documentation to assist with completing the TFI.

Possible Data Sources for the TFI: Tier I

Completing & Recording the TFI Items The Tiered Fidelity Inventory

Completing the TFI Reminder: * Not an extensive Have the Team Members & Coach present. discussion *Save Action Planning for later Allow at least 30 minutes to complete each tier. Complete the TFI as a team

Coach-guided, Team-based Self-assessment 2 Fully Implemented 1 Partially Implemented 0 Not Implemented

Recording the TFI Scores Enter the scores into PBIS Assessment  This can be done as the team completes the TFI, or  The scores can be entered at a later time The scores are entered by a PBIS Assessment Coordinator or a designated Team Member.  Go to www.pbisapps.org

Accessing & Reporting Results The Tiered Fidelity Inventory (TFI)

Four Reports Available for the TFI Tot otal S Scor ore : Overall implementation percentage for Tiers I-III  Most helpful when the team is implementing all three tiers Sc Scale le : Overall implementation percentage for each tier  70% is the benchmark for implementation with fidelity Su Subscale le : Overall implementation percentage for each subscale of each tier  Tier I subscales: Teams, Implementation, and Evaluation  Tier II subscales: Teams, Intervention, and Evaluation  Tier III subscales: Teams, Resources, Support Plans, and Evaluation Items ms : Each item is listed with the score  Very helpful for prioritizing and action planning

TFI Total Score Report Total Score Report : Overall implementation percentage for Tiers I-III This is most helpful when the team is implementing all three tiers.

TFI: Scale Report Scale Report : Overall implementation percentage for each tier 70% is the benchmark for implementation with fidelity.

TFI: Subscale Report

TFI: Individual Items Report: Tiers I & II

TFI: Individual Items Report: Tier III

Next Steps  Have team members review the reports  Schedule a team meeting  Use the reports to prioritize and develop your Action Plan

Example Action Plan Celebrate the 2’s! Choose up to three 1’s or 0’s to focus upon.

Sharing the Results & Action Plan for the TFI  Develop an action plan with the team  Share the action plan with staff  Give monthly updates of progress to staff  Provide an Annual Summary to share with families, staff, the district, and other stakeholders

Evaluation Summary Example Annual Summary for Stakeholders Guides PBIS implementation • Professional development needs • Coaching supports • Re-teaching • Feedback and communication with stakeholders

Action Planning with the TFI  District L Level: The Items report from PBIS Evaluation assists with planning professional development for the District, and also to evaluate the implementation of Tiers I-III  Individual S Schools: The Items Report assists schools in developing their PBIS Action Plan

PBIS Assessments Used Over the Years Too many surveys and difficulty with  Self Assessment Survey (SAS) creating action plans with multiple sources of data. District decision to  School Safety Survey (SSS) move to the Tiered Fidelity Inventory  School-wide Evaluation Tool (SET)  Team Implementation Checklist (TIC)  Benchmarks of Quality (BoQ)

Current Evaluation Plan 2017 017-18 T TFI C Calendar ar  August – October : Complete full TFI; First district-wide PBIS in-service  January : Assess target tier with TFI and update action planning  February : Second district-wide PBIS in-service  May : Assess target tier with TFI and update action