Slide 1

Washington PBIS Conference Northwest PBIS Network Spokane, WA November 2013 Nadia K. Sampson & Dr. Kelsey R. Morris University of Oregon

Slide 2

Introductions & Presentation Goals Collecting Data for Decision Making PBIS Applications Overview Analyzing Data to Enhance Decision Making Essential Questions Are we doing what we said we would do? Is it making a positive difference in student outcomes? Questions & Answers

Slide 3

School/Facility SWIS User CICO-SWIS User ISIS-SWIS Coordinator or User PBIS Assessment User District, Regional, Program, or State Implementer or Coach Manager or Evaluator PBIS Assessment Coordinator PBIS Evaluation User SWIS Suite Facilitator Other

Slide 4

Intended Audience: Individuals wanting to monitor progress and implementation fidelity at the student, school/facility, or multi- site level (e.g., district, region, state). What you should leave with: An overview of the PBIS Applications available Examples of how to use PBISApps data for progress monitoring and implementation fidelity Examples of how the applications function and can be incorporated into decision systems

Slide 5

Slide 6

Slide 7

PBISApps is was developed and is operated by Educational and Community Supports (ECS), a research unit at the University of Oregon. The PBISApps team manages a series of educational tools related to the implementation of multi-tiered support systems (MTSS): School-Wide Information System (SWIS) Suite including SWIS, CICO-SWIS, ISIS-SWIS PBIS Assessment PBIS Evaluation PBIS Applications have been implemented in more than 25,000 schools in the U.S. and abroad.

Slide 8

Slide 9

ISIS-SWIS is a decision system for students requiring more intensive and individualized supports for academic, social, or mental health services. CICO-SWIS is a decision system for targeted or group- based interventions for students needing additional support beyond the Universal or Tier I system. The School-Wide Information System (SWIS) is a web- based decision system designed to help school/facility personnel use office referral data to monitor progress of school-wide and individual student interventions.

Slide 10

The SWIS Suite is a set of four applications (SWIS, CICO-SWIS, ISIS-SWIS, SAMI) designed to assist schools in using information for decision making which makes a team more effective and efficient. The right information given in the right format, at the right time, to the right people enhances the quality of decision making. Teams will ask questions of their data such as Do we have a problem? What is the problem? Where, when, why, and how are problems occurring?

Slide 11

Slide 12

Slide 13

Slide 14

Slide 15

PBIS Assessment is a web-based application designed to offer a variety of tools for measuring and monitoring high-fidelity, sustained implementation of school-wide positive behavioral interventions and supports (SWPBIS). Are we doing what we said we would do?

Slide 16

Using PBIS Assessment data improves the efficiency and accuracy of: Initial assessment of discipline practices. Implementation assessment of the fidelity with which schools use SWPBIS procedures. Sustained assessment of SWPBIS implementation at all three tiers to promote ongoing use of core SWPBIS features. PBIS Assessment assists in designing action plans to improve SWPBIS implementation fidelity.

Slide 17

Research Tool Annual Assessment Tool Progress Monitoring Tool Universal System School-wide Evaluation Tool (SET) Benchmarks of Quality (BoQ) Early Childhood BoQ (EC BoQ) PBIS Self-Assessment Survey (SAS) Team Implementation Checklist (TIC) Secondary & Tertiary Systems Benchmarks of Advanced Tiers (BAT) PBIS Self-Assessment Survey (SAS) Monitoring Advanced Tiers Tool (MATT) Outcome Measures: School Safety Survey

Slide 18

Research Tool Annual Assessment Tool Progress Monitoring Tool Universal System School-wide Evaluation Tool (SET) Benchmarks of Quality (BoQ) Early Childhood BoQ (EC BoQ) PBIS Self-Assessment Survey (SAS) Team Implementation Checklist (TIC) Secondary & Tertiary Systems Individual Student School- wide Evaluation Tool (ISSET) Benchmarks of Advanced Tiers (BAT) PBIS Self-Assessment Survey (SAS) Monitoring Advanced Tiers Tool (MATT) Outcome Measures: School Safety Survey

Slide 19

To get a PBIS Assessment account: Identify a local (district/regional) PBIS Assessment Coordinator PBIS Assessment Coordinator will provide your school with an account code to login

Slide 20

Slide 21

The PBIS Evaluation website allows state, regional, and district leadership teams to use implementation fidelity and student outcome data to evaluate the impact of their PBIS implementation. PBISEval is a reporting tool that aggregates SWIS Suite and PBIS Assessment data across multiple schools in an identified state, region, or district.

Slide 22

A PBIS Evaluation account allows teams to: View state, district, or regional data. View multiple schools at the same time. Create customized cohorts of schools. Compare SWPBIS implementation to student outcomes.

Slide 23

A PBIS Evaluation account is available to any state, region, or district with a SWPBIS leadership team actively engaged in SWPBIS implementation. 1.Review Introduction to PBIS Evaluation available at pbisapps.org 2.Contact support@pbisapps.org 3.Determine data-sharing agreements 4.Schedule demonstration/training

Slide 24

Your annual subscription starts the day your teams account is activated. Your account will be renewed automatically each year. Region SizePrice District license$500 Regional license$750 State license$1000

Slide 25

Slide 26

Are we doing what we said we would do? Is it making a positive difference in student outcomes?

Slide 27

What information do we already collect? How will we use the information we have? What do we need to make good decisions on a daily, weekly, and monthly schedule? What do we need to make good decisions on a quarterly or annual schedule? What is possible? What is doable?

Slide 28

What are our systems and procedures for collecting data? What are our systems and procedures for analyzing and sharing data? How are teams organized to use data for decision making?

Slide 29

Are we doing what we said we would do?

Slide 30

PBIS Assessment Teams can review current implementation data for the school year across tiers of implementation. Discuss implications and action planning. Research Tool Annual Assessment Tool Progress Monitoring Tool Universal System School-wide Evaluation Tool (SET) Benchmarks of Quality (BoQ) Early Childhood BoQ (EC BoQ) PBIS Self-Assessment Survey (SAS) Team Implementation Checklist (TIC) Secondary & Tertiary Systems Individual Student School-wide Evaluation Tool (ISSET) Benchmarks of Advanced Tiers (BAT) PBIS Self-Assessment Survey (SAS) Monitoring Advanced Tiers Tool (MATT) Outcome Measures: School Safety Survey

Slide 31

Slide 32

Is it making a positive difference in student outcomes?

Slide 33

SWIS Suite SWIS School-wide data CICO-SWIS Targeted, small group data ISIS-SWIS Individualized intervention data

Slide 34

SWIS assists in identifying school-wide patterns and problems The SWIS Dashboard serves as an indicator of current levels of activity within the school/facility

Slide 35

The SWIS Drill Down feature allows for a deeper level of analysis formatted by selected filters

Slide 36

CICO-SWIS assists in progress monitoring students participating in the Check- In Check-Out intervention.

Slide 37

The Average Daily Points report within CICO helps answer depicts how is each student doing in relation to the school- wide goal.

Slide 38

ISIS-SWIS assists in progress monitoring individual students with specific behavior support plans.

Slide 39

Brian Bender Brian is a creative and thoughtful eighth grader with a history of academic and behavioral problems in the classroom. Brian is a student who receives academic and behavioral Tier III supports.

Slide 40

The Individual Student Dashboard within SWIS provides a summary report of a students office discipline referral patterns.

Slide 41

Question for Analysis: What is the students pattern over time?

Slide 42

Question for Analysis: What does the students average day look like?

Slide 43

Question for Analysis: What is the students pattern over time in a single period?

Slide 44

Slide 45

Slide 46

Slide 47

State Region District School

Slide 48

PBIS Evaluation collects data from the SWIS Suite as well as PBIS Assessment to help districts, regions, and states analyze: Which schools are actively engaged in SWPBIS implementation? Are schools implementing SWPBIS with fidelity? Is the implementation having an effect on student behavior?

Slide 49

Summary of Schools Adopting SWPBIS

Slide 50

Summary of SWPBIS Schools by Grade Level

Slide 51

Are schools implementing SWPBIS to criterion? SET Subscale Report

Slide 52

Are schools implementing SWPBIS to criterion? BoQ Subscale Report

Slide 53

Is SWPBIS implementation affecting student outcomes? ODR/100/Day

Slide 54

Is SWPBIS implementation affecting student outcomes? ODRs by Problem Behavior

Slide 55

Is SWPBIS implementation affecting student outcomes? ODRs by Ethnicity

Slide 56

Is SWPBIS implementation affecting student outcomes? Suspension Report

Slide 57

Is SWPBIS implementation affecting student outcomes? Triangle Report

Slide 58

Is SWPBIS implementation affecting student outcomes? CICO-SWIS: Students Succeeding

Slide 59