Cooperative Educational ServicesMarch 18, 2015

Christine Peck, Psy.D, BCBA-D & Tracey Lamothe

PBIS 2014-2015

Coaches Network Session 2

Agenda for today

• Food for thought – PBIS Assessments as a communication and sustainability tool

• Sharing ideas with the whole group – maintaining support, communicating outcomes, and making connections to school improvement and culture

• Table Talks

• Debrief & suggest topics for next session 6/2/15

Sustainability

Durable implementation of a practice at a level

of fidelity that continues to

produced valued outcomes

Sustainability• 4 elements that contribute to sustainability• Promote PRIORITY• Ensure EFFECTIVENESS• Increase EFFICIENCY

•Use data for CONTINUOUS REGENERATION & as a communication tool

Share the data…Implementation dataStudent outcome dataSustainability data (SUBSIST – at last coaches session)

About Fidelity…• What is fidelity of implementation?• The extent to which the critical features of PBIS are implemented as intended

• Why assess it at least annually?• Helps team target next steps and/or areas for improvement• Helps improve outcomes for students by nurturing the systems created during

training

• How do we efficiently and effectively assess fidelity?

PBIS Assessments @ pbisapps.org

PBIS Assessment

PBIS Applications Training Team

District/School Evaluation Planning

PBIS Evaluation Blueprint

“Evaluation is the process of collecting and using information for decision making.

“A hallmark of School-wide Positive Behavior Support (SWPBS) is a commitment to formal evaluation.”

Evaluation Questions

FidelityTo what extent was SWPBS implemented as designed? To what extent was SWPBS implemented with fidelity?

“Are we doing what we said we would do?”

Evaluation Action Planning

It is about…

CONTEXTYour settingsYour needs

Which Surveys Meet Your

School’s Needs?

Example District/School B

What specific areas in PBIS are we strong in, and in which areas do we need more training?

Are we improving on our implementation of PBIS?

How do our staff members actually rate our PBIS implementation?

How is our implementation of Tiers II and III?

Example District B Evaluation QuestionsImplementing PBIS for three years, has been using the TIC/SET and has been consistently over 80%

District/School B: Evaluation Plan

Measure Year One Year Two Year Three

Fall Winter Spring Fall Winter Spring Fall Winter Spring

BoQ X X X

SAS X X X

Safety Survey X X X

ATT X X X X X X X X X

Example District/School D

In what specific PBIS areas are we strong, and in which areas do we need more training?

In what academic areas are we strong, and in which areas do we need more improvement?

How can we tailor our training/evaluation to meet the needs of various schools?

How can we schedule our evaluations so that we are not overwhelming our schools?

Example District D Evaluation QuestionsThe district wants to bring RtI Behavior and Academics together and create one evaluation plan.

Assessment Instrument Fall (August/Sept/Oct) Winter

(Dec/Jan)Spring

(April/May) Purpose

Team Implementation Checklist (TIC)

X X X Fidelity of Implementation

Self-Assessment Survey

X Fidelity of implementation

School Safety Survey

X Outcomes related to Protective and Risk Factors

SET X Fidelity of Implementation

AIMsWeb X X XScreening

Progress Monitor

SAT10 X Summative Evaluation

DIBELS X X X Screening

Progress monitoring

Nieves Flores, 2012

Task: Developing Your Plan

Questions to Consider:

Which surveys are your schools/districts currently using?Do they answer your evaluation questions:

Are we implementing SWPBIS with fidelity?Is there more information that we need?

Pbisapps.org > PBIS Assessment > Find Out More about Surveys

Do your surveys assess the Tiers you are implementing?Do you need a research tool?

Task: Developing Your Plan

Are you “topping out” of the surveys you are currently taking?

Do you need to customize your evaluation plan for the schools, or will one evaluation plan fit for all schools?

Do you want to assess all tiers of PBIS implementation?

Is your Evaluation Plan manageable for schools?

Impact on SWPBIS Fidelity

Leadership TeamSWPBIS District Leadership Team Self-Assessment

Capacity DevelopmentNumber of trainers/coaches available to support teams/districtsBehavioral expertise available to support Tier II and Tier III implementationEvaluation capacity

School TeamsTier I Implementation (TIC, BoQ, SET, SAS)

Collectively and/or by training cohortTier II / Tier III Implementation (MATT, BAT, ISSET)

Collectively and/or by training cohort

Impact on Student OutcomesBehavioral Outcomes

Office Discipline ReferralsSuspension/ExpulsionAttendanceDrop Out/GraduationDisproportionality in ODR and suspension/expulsion

Academic outcomesCurriculum Based Measures

Oral Reading Fluency, Dibels, AimsWebStandardized Measures

State and NationalMath, reading, writing assessments

Impact and Future Directions

Advances to datePlans for next three yearsAreas in need of adaptation

Narrowing of evaluation questions and concerns

Support and Resources

App Support & Resources

All surveys available at pbisapps.orgMost taken on-line and all reports are on your school ‘dashboard.’Currently free of charge

Schools need a PBIS Assessments Coordinator to open/manage surveys

Tracey or Christine serve the C.E.S. region

Share the big ideas…PresentationsCommunication toolsConnections to other school initiatives

School examples• Glenna Freeman, Team Coach, Davenport Ridge in Stamford [Year 3]• District presentation• Connections to district and school improvement plan• Supporting staff implementation

• Tashua Elementary School, Trumbull [Year 2]• Staff and student PowerPoint presentations

• Wilcoxon Elementary, Stratford [Year 2]• family brochure (handout)

Help Each Other…

Table Talks

Table Talks• Count off by 4s (or more depending on size of the group)• Sit together by number and choose a facilitator and a recorder

• Using the categories on the prompt sheet, discuss ways you use, or would like to use, data, materials and communication tools to help create or maintain support for your PBIS implementation efforts

• Be prepared to share out with the larger group at 10:40.

Experimental Research on SWPBIS

Bradshaw, C.P., Koth, C.W., Thornton, L.A., & Leaf, P.J. (2009). Altering school climate through school-wide Positive Behavioral Interventions and Supports: Findings from a group-randomized effectiveness trial. Prevention Science, 10(2), 100-115

Bradshaw, C.P., Koth, C.W., Bevans, K.B., Ialongo, N., & Leaf, P.J. (2008). The impact of school-wide Positive Behavioral Interventions and Supports (PBIS) on the organizational health of elementary schools. School Psychology Quarterly, 23(4), 462-473.

Bradshaw, C. P., Mitchell, M. M., & Leaf, P. J. (2010). Examining the effects of School-Wide Positive Behavioral Interventions and Supports on student outcomes: Results from a randomized controlled effectiveness trial in elementary schools. Journal of Positive Behavior Interventions, 12, 133-148.

Bradshaw, C.P., Reinke, W. M., Brown, L. D., Bevans, K.B., & Leaf, P.J. (2008). Implementation of school-wide Positive Behavioral Interventions and Supports (PBIS) in elementary schools: Observations from a randomized trial. Education & Treatment of Children, 31, 1-26.

Bradshaw, C., Waasdorp, T., Leaf. P., (in press). Effects of School-wide positive behavioral interventions and supports on child behavior problems and adjustment. Pediatrics.

Horner, R., Sugai, G., Smolkowski, K., Eber, L., Nakasato, J., Todd, A., & Esperanza, J., (2009). A randomized, wait-list controlled effectiveness trial assessing school-wide positive behavior support in elementary schools. Journal of Positive Behavior Interventions, 11, 133-145.

Horner, R. H., Sugai, G., & Anderson, C. M. (2010). Examining the evidence base for school-wide positive behavior support. Focus on Exceptionality, 42(8), 1-14.

Ross, S. W., Endrulat, N. R., & Horner, R. H. (2012). Adult outcomes of school-wide positive behavior support. Journal of Positive Behavioral Interventions. 14(2) 118-128.Waasdorp, T., Bradshaw, C., & Leaf , P., (2012) The Impact of Schoolwide Positive Behavioral Interventions and Supports on Bullying and Peer Rejection: A Randomized Controlled Effectiveness Trial. Archive of Pediatric Adolescent Medicine. 2012;166(2):149-156 Bradshaw, Pas, Goldweber, Rosenberg, & Leaf, 2012

SWPBIS Experimentally Related to:1. Reduction in problem behavior2. Increased academic performance3. Increased attendance4. Improved perception of safety5. Reduction in bullying behaviors

6. Improved organizational efficiency7. Reduction in staff turnover8. Increased perception of teacher efficacy

9. Improved Social Emotional competence

Main Messages• PBIS works.

Effective (academic, behavior)

Equitable (all students succeed) Efficient (time, cost)

School-wide Positive Behavioral Interventions and Supports (SWPBIS)

• The social culture of a school matters.

• A continuum of supports that begins with the whole school and extends to intensive, wraparound support for individual students and their families.

• Effective practices with the systems needed for high fidelity and sustainability

• Multiple tiers of intensity

Help Us Help You…

Our next Coaches Network session is June 2, 2015. Please complete the 3-2-1 feedback sheet and let us know how this format worked for you and what topics you would like to discuss next time (or in training if applicable)

We will share the great stuff we gather from attending the Northeast PBIS Conference in May