Harvesting Data for Problem Solving REBECCA PIERMATTEI Wayne Hickman Christina Jordan
description
Transcript of Harvesting Data for Problem Solving REBECCA PIERMATTEI Wayne Hickman Christina Jordan
![Page 1: Harvesting Data for Problem Solving REBECCA PIERMATTEI Wayne Hickman Christina Jordan](https://reader036.fdocuments.us/reader036/viewer/2022062222/56815fab550346895dcea6b6/html5/thumbnails/1.jpg)
Harvesting Data for Problem Solving
REBECCA PIERMATTEIWayne HickmanChristina Jordan
PBIS Maryland Coaches MeetingApril 30, 2014 & May 5, 2014
![Page 2: Harvesting Data for Problem Solving REBECCA PIERMATTEI Wayne Hickman Christina Jordan](https://reader036.fdocuments.us/reader036/viewer/2022062222/56815fab550346895dcea6b6/html5/thumbnails/2.jpg)
WHAT CAN WE LEARN FROM DATA?
What we are doing well and what challenges we face
Which students, teachers, systems need more support
Whether our support is successful
![Page 3: Harvesting Data for Problem Solving REBECCA PIERMATTEI Wayne Hickman Christina Jordan](https://reader036.fdocuments.us/reader036/viewer/2022062222/56815fab550346895dcea6b6/html5/thumbnails/3.jpg)
In a NutshellKnow what data you need and how to access the
data.
Make sure your data is reliable
Review and share data on a regular basis.
Keep it simple and reasonable.
Use your data to guide your decision making.
Use your data to evaluate individual progress as well as program and school-wide success.
![Page 4: Harvesting Data for Problem Solving REBECCA PIERMATTEI Wayne Hickman Christina Jordan](https://reader036.fdocuments.us/reader036/viewer/2022062222/56815fab550346895dcea6b6/html5/thumbnails/4.jpg)
BEFORE YOU START…Resource Mapping
![Page 5: Harvesting Data for Problem Solving REBECCA PIERMATTEI Wayne Hickman Christina Jordan](https://reader036.fdocuments.us/reader036/viewer/2022062222/56815fab550346895dcea6b6/html5/thumbnails/5.jpg)
Resource Mapping-Inventory of Current Practices
• What are the practices in place at each tier of the triangle?
• Are they evidence-based practices?• How are you measuring effectiveness of
practices (data)? • Who are the service delivery
teams/personnel (e.g., graduation coach, PALS teacher, Math Coach)
![Page 6: Harvesting Data for Problem Solving REBECCA PIERMATTEI Wayne Hickman Christina Jordan](https://reader036.fdocuments.us/reader036/viewer/2022062222/56815fab550346895dcea6b6/html5/thumbnails/6.jpg)
Tier 3
Tier 2
Tier 1
Triangle Activity:
Applying the Three-Tiered
Logic to Your School
7
Practices, Initiatives, Programs for a FEW
Practices, Initiatives, Programs for SOME
Practices, Initiatives, Programs for ALL
![Page 7: Harvesting Data for Problem Solving REBECCA PIERMATTEI Wayne Hickman Christina Jordan](https://reader036.fdocuments.us/reader036/viewer/2022062222/56815fab550346895dcea6b6/html5/thumbnails/7.jpg)
BEFORE YOU START…Resource Mapping
Early Warning Indicators
![Page 8: Harvesting Data for Problem Solving REBECCA PIERMATTEI Wayne Hickman Christina Jordan](https://reader036.fdocuments.us/reader036/viewer/2022062222/56815fab550346895dcea6b6/html5/thumbnails/8.jpg)
Early Warning IndicatorsCourse
Performance inCore Subjects GPA Credits
FCAT/Concordance
ScoresAttendance
Office Discipline Referrals
AdditionalFactors
On-Track Indicators
On-Track
Meeting all graduation requirements Cs or better in all areas
2.5 or more Meeting credit graduation requirement for grad plan year
Level 3 or Above or concordant scores within the same school year
4% or less absences per quarter or semester
3 or less Level I and/or minor referrals
DisengagementNo extra curricular involvementSubstance AbuseHigh MobilityMental health issuesFree/Reduced lunchFoster/group homeTransient/HomelessParent unemployment Student employmentChanges in behavior/ appearance More recent traumatic eventMissed guidance appointmentsNo show for yearbook picture
At-Risk forOff Track
Lacking 1 graduation requirement
2.0 to 2.49 Behind 1 Credits
Level 2 on FCAT 5% or more absences per quarter or semester
4 or less Level I and/or minor referralsLevel II ODRs per semester
Off-Track
Lacking 2 graduation requirementsFailing 1-3 classes
Less than 2.0 Behind 3 credits Not passed both sections of 10th grade FCAT or retakesNo concordant scores
10% absences per quarter or semester
5 or more Level I and/or Level II ODRs per semester
Highly Off-Track
Lacking 2 or more graduation requirementsCurrently failing 3 or more classes
Less than or equal to 1.5
Behind 4 or more credits
Not passed 10th grade FCAT or retakesNo concordant scores
15% or more absences per quarter or semester
5 or more Level II ODRs for fighting/ profanity/ disruption per semester
ExtremelyOff-Track
Meeting no graduation requirements2-3 Years Behind
Less than or equal to 1.0
Not meeting cohort graduation plan
Not passed 10th grade FCAT or retakesNo concordant scores
20% or more absences per quarter or semester
Established pattern of severe behavior Level II & III ODRs
![Page 9: Harvesting Data for Problem Solving REBECCA PIERMATTEI Wayne Hickman Christina Jordan](https://reader036.fdocuments.us/reader036/viewer/2022062222/56815fab550346895dcea6b6/html5/thumbnails/9.jpg)
Part A: SCHOOL-WIDE DATAIdentify what academic and behavioral data you need
ACADEMIC: Homework completion, GPA, Credit Accrual, Benchmark Assessments
BEHAVIORAL: ODRs (Big 5), attendance, suspension/expulsion, minor incidents, nursing and counseling logs
Identify the sources of that data
Identify the person responsible for getting and presenting the data
Identify how often and it what manner it will be shared with the team, faculty, and administration
![Page 10: Harvesting Data for Problem Solving REBECCA PIERMATTEI Wayne Hickman Christina Jordan](https://reader036.fdocuments.us/reader036/viewer/2022062222/56815fab550346895dcea6b6/html5/thumbnails/10.jpg)
Part B: WHAT DO WE DO WITH THE DATA?
Celebrate success!
Identify problems with PRECISION using the 5 W’s:What, Where, When, Who, Why
Determine whether your data indicates a need for school-wide practice or small group/individual response?
Develop Solution Options
Create Problem Solving Action Plan
Evaluate Solution
![Page 11: Harvesting Data for Problem Solving REBECCA PIERMATTEI Wayne Hickman Christina Jordan](https://reader036.fdocuments.us/reader036/viewer/2022062222/56815fab550346895dcea6b6/html5/thumbnails/11.jpg)
HELPFUL TOOLSData Decision RulesProblem Solving Action Plan
![Page 12: Harvesting Data for Problem Solving REBECCA PIERMATTEI Wayne Hickman Christina Jordan](https://reader036.fdocuments.us/reader036/viewer/2022062222/56815fab550346895dcea6b6/html5/thumbnails/12.jpg)
IF: Focus On:
> 35% of students receive 1 or more referralsAverage referrals per student > 2.5
Schoolwide Systems
> 35% of referrals come from non-classroom settings> 15% of students who receive a referral are referred from non-classroom settings
Non-Classroom Systems
>50% of referrals are from classroom settings>40% of referrals come from less than 10% of the classrooms
Classroom Systems
At least 10-15 students have 5 or more referrals Targeted Group Interventions
<10 students with 10 or more office referrals<10 students continue w/referrals after targeted interventionSmall number of students destabilizing overall functioning
Individual Student Systems
![Page 13: Harvesting Data for Problem Solving REBECCA PIERMATTEI Wayne Hickman Christina Jordan](https://reader036.fdocuments.us/reader036/viewer/2022062222/56815fab550346895dcea6b6/html5/thumbnails/13.jpg)
EXAMPLEPRECISION PROBLEM STATEMENT:
Many students from all grade levels are engaging in disruption, inappropriate language, and harassment in the cafeteria and hallway during lunch, and the behavior is maintained by peer attention.
Identify 5 W’sIdentify which system you will target
![Page 14: Harvesting Data for Problem Solving REBECCA PIERMATTEI Wayne Hickman Christina Jordan](https://reader036.fdocuments.us/reader036/viewer/2022062222/56815fab550346895dcea6b6/html5/thumbnails/14.jpg)
![Page 15: Harvesting Data for Problem Solving REBECCA PIERMATTEI Wayne Hickman Christina Jordan](https://reader036.fdocuments.us/reader036/viewer/2022062222/56815fab550346895dcea6b6/html5/thumbnails/15.jpg)
TIER 2/3: Sorting Students into Interventions
ACTIVITY
![Page 16: Harvesting Data for Problem Solving REBECCA PIERMATTEI Wayne Hickman Christina Jordan](https://reader036.fdocuments.us/reader036/viewer/2022062222/56815fab550346895dcea6b6/html5/thumbnails/16.jpg)
![Page 17: Harvesting Data for Problem Solving REBECCA PIERMATTEI Wayne Hickman Christina Jordan](https://reader036.fdocuments.us/reader036/viewer/2022062222/56815fab550346895dcea6b6/html5/thumbnails/17.jpg)
BEFORE YOU START…Resource Mapping
Early Warning Indicators
Decision Rules for Access to Interventions
![Page 18: Harvesting Data for Problem Solving REBECCA PIERMATTEI Wayne Hickman Christina Jordan](https://reader036.fdocuments.us/reader036/viewer/2022062222/56815fab550346895dcea6b6/html5/thumbnails/18.jpg)
Decision Rules for Access to Advanced Tiers
Specific to each intervention
Identify objective variables/criteria as well as the minimum/maximum for eachEX: GPA between 1.0 and 1.5
You may need to scale up or down depending on your capacity
![Page 19: Harvesting Data for Problem Solving REBECCA PIERMATTEI Wayne Hickman Christina Jordan](https://reader036.fdocuments.us/reader036/viewer/2022062222/56815fab550346895dcea6b6/html5/thumbnails/19.jpg)
Part C: Sorting Students into Interventions
1. How will students be identified for this intervention? What are the data decision rules for access – criteria used, min and max for each variable?
2. What data do we need?
3. Where will we get the data?
4. Who will be responsible for collecting the data?
![Page 20: Harvesting Data for Problem Solving REBECCA PIERMATTEI Wayne Hickman Christina Jordan](https://reader036.fdocuments.us/reader036/viewer/2022062222/56815fab550346895dcea6b6/html5/thumbnails/20.jpg)
HELPFUL TOOLSEARLY WARNING INDICATORS
RESOURCE MAPPING
DECISION RULES FOR ACCESS TO ADVANCED TIERS
![Page 21: Harvesting Data for Problem Solving REBECCA PIERMATTEI Wayne Hickman Christina Jordan](https://reader036.fdocuments.us/reader036/viewer/2022062222/56815fab550346895dcea6b6/html5/thumbnails/21.jpg)
Part D: Progress Monitoring and Program Evaluation
1. How will student progress be measured/monitored? Who is responsible for measuring/monitoring progress?
2. What indicators/benchmarks will show that a student is responding to the intervention? Not responding?
3. What indicators/benchmarks will show that a student is ready to exit the program?
4. How will overall program success be measured/monitored?
![Page 22: Harvesting Data for Problem Solving REBECCA PIERMATTEI Wayne Hickman Christina Jordan](https://reader036.fdocuments.us/reader036/viewer/2022062222/56815fab550346895dcea6b6/html5/thumbnails/22.jpg)
HELPFUL TOOL
Intervention Tracking Tool
*Illinois PBIS Network
![Page 23: Harvesting Data for Problem Solving REBECCA PIERMATTEI Wayne Hickman Christina Jordan](https://reader036.fdocuments.us/reader036/viewer/2022062222/56815fab550346895dcea6b6/html5/thumbnails/23.jpg)
![Page 24: Harvesting Data for Problem Solving REBECCA PIERMATTEI Wayne Hickman Christina Jordan](https://reader036.fdocuments.us/reader036/viewer/2022062222/56815fab550346895dcea6b6/html5/thumbnails/24.jpg)
OH NO!What do you do if your data shows
your program is not working?
![Page 25: Harvesting Data for Problem Solving REBECCA PIERMATTEI Wayne Hickman Christina Jordan](https://reader036.fdocuments.us/reader036/viewer/2022062222/56815fab550346895dcea6b6/html5/thumbnails/25.jpg)
FIDELITY MEASURESDetermine whether you are
implementing with fidelity(Are you doing it the way you are supposed to be doing it?)
Consider BOQ, SET, PBIS-TIC
Consider intervention specific fidelity measures
![Page 26: Harvesting Data for Problem Solving REBECCA PIERMATTEI Wayne Hickman Christina Jordan](https://reader036.fdocuments.us/reader036/viewer/2022062222/56815fab550346895dcea6b6/html5/thumbnails/26.jpg)
IMPORTANT CONSIDERATION
DATA MUST BE RELIABLEEXAMPLE: Behavior Referrals
Define your behaviors
Agreement re: major/minor
Standardized procedures for gathering referrals
All staff trained in how to complete and submit referrals
![Page 27: Harvesting Data for Problem Solving REBECCA PIERMATTEI Wayne Hickman Christina Jordan](https://reader036.fdocuments.us/reader036/viewer/2022062222/56815fab550346895dcea6b6/html5/thumbnails/27.jpg)
In a NutshellKnow what data you need and how to access the
data.
Make sure the data is reliable
Review and share data on a regular basis.
Keep it simple and reasonable.
Use your data to guide your decision making.
Use your data to evaluate individual progress as well as program and school-wide success.
![Page 28: Harvesting Data for Problem Solving REBECCA PIERMATTEI Wayne Hickman Christina Jordan](https://reader036.fdocuments.us/reader036/viewer/2022062222/56815fab550346895dcea6b6/html5/thumbnails/28.jpg)
Acknowledgements MDS3 is funded by a grant from the USDOE.
Federal Grant CFDA# Q184Y100015
Sheppard Pratt Health System: Rebecca Piermattei, M.S. [email protected] Wayne Hickman, Ed.D. [email protected] Christina Jordan, M.Ed. [email protected]
Maryland State Department of Education
Johns Hopkins University