Problem-Solving/Response to Intervention: Challenges to Implementation

110
Problem-Solving/Response to Intervention: Challenges to Implementation Springfield Public Schools May 15, 2008 George M. Batsche Co-Director, Institute for School Reform Florida Statewide Problem-Solving/RtI Project School Psychology Program University of South Florida

description

Problem-Solving/Response to Intervention: Challenges to Implementation. Springfield Public Schools May 15, 2008 George M. Batsche Co-Director, Institute for School Reform Florida Statewide Problem-Solving/RtI Project School Psychology Program University of South Florida. Resources. - PowerPoint PPT Presentation

Transcript of Problem-Solving/Response to Intervention: Challenges to Implementation

Page 1: Problem-Solving/Response to Intervention: Challenges to Implementation

Problem-Solving/Response to Intervention:Challenges to Implementation

Springfield Public SchoolsMay 15, 2008

George M. Batsche

Co-Director, Institute for School Reform

Florida Statewide Problem-Solving/RtI Project

School Psychology Program

University of South Florida

Page 2: Problem-Solving/Response to Intervention: Challenges to Implementation

Resources

• www.nasdse.org– Implementation Blueprints– “Primer” on RtI– Research Evidence

• www.floridarti.usf.edu

• www.fcrr.org

• www.rtinetwork.org

Page 3: Problem-Solving/Response to Intervention: Challenges to Implementation

The Vision

• 95% of students at “proficient” level

• Students possess social and emotional behaviors that support “active” learning

• A “unified” system of educational services

– One “ED”

• Student Support Services perceived as a necessary component for successful schooling

Page 4: Problem-Solving/Response to Intervention: Challenges to Implementation

Paradigm Shift

• Eligibility focus– Diagnose and Place– Get label

• Outcome focus – Problem Solving and

Response to Intervention– Get help

Page 5: Problem-Solving/Response to Intervention: Challenges to Implementation

Response to Intervention

• RtI is the practice of (1) providing high-quality instruction/intervention matched to student needs and (2) using learning rate over time and level of performance to (3) make important educational decisions.

(Batsche, et al., 2005)

• Problem-solving is the process that is used to develop effective instruction/interventions.

Page 6: Problem-Solving/Response to Intervention: Challenges to Implementation

Problem Solving Process

EvaluateResponse to

Intervention (RtI)

EvaluateResponse to

Intervention (RtI)

Problem AnalysisValidating ProblemIdent Variables that

Contribute to ProblemDevelop Plan

Problem AnalysisValidating ProblemIdent Variables that

Contribute to ProblemDevelop Plan

Define the ProblemDefining Problem/Directly Measuring Behavior

Define the ProblemDefining Problem/Directly Measuring Behavior

Implement PlanImplement As Intended

Progress MonitorModify as Necessary

Implement PlanImplement As Intended

Progress MonitorModify as Necessary

Page 7: Problem-Solving/Response to Intervention: Challenges to Implementation

Steps in the Problem-Solving Process

1. PROBLEM IDENTIFICATION• Identify replacement behavior• Data- current level of performance• Data- benchmark level(s)• Data- peer performance• Data- GAP analysis

2. PROBLEM ANALYSIS• Develop hypotheses( brainstorming)• Develop predictions/assessment

3. INTERVENTION DEVELOPMENT• Develop interventions in those areas for which data are available and hypotheses verified• Proximal/Distal• Implementation support

4. Response to Intervention (RtI)• Frequently collected data• Type of Response- good, questionable, poor

Page 8: Problem-Solving/Response to Intervention: Challenges to Implementation

Stages of Implementing Problem-Solving/RtI

• Consensus– Belief is shared– Vision is agreed upon– Implementation requirements understood

• Infrastructure Development– Problem-Solving Process– Data System– Policies/Procedures– Training– Tier I and II intervention systems

• E.g., K-3 Academic Support Plan– Technology support– Decision-making criteria established

• Implementation

Page 9: Problem-Solving/Response to Intervention: Challenges to Implementation

The Process of Systems Change

• Until, and unless, Consensus (understanding the need and trusting in the support) is reached no support will exist to establish the Infrastructure. Until, and unless, the Infrastructure is in place Implementation will not take place.

• A fatal flaw is to attempt Implementation without Consensus and Infrastructure

• Leadership must come both from the Principal and from the educators in the building.

Page 10: Problem-Solving/Response to Intervention: Challenges to Implementation

Contextual Issues Affecting The Problem-Solving Process in General and Special Education

• IDEA Re-Authorization– Focus on academic outcomes– General education as baseline metric– Labeling as a “last resort”– Increasing general education options– Pooling building-based resources– Flexible funding patterns– RtI Introduced as option for LD eligibility

• ESEA Legislation-No Child Left Behind• National Emphasis on Reading• Evidence-based Interventions

Page 11: Problem-Solving/Response to Intervention: Challenges to Implementation

Is It All About Reading? Maybe At First!

• 52% of IDEA $$ go to LD Programs• 70% +/- of special education “activities” (e.g., evaluations,

staffings, IEPs) related to LD cases• 94% of students in LD because of reading/language arts• 46% of IDEA $$ go to improve reading• Changes in LD Rules will affect the vast majority of special

education “activities”

Page 12: Problem-Solving/Response to Intervention: Challenges to Implementation

Why Problem-Solving ?BIG IDEAS

• AYP and Disaggregated Data (NCLB) move focus of attention to student progress, not student labels

• Building principals and superintendents want to know if students are achieving benchmarks, regardless of the students “type”

• Accurate “placements” do not guarantee that students will be exposed to interventions that maximize their rate of progress

• Effective interventions result from good problem-solving, rather than good “testing”

• Progress monitoring is done best with “authentic” assessment that is sensitive to small changes in student academic and social behavior

Page 13: Problem-Solving/Response to Intervention: Challenges to Implementation

Big Ideas (con’d)

• Interventions must be “evidence based” (IDEA/NCLB)• Response to Intervention(RtI) is the best measure of problem

“severity” • Program eligibility (initial and continued) decisions are best

made based on RtI• Staff training and support (e.g., coaching) improve intervention

skills• “Tiered” implementation improves service efficiency

Page 14: Problem-Solving/Response to Intervention: Challenges to Implementation

How Do We Know If This is a General Education Initiative?• Priority of superintendent and school board

– District Leadership Team– Strategic Plan

• Focus is on effectiveness of Tier 1 for disaggregated groups– Unit of Analysis is the BUILDING

Page 15: Problem-Solving/Response to Intervention: Challenges to Implementation

How Do We Know If This is a General Education Initiative?• Principal Led

– Regular data analysis– Data Days– Team focuses in improving impact of core

instruction

• Prevention and Early Intervention– Screening and early intervention with Kindergarten

students

Page 16: Problem-Solving/Response to Intervention: Challenges to Implementation

Components of Response to Intervention: Infrastructure

Page 17: Problem-Solving/Response to Intervention: Challenges to Implementation
Page 18: Problem-Solving/Response to Intervention: Challenges to Implementation

Steps in the Problem-Solving Process

1. PROBLEM IDENTIFICATION• Identify replacement behavior• Data- current level of performance• Data- benchmark level(s)• Data- peer performance• Data- GAP analysis

2. PROBLEM ANALYSIS• Develop hypotheses( brainstorming)• Develop predictions/assessment

3. INTERVENTION DEVELOPMENT• Develop interventions in those areas for which data are available and hypotheses verified• Proximal/Distal• Implementation support

4. Response to Intervention (RtI)• Frequently collected data• Type of Response- good, questionable, poor

Page 19: Problem-Solving/Response to Intervention: Challenges to Implementation

Problem-Solving/RtIResource Management

• Public Education Resource Deployment– Support staff cannot

resource more than 20% of the students

– Service vs Effectiveness--BIG ISSUE

1-5% 1-5%

5-10% 5-10%

80-90%80-90%

Students

Academic Behavior

Page 20: Problem-Solving/Response to Intervention: Challenges to Implementation

How Does it Fit Together?Standard Treatment Protocol

Addl.Diagnostic

Assessment

InstructionResults

Monitoring

IndividualDiagnostic

IndividualizedIntensive

weekly

All Students at a grade level

ODRsMonthly

Bx Screening

Bench-Mark

Assessment

AnnualTesting

Behavior Academics

None ContinueWithCore

Instruction

GradesClassroom

AssessmentsYearly Assessments

StandardProtocol

SmallGroupDifferen-tiatedBy Skill

2 times/month

Step 1Step 2 Step 3 Step 4

Supplemental

1-5%

5-10%

80-90%

Core

Intensive

Page 21: Problem-Solving/Response to Intervention: Challenges to Implementation

10 - 15%

Tier I Problem-Solving:Data and Skills

Needed

80 - 90%

Tier I - Assessment Discipline Data (ODR)

Benchmark AssessmentSchool Climate Surveys

Universal ScreeningFCAT

Universal ScreeningDistrict-Wide Assessments

Tier I - Core Interventions School-wide Discipline

Positive Behavior SupportsWhole-class Interventions

Core Instruction

Page 22: Problem-Solving/Response to Intervention: Challenges to Implementation
Page 23: Problem-Solving/Response to Intervention: Challenges to Implementation
Page 24: Problem-Solving/Response to Intervention: Challenges to Implementation
Page 25: Problem-Solving/Response to Intervention: Challenges to Implementation

TIER ONE DATA ANALY SIS School A (K-5) 2006-07 Student population (size) at site 608

Percent of students on free/reduced lunch 56%

Percent of students who are ELL 38%

Percent of students served in Special Education 10%

Percent of students identified as having a Specific Learning Disability 3.8%

Per pupil funding $8,100

Percentage of students per grade proficient on school screening measure

K – 88% 1 – 71% 2 – 66% 3 – 91%1 4 – 81% 5 – 85%

Reading First School N

Title I school Y 1School indicated that 3rd grade scores are high because they were the first grade to receive targeted interventions since K.

Page 26: Problem-Solving/Response to Intervention: Challenges to Implementation

TIER ONE DATA ANALY SIS

School E (Grades 6-8 middle school) 2005-06

Student population (size) at site 870

Percent of students on free/reduced lunch 50

Percent of students who are ELL 22

Percent of students served in Special Education 11

Percent of students identified as having a Specific Learning Disability 3

Per pupil funding $5,277.30

Percentage of students per grade proficient on state measure (CST English/Language Arts)2

6th 50% 7th 57% 8th 50%

Is this a Reading First School? N

Is this a Title I school? Y 2The percentage of students who were below or far below basic was 16% for 6th grade, 17% for 7th grade, and 16% for 7th grade.

Page 27: Problem-Solving/Response to Intervention: Challenges to Implementation

Tier 1 Data Example

Page 28: Problem-Solving/Response to Intervention: Challenges to Implementation

QuickTime™ and aTIFF (LZW) decompressor

are needed to see this picture.

Page 29: Problem-Solving/Response to Intervention: Challenges to Implementation

Reading Instruction - Tier I Grade Level

Anclote NWF-4

Low Risk70%

Moderate Risk21%

High Risk9%

Page 30: Problem-Solving/Response to Intervention: Challenges to Implementation

H

Page 31: Problem-Solving/Response to Intervention: Challenges to Implementation

H

Page 32: Problem-Solving/Response to Intervention: Challenges to Implementation
Page 33: Problem-Solving/Response to Intervention: Challenges to Implementation
Page 34: Problem-Solving/Response to Intervention: Challenges to Implementation
Page 35: Problem-Solving/Response to Intervention: Challenges to Implementation

www.swis.org

Page 36: Problem-Solving/Response to Intervention: Challenges to Implementation

www.swis.org

Page 37: Problem-Solving/Response to Intervention: Challenges to Implementation

80 - 90%

10 - 15%

1 - 5%

Tier II Problem-SolvingData and Skills

Needed

Tier II - Targeted InterventionsTargeted Group Interventions

Increased IntensityNarrow FocusLinked to Tier I

80 - 90%

10-15%

Tier II - AssessmentBehavioral Observations

Intervention Data Group Diagnostic

Universal ScreeningProgress Monitoring

Tier I - Core InterventionsTier I Assessment

Page 38: Problem-Solving/Response to Intervention: Challenges to Implementation

Data Infrastructure: Using Existing Data to Predict Intervention Needs

• Previous referral history predicts future referral history• How do we interpret teacher referrals?• Previous intervention history predicts future intervention history• How do we use this information to establish an infrastructure for

change?

Page 39: Problem-Solving/Response to Intervention: Challenges to Implementation

Data-Driven Infrastructure:Establishing a Building Baseline

• Code referrals (reasons) for past 2-3 years– Identifies problems teachers feel they do not have the

skills/support to handle– Referral pattern reflects skill pattern of the staff, the

resources currently in place and the “history” of what constitutes a referral in that building

– Identifies likely referral types for next 2 years– Identifies focus of Professional Development Activities AND

potential Tier II and III interventions– Present data to staff. Reinforces “Need” concept

Page 40: Problem-Solving/Response to Intervention: Challenges to Implementation

Data-Driven Infrastructure:Establishing a Building Baseline

• Assess current “Supplemental Interventions”– Identify all students receiving supplemental

interventions– For those interventions, identify

• Type and Focus (academic, direct instruction, etc)• Duration (minutes/week)• Provider

– Aggregate• Identifies instructional support types in building• This constitutes Tier II and III intervention needs

Page 41: Problem-Solving/Response to Intervention: Challenges to Implementation

Data For Each Tier - Where Do They Come From?

• Tier 1: Universal Screening, accountability assessments, grades, classroom assessments, referral patterns, discipline referrals

• Tier 2: Universal Screening - Group Level Diagnostics (maybe), systematic progress monitoring, large-scale assessment data and classroom assessment

• Tier 3: Universal Screenings, Individual Diagnostics, intensive and systematic progress monitoring, formative assessment, other informal assessments

Page 42: Problem-Solving/Response to Intervention: Challenges to Implementation

Nonsense Word Fluency

5

15

13

25

12

20

0

2

4

6

8

10

12

14

16

18

20

22

24

26

28

30

32

34

Fall Winter Spring

Letter-Sounds Per Minute

Student Benchmark Peers

Page 43: Problem-Solving/Response to Intervention: Challenges to Implementation

Referral Analysis

• 42% Noncompliance• 30% Off-Task/Inattention• 12% Physical/Verbal

Aggression• 6% Relational

Aggression• 10% Bullying

0

5

10

15

20

25

30

35

40

45

1stQtr

2ndQtr

3rdQtr

4thQtr

Noncompliance

Off Task

Aggression

RelAggressionBullying

Page 44: Problem-Solving/Response to Intervention: Challenges to Implementation

Building-Level Behavior Data

• % Building %Referred

Male 50%80%

White 72%54%

Hispanic 12% 20%

African American 15%24%

Other 1% 2%

Low SES 25% 50%

Behavior Referral Analysis

0

10

20

30

40

50

60

70

80

90

MaleFemale White

HispanicAfrican Am

OtherLow SES

Building

Referred

Page 45: Problem-Solving/Response to Intervention: Challenges to Implementation

0

10

20

30

40

50

60

70

80

90

100

Jan Feb Mar Apr May

Benchmark75%

30 %

42%

74%

58%

Baseline

(

Work

Completed

1. Problem ID: Increase % completed2. Current Level: 30%3. Peer Group: 58%3. Desired Level: 75%4. GAP 45%5. Rate/Week Improvement: 45/16= 3%

Page 46: Problem-Solving/Response to Intervention: Challenges to Implementation

0

10

20

30

40

50

60

70

80

90

100

Jan Feb Mar Apr May

Benchmark75%

30 %

42%

74%

58%

Baseline

33%

37% 37%40%

42%

Study Skills Group

49%

65%62%

67%

70%

62%

79%75%

73%

79%82%

86% 85%

90%92%

(+3%) (+4%)

(+0%) (+3%)

(+2%)

Accuracy

Page 47: Problem-Solving/Response to Intervention: Challenges to Implementation

Tier Functions/Integration

• How the Tiers work

• Time aggregation

• Tier integration

Page 48: Problem-Solving/Response to Intervention: Challenges to Implementation

How the Tiers Work

• Goal: Student is successful with Tier 1 level of support-academic or behavioral

• Greater the tier, greater support and “severity”• Increase level of support (Tier level) until you identify an intervention that

results in a positive response to intervention• Continue until student strengthens response significantly• Systematically reduce support (Lower Tier Level)• Determine the relationship between sustained growth and sustained

support.

Page 49: Problem-Solving/Response to Intervention: Challenges to Implementation

Integrating the Tiers

• Tier 1 (Core) instruction present at all three levels

• Purpose of Tier 2 is to improve success in Tier 1

• Purpose of Tier 3 is to improve success in Tier 2

• Is there a single “intervention” plan made up of different Tier services?

Page 50: Problem-Solving/Response to Intervention: Challenges to Implementation

Integrating the Tiers

• 5th grade student reading at the 2nd grade level– Tier 3

• Direct Instruction, Targeted, Narrow Focus (e.g., phonemic awareness, phonics, some fluency)

– Tier 2• Fluency, vocabulary, comprehension, pre-teach for Tier 1

– Tier 1• Focus on comprehension, participation, scripted decoding

• Use core materials for content• Progress monitor both instructional level and grade placement level skills

Page 51: Problem-Solving/Response to Intervention: Challenges to Implementation

Intervention Development

• Tiers 1 and 2

• Critical Components

• Evidence-based

Page 52: Problem-Solving/Response to Intervention: Challenges to Implementation

Intervention Development

• Criteria for “Appropriate” and “Effective” Interventions:– Evidence-based

• Type of Problem• Population• Setting• Levels of Support

• Focused on most important needs• Group interventions have priority• Interventions MUST be linked to Tier 1 focus, materials, performance criteria

Page 53: Problem-Solving/Response to Intervention: Challenges to Implementation

Interventions: Tier 1

• Group students based on skill data• Differentiate instruction based on grouping• Organize students based on skill performance

– Higher performing, more students, – Lower performing, fewer students

• Same amount of time, different use of that time• Breadth of skill focus might vary

Page 54: Problem-Solving/Response to Intervention: Challenges to Implementation

Characteristics of Tier 2 Interventions

• Available in general education settings• Opportunity to increase exposure (academic engaged time) to

curriculum• Opportunity to narrow focus of the curriculum• Sufficient time for interventions to have an effect (10-30 weeks)• Often are “standardized” supplemental curriculum protocols

Page 55: Problem-Solving/Response to Intervention: Challenges to Implementation

Interventions: Tier 2

• First resource is TIME (AET)– HOW much more time is needed?

• Second resource is curriculum– WHAT does the student need?

• Third resource is personnel– WHO or WHERE will it be provided?

Page 56: Problem-Solving/Response to Intervention: Challenges to Implementation

Tier 2: Getting TIME

• “Free” time--does not require additional personnel– Staggering instruction

– Differentiating instruction

– Cross grade instruction

– Skill-based instruction

• Standard Protocol Grouping• Reduced range of “standard” curriculum• After-School• Home-Based

Page 57: Problem-Solving/Response to Intervention: Challenges to Implementation

Tier 2: Curriculum

• Standard protocol approach• Focus on essential skills• Most likely, more EXPOSURE and more FOCUS of core

instruction• Linked directly to core instruction materials and benchmarks• Criterion for effectiveness is 70% of students receiving Tier 2

will reach benchmarks

Page 58: Problem-Solving/Response to Intervention: Challenges to Implementation

Tier 2: Personnel

• EVERYONE in the building is a potential resource• Re-conceptualize who does what• Personnel deployed AFTER needs are identified• WHERE matters less and less• REMEMBER, student performance matters more than labels, locations and

staff needs.• A school cannot deliver intensive services to more than 7% of the population

Page 59: Problem-Solving/Response to Intervention: Challenges to Implementation

Intervention Support

• Intervention plans should be developed based on student need and skills of staff

• All intervention plans should have intervention support

• Principals should ensure that intervention plans have intervention support

• Teachers should not be expected to implement plans for which there is no support

Page 60: Problem-Solving/Response to Intervention: Challenges to Implementation

Critical Components of Intervention Support

• Support for Intervention Integrity

• Documentation of Intervention Implementation

• Intervention and Eligibility decisions and outcomes cannot be supported in an RtI model without these two critical components

Page 61: Problem-Solving/Response to Intervention: Challenges to Implementation

Intervention Support

• Pre-meeting– Review data– Review steps to intervention– Determine logistics

• First 2 weeks– 2-3 meetings/week– Review data– Review steps to intervention– Revise, if necessary

Page 62: Problem-Solving/Response to Intervention: Challenges to Implementation

Intervention Support

• Second Two Weeks– Meet twice each week

• Following weeks– Meet at least weekly– Review data– Review steps– Discuss Revisions

• Approaching benchmark– Review data– Schedule for intervention fading– Review data

Page 63: Problem-Solving/Response to Intervention: Challenges to Implementation
Page 64: Problem-Solving/Response to Intervention: Challenges to Implementation

Implementation:Critical Components

Page 65: Problem-Solving/Response to Intervention: Challenges to Implementation

Response to Intervention: The “Rate” is the key

• Academic engaged time is best predictor of student performance.

• How quickly a gap can be closed is determined by the size of the gap and the time allotted to “close” it.

• Implication for high school is that very little time remains. If the gap is large, the rate required will be high.

• The goal is to minimize the gap prior to entry into high school

Page 66: Problem-Solving/Response to Intervention: Challenges to Implementation

Decision Rules: What is a “Good” Response to Intervention?

• Positive Response

– Gap is closing

– Can extrapolate point at which target student(s) will “come in range” of target--even if this is long range

• Questionable Response

– Rate at which gap is widening slows considerably, but gap is still widening

– Gap stops widening but closure does not occur

• Poor Response

– Gap continues to widen with no change in rate.

Page 67: Problem-Solving/Response to Intervention: Challenges to Implementation

Performance

Fall

Positive Response to Intervention

Expected Performance

Observed Performance

Winter Spring

Page 68: Problem-Solving/Response to Intervention: Challenges to Implementation

Performance

Time

Positive Response to Intervention

Expected Trajectory

Observed Trajectory

Page 69: Problem-Solving/Response to Intervention: Challenges to Implementation

Decision Rules: What is a “Questionable” Response to Intervention?

• Positive Response

– Gap is closing

– Can extrapolate point at which target student(s) will “come in range” of target--even if this is long range

• Questionable Response

– Rate at which gap is widening slows considerably, but gap is still widening

– Gap stops widening but closure does not occur

• Poor Response

– Gap continues to widen with no change in rate.

Page 70: Problem-Solving/Response to Intervention: Challenges to Implementation

Performance

Fall

Questionable Response to Intervention

Expected Performance

Observed Performance

Winter Spring

Page 71: Problem-Solving/Response to Intervention: Challenges to Implementation

Performance

Time

Questionable Response to Intervention

Expected Trajectory

Observed Trajectory

Page 72: Problem-Solving/Response to Intervention: Challenges to Implementation

Decision Rules: What is a “Poor” Response to Intervention?

• Positive Response

– Gap is closing

– Can extrapolate point at which target student(s) will “come in range” of target--even if this is long range

• Questionable Response

– Rate at which gap is widening slows considerably, but gap is still widening

– Gap stops widening but closure does not occur

• Poor Response

– Gap continues to widen with no change in rate.

Page 73: Problem-Solving/Response to Intervention: Challenges to Implementation

Performance

Fall

Poor Response to Intervention

Expected Performance

Observed Performance

Winter Spring

Page 74: Problem-Solving/Response to Intervention: Challenges to Implementation

Performance

Time

Poor Response to Intervention

Expected Trajectory

Observed Trajectory

Page 75: Problem-Solving/Response to Intervention: Challenges to Implementation

Performance

Time

Response to Intervention

Expected Trajectory

Observed Trajectory

Positive

Questionable

Poor

Page 76: Problem-Solving/Response to Intervention: Challenges to Implementation

DecisionsWhat to do if RtI is:

• Positive

• Continue intervention with current goal

• Continue intervention with goal increased

• Fade intervention to determine if student(s) have acquired functional independence.

Page 77: Problem-Solving/Response to Intervention: Challenges to Implementation

DecisionsWhat to do if RtI is:

• Questionable

– Was intervention implemented as intended?

• If no - employ strategies to increase implementation integrity

• If yes -

– Increase intensity of current intervention for a short period of time and assess impact. If rate improves, continue. If rate does not improve, return to problem solving.

Page 78: Problem-Solving/Response to Intervention: Challenges to Implementation

DecisionsWhat to do if RtI is:

• Poor

– Was intervention implemented as intended?

• If no - employ strategies in increase implementation integrity

• If yes -

– Is intervention aligned with the verified hypothesis? (Intervention Design)

– Are there other hypotheses to consider? (Problem Analysis)

– Was the problem identified correctly? (Problem Identification)

Page 79: Problem-Solving/Response to Intervention: Challenges to Implementation

Intervention Integrity DecisionsEvidence based intervention linked

to verified hypothesis planned

Evidence based intervention implemented

Student Outcomes (SO)

Assessed

Treatment Integrity (TI) Assessed

Data-based Decisions

Continue Intervention

Implement strategies to promote treatment integrity

Modify/change Intervention

+SO +TI

-SO +TI

-SO -TI

From Lisa Hagermoser Sanetti, 2008 NASP Convention

Page 80: Problem-Solving/Response to Intervention: Challenges to Implementation

Basic Issues in Eligibility Determination

• Student must have the CHARACTERISTICS of the disability

• Student must demonstrate a NEED for the program

» (IDEIA, 2004)

Page 81: Problem-Solving/Response to Intervention: Challenges to Implementation

Criteria for Special Education Eligibility

• Significant gap exists between student and benchmark/peer performance

• The Response to Intervention is insufficient to predict attaining benchmark

• Student is not a functionally independent learner

• Complete comprehensive evaluation– Determine presence/absence of “characteristics”– Parent permission required here

Page 82: Problem-Solving/Response to Intervention: Challenges to Implementation

IDEIA Comprehensive Evaluation

• Problem Identification– Oral Expression

– Listening Comprehension

– Written Expression

– Basic Reading Skill

– Reading Fluency Skills

– Reading Comprehension

– Mathematics Calculation

– Mathematics Problem-Solving

Page 83: Problem-Solving/Response to Intervention: Challenges to Implementation

IDEIA Comprehensive Evaluation

• Relevant behavior noted during the observation and relationship of Bx to academic functioning– Data from required

observation

Page 84: Problem-Solving/Response to Intervention: Challenges to Implementation

Behavior Observation:Questions to be Answered

• What is the student behavior during difficult academic tasks?– % On-Task Attention– Level of Productivity (e.g., work completed)– Accuracy of work Completed

• Is this pattern different from academic tasks which are not difficult for the student?

• What is the relationship between target student behavior and behavior of students who can do the task? (average student)

Page 85: Problem-Solving/Response to Intervention: Challenges to Implementation

IDEIA Comprehensive Evaluation• The child does not achieve

adequately for the child’s age or to meet state-approved grade-level standards

– GAP Analysis from Tier 1– Student/peer performance– Effective instruction

AND

Page 86: Problem-Solving/Response to Intervention: Challenges to Implementation

Data Required for Problem Identification

• Current Level of Functioning

• Benchmark/Desired Level

• Peer Performance

• GAP Analysis

Page 87: Problem-Solving/Response to Intervention: Challenges to Implementation

Example- ORF

• Current Level of Performance:– 40 WCPM

• Benchmark– 92 WCPM

• Peer Performance – 88 WCPM

• GAP Analysis: 92/40= 2+X difference SIGNIFICANT GAP

• Is instruction effective? Yes, peer performance is at benchmark.

Page 88: Problem-Solving/Response to Intervention: Challenges to Implementation

Example- Behavior

• Current Level of Performance:– Complies 35% of time

• Benchmark (set by teacher)– 75%

• Peer Performance – 40%

• GAP Analysis: 40/35= 1.1X difference NO SIGNIFICANT GAP

• Is behavior program effective? No, peers have significant gap from benchmark as well.

Page 89: Problem-Solving/Response to Intervention: Challenges to Implementation

Example: High School

• Current level of performance– Attendance- 70%– Homework completed- 20%– Class work completed- 60%– Accuracy-65%

• Peer Performance– Attendance-95%– Homework completed-86%– Classwork completed 90%– Accuracy-82%

• Benchmark- 75%

Page 90: Problem-Solving/Response to Intervention: Challenges to Implementation

Data-Based Determination of Expectations

• Data- Current Level of Performance• Data- Benchmark Level• Date- # of Weeks to Benchmark• Calculate-

– Difference between current and benchmark level– Divide by # Weeks– Result: Rate per week of growth required

• REALISTIC? Compare to Peer Group Rate

Page 91: Problem-Solving/Response to Intervention: Challenges to Implementation

Data-Based Determination of Expectations: Academic

• Benchmark Level: 90 WCPM• Current Level: 40 WCPM• Difference: 50 WCPM• Time to Benchmark: 20 Weeks• Rate of Growth Required:

– 50/20= 2.5 WCPM

• Peer Group Rate = 2.0 wcpm growth• REALISTIC? Not unless you increase AET

Page 92: Problem-Solving/Response to Intervention: Challenges to Implementation

Data-Based Determination of Expectations: High School• Benchmark Level:85% work, 95% attendance, 75% accuracy• Current Level:

– Attendance: 70% – Homework 20%– Class work 65%

• Difference:– Attendance 25%– Homework 65%– Class work 25%– Accuracy 10%

• Time to Benchmark: 10 Weeks (work), 4 weeks (attendance)• Rate of Growth Required:

– Attendance 25/4= 6%/week– Homework 65/10= 6.5%/week– Class work 25/10 = 2.5%/week– Accuracy 10%/10 = 1%/week

Page 93: Problem-Solving/Response to Intervention: Challenges to Implementation

Data-Based Determination of Expectations: Behavior

• Same as academic calculations, EXCEPT:– Benchmark is fixed so you do not have peer rate– Level of reality must await RtI to initial interventions.– Research support for rates of improvement for the type of replacement

behavior desired.– Don’t forget to consider ecological variables when using research

• Number of students in class• Level of support for intervention implementation• Frequency of progress monitoring

Page 94: Problem-Solving/Response to Intervention: Challenges to Implementation

IDEIA Comprehensive Evaluation• The child does not make sufficient

progress to meet age or to meet state-approved standards when using a process based on the child’s response to scientific, research-based intervention

– RtI Data from Tiers 2 and 3– Poor response to intervention– Lack of functional independence

OR

Page 95: Problem-Solving/Response to Intervention: Challenges to Implementation

Decision Rules: What is a “Good” Response to Intervention?

• Good Response– Gap is closing– Can extrapolate point at which target student will “come in range”

of peers--even if this is long range• Questionable Response

– Rate at which gap is widening slows considerably, but gap is still widening

– Gap stops widening but closure does not occur• Poor Response

– Gap continues to widen with no change in rate.

Page 96: Problem-Solving/Response to Intervention: Challenges to Implementation

Decision Rules: Linking RtI to Intervention Decisions

• Positive, Questionable, Poor Response• Intervention Decision Based on RtI (General Guidelines)

– Positive• Continue intervention until student reaches benchmark (at least).• Fade intervention to determine if student has acquired functional

independence.– Questionable

• Increase intensity of current intervention for a short period of time and assess impact. If rate improves, continue. If rate does not improve, return to problem solving.

– Poor• Return to problem solving for new intervention

Page 97: Problem-Solving/Response to Intervention: Challenges to Implementation

Guiding Questions:Case of “Steven”

• “Steven”– What was the RtI for Tier 2?– What was the RtI for Tier 3?– Is he a functionally independent learner?– Does he have a “need” for special education?– Are you ready to complete the comprehensive

evaluation?

Page 98: Problem-Solving/Response to Intervention: Challenges to Implementation

Steven

20 1822 21

2428

3136 35

42 4440

45

0

10

20

30

40

50

60

70

80

90

100

Sept Oct Nov Dec Jan Feb

School Weeks

Words Correct Per Min

Tier 2: Strategic -PALS

Tier 3: Intensive - 1:1 instruction, 5x/week, Problem-solving Model to Target Key Decoding Strategies, Comprehension Strategies

Aimline= 1.50 words/week

Trendline = 0.2.32 words/week

Page 99: Problem-Solving/Response to Intervention: Challenges to Implementation

Guiding Questions:Case of “Bart”

• “Bart”– What was the RtI for Tier 2?– What was the RtI for Tier 3?– Is he a functionally independent learner?– Does he have a “need” for special education?– Are you ready to complete the comprehensive

evaluation?

Page 100: Problem-Solving/Response to Intervention: Challenges to Implementation

Bart

20 1822 21

24 2225

30

2628

3028

31

0

10

20

30

40

50

60

70

80

90

100

Sept Oct Nov Dec Jan Feb

School Weeks

Words Correct Per Min

Tier 2: Strategic -PALS

Tier 3: Intensive - 1:1 instruction, 5x/week, Problem-solving Model to Target Key Decoding Strategies, Comprehension Strategies

Aimline= 1.50 words/week

Trendline = 0.95 words/week

Page 101: Problem-Solving/Response to Intervention: Challenges to Implementation

Guiding Questions:Case of Victor

– What was the RtI for Tier 2?– What was the RtI for Tier 3?– Is he a functionally independent learner?– Does he have a “need” for special education?– Are you ready to complete the comprehensive

evaluation?

Page 102: Problem-Solving/Response to Intervention: Challenges to Implementation

II

Page 103: Problem-Solving/Response to Intervention: Challenges to Implementation

IDEIA Comprehensive Evaluation• The findings are not primarily the

result of:– Sensory or Motor Disability– Mental Retardation

• Assess Adaptive Behavior First

– Emotional Disturbance• Data from observation• Observation and

performance data– Cultural Factors

• AYP Data for Race (NCLB)• Comparative AYP for

Culture (Local Norms)– Environmental or Economic

Disadvantage• AYP Data for Low SES

– Limited English Proficiency• AYP Data for LEP

Page 104: Problem-Solving/Response to Intervention: Challenges to Implementation

Rule Out: ED

• Behavior Observation– Compare behavior to peers through systematic

observation procedures– Document any “behaviors” that cluster with

particular disorders

• Behavior Rating Scales that document “emotional disorder/disturbance” (if necessary--remember these behaviors must adversely effect academic or social performance)

Page 105: Problem-Solving/Response to Intervention: Challenges to Implementation

Rule Out: Culture/Race

• Collect data on other students of same culture on target behaviors/concerns and compare with target student.

• Use NCLB data (or benchmark data) to compare performance of target student with data from those students who share demographics.

Page 106: Problem-Solving/Response to Intervention: Challenges to Implementation

Rule Out: Economic Disadvantage

• Compare performance of target student with the NCLB or district data on other students on the “free/reduced lunch program. FRLP”– If other FRLP students are performing at a significantly higher level, then

it is less likely that economic disadvantage is the primary reason.– If other FRLP students share the same performance levels, then the

team must consider core instruction issues with these students.

Page 107: Problem-Solving/Response to Intervention: Challenges to Implementation

Rule Out: English Language Learners (ELL)

• Compare performance of target student with the NCLB or district data on other ELL students.– If other ELL students are performing at a significantly higher level, then it

is less likely that economic disadvantage is the primary reason.– If other ELL students share the same performance levels, then the team

must consider core instruction issues with these students.

Page 108: Problem-Solving/Response to Intervention: Challenges to Implementation

Eligibility Summary

• Replacement behavior in one of the 8 SLD areas.• Interventions implemented with integrity and documented.• Behavior is not interfering with student performance.• A significant GAP exists between the students current level of

performance and state approved, grade-level benchmarks.

Page 109: Problem-Solving/Response to Intervention: Challenges to Implementation

Eligibility Summary

• The student has received intensive intervention services.• The student has demonstrated questionable or poor RtI OR• The student cannot sustain benchmark performance without the

intensive interventions.• Sensory/motor disability, MR, ED, Cultural factors, Economic

Disadvantage, and Language issues have been ruled out

Page 110: Problem-Solving/Response to Intervention: Challenges to Implementation

IDEA 2004 method of special education entitlement

Only purpose of assessment is to assist in intervention development

Assessment & Progress Data from Problem Solving

Educational Discrepancy Instructional Progress Need

Convergence of Data from a Variety of Sources

(Grimes & Tilly, 2003)

Response to Intervention