INFUSINGVALUE-ADDED INTO THE SLO

PROCESS

August 2015

TURN AND TALK:WHAT DO YOU KNOW ABOUT VALUE ADDED

DATA?

Page1

Beginning of Year Working collaboratively with their evaluator or a peer, educators draw upon the SLO and Outcome Summary Process Guide (see page 2) to develop a minimum of one SLO. The development of the SLO now must include the review of teacher and principal value-added, as well as graduation rates or schoolwide reading value-added (as appropriate to the role of the educator). Educators continue to document the goal within the appropriate online data management system (e.g., Teachscape or MyLearningPlan). Collaborative learning-focused conversations are required as part of the process, but flexibility exists in whom educators collaborate with in Supporting Years. However, in Summary Years, educators must conduct this process with their evaluators.

Page2

What is new or different from last year?

Page3

TEACHERS Teacher Value-Added and Schoolwide Reading: When developing SLOs, teachers must review individually, as well as with teacher teams at both the grade level and across the content area (e.g., schoolwide reading value-added), to identify trends (i.e., strengths and areas for growth) across time. These trends can inform SLOs or professional practice goals, based on areas of need. Working in teams with other teachers could inform the development of a team SLO that may align to a School Learning Objective identified by the principal. Value-added trends may also illuminate strategies that have worked well, based on areas of strength, and can support ongoing instructional efforts. Working in teams with other teachers could provide the opportunity to share best practices and successful strategies which support school improvement plans and/or goals.

LET’S WALK THROUGH THIS…

Graduation Rate: When developing SLOs, high school teachers must review graduation rate data across time to identify positive or negative trends regarding the matriculation of their school’s students. During this review, teachers should reflect on how their practice has supported the trends within the graduation rate data. Teachers should also review the data in vertical and horizontal teams to review school (and district) practices which positively and negatively impact graduation rates. This analysis can inform the development of SLOs, as well as professional practice goals, to support the improvement of graduation rates of the educator’s students. This review can also illuminate the success of various college and career ready strategies implemented by teachers and across the school to be modified or duplicated.

Educators are not required to develop a goal based on these data or to develop a goal with the intention to improve these data, unless the data indicates that is necessary.

As always, the purpose of the Educator Effectiveness System is to provide information that is meaningful and supports each individual educator’s growth in their unique roles and contexts. By reviewing multiple data points, including those listed above, the educator has access to a more comprehensive view of their practice and a greater ability to identify areas of strength and need—both of which can inform the development of goals, as well as instructional/leadership strategies which can support progress towards goals.

Note: Due to the lag in data provided by DPI to districts, as well as the date in the year in which the data is provided to the districts (i.e., the following year), educators should only use the data to review trends across time when developing an SLO. Educators should not use the data to score SLOs.

Our MISSION as educators is to improve teaching and learning.

MINDSET OF IMPROVEMENT

“You don’t have to be sick to get better!”-Michael Josephson

MINDSET OF IMPROVEMENT

Continuous Improvement is for EVERYONE

THERE ARE 2 GENERAL WAYS TO LOOK AT STUDENT ASSESSMENT DATA

14

Attainment model - a “point in time” measure of student proficiencycompares the measured proficiency rate with a

predefined proficiency goal.

Growth model – measures average gain in student scores from one year to the nextaccounts for the prior knowledge of students.

WHAT IS VALUE-ADDED?

It is a type of growth model that measures the contribution of schooling to student performance on the WKCE in reading and in mathematics

Uses statistical techniques to separate the impact of schooling from other factors that may influence growth

Focuses on how much students improve on the WKCE (or our new assessment) from one year to the next as measured in scale score points

15

More Clear Data Picture

Many data pieces give us a fuller picture…

STAR

WKCE or Badger

AIMSweb

ACT

WorkKeys

Classroom Assessments

AP

SurveysAspire

Observation Data

PALSVA Data

Why would we care about Value

Added data?

VA allows for fairer growth comparisons to be made (in contrast to pure achievement)

17

90% Proficiency

School A School B

86% Proficiency6% Free and

Reduced90% Free and Reduced

VA ALLOWS FOR FAIRER GROWTH COMPARISONS TO BE MADE (IN CONTRAST TO PURE GROWTH) We know that in Wisconsin, certain groups of

students do not grow (or achieve) at the same rate as others.

This can be due to the achievement level of a child (lowest students can grow the most)

This can also be related to demographics such as Special Ed status ELL Race/ethnicity Economically Disadvantaged etc.

Hi! I’m a 4th grade boy. I got a scale score of 2418 on

my WKCE in reading this year!

And these are all the other boys in WI who had the

exact same scale score as me.

4th grad

e

Now I’m in 5th grade and just got a scale score of 2449 on my

reading WKCE! I grew 31 points.

All of the other boys took the test again, too. Their average

scale score was 2443. Their growth was 25

points.

5th grad

e

So we would say that my

teachers in 4th grade had a higher Value

Add than would be expected.

5th grad

e

Average growth was 25

points

I grew 31 points

Outside the school’s influence

Race/Ethnicity

Gender

Section 504

Economic Status

Disability (by type)

Prior Year Score (reading and math)

English Proficiency (by category level)

Mobility

USING THE SAME PROCESS, VA CONTROLS FOR THESE FACTORS

HOW DO THEY DECIDE WHAT TO CONTROL FOR?

Check 1: Is this factor outside the school or teacher’s influence?

Check 2: Do we have reliable data?

Check 3: If not, can we pick up the effect by proxy?

Check 4: Does it increase the predictive power of the model?

CHECKING FOR UNDERSTANDING

What would you tell a 5th grade teacher who said they wanted to include the following in the Value-Added model for their results?:

A. 5th grade reading curriculumB. Their students’ attendance during 5th gradeC. Education level of the parentsD. Student motivation

Check 1: Is this factor outside the school or teacher’s influence?

Check 2: Do we have reliable data?

Check 3: If not, can we pick up the effect by proxy?

Check 4: Does it increase the predictive power of the model?

REPORTING VALUE-ADDED

In the latest generation of Value-Added reports, estimates are color coded based on statistical significance. This represents how confident we are about the effect of schools and teachers on student academic growth.

Green and Blue results are areas of relative strength.Student growth is above average.

Gray results are on track. In these areas, there was not enough data available to differentiate this result from average.

Yellow and Red results are areas of relative weakness. Student growth is below average.

Grade 4 30

3

Value-Added is displayed on a 1-5 scale for reporting purposes.

About 95% of estimates will fall between 1 and 5 on the scale.

Most results will be clustered around 3

3.0 represents meeting predicted

growth for your students.

Since predictions are based on the actual

performance of students in your state, 3.0 also

represents the state average growth for students similar to

yours.

Numbers lower than 3.0 represent growth that did not

meet prediction.

Students are still learning, but at a rate slower than

predicted.

Numbers higher than 3.0 represent growth that beat

prediction.

Students are learning at a rate

faster than predicted.

Grade 4 3.8

95% Confidence Interval

30

READING

Value-Added estimates are provided with a confidence interval.

Based on the data available for these thirty 4th Grade Reading students, we are 95% confident that the true Value-Added lies between the endpoints of this confidence interval (between 3.2 and 4.4 in this example), with the most likely estimate being 3.8.

3

CONFIDENCE INTERVALS

Grade 3 4.513

READING

Grade 4 36

Grade 5 84

4.5

4.5

3

Grade 3 1.513

Grade 4 36

Grade 5 84

1.5

1.5

3

MATH

Color coding is based on the location of the confidence interval.

The more student data available for analysis, the more confident we can be that growth trends were caused by the teacher or school (rather than random events).

LET’S LOOK AT THE REPORTS AVAILABLE IN SCHOOL ACCESS FILE EXCHANGE (SAFE)

WE BEGIN WITH SOME CAVEATS!

VA is one data source among many that provides a different perspective on student growth.

VA should never be the sole data source to identify effective/ineffective schooling!

Taking VA out of the Student Outcome score allows each educator to decide how (or if) this data informs the SLO process.

THIS NEXT SECTION IS INTENDED FOR YOU TO USE WITH YOUR OWN SCHOOL VA REPORTS. YOU MAY CHOOSE TO USE YOUR SNIPPING TOOL TO INSERT YOUR SCHOOL DATA IN THE APPROPRIATE PLACE. PRINTING COLOR COPIES OF YOUR VA REPORTS FOR STAFF MIGHT ALSO BE HELPFUL

Page 1

Introduction to VA Color Coding

Page 2

With a partner: What are some observations you can make about this data as a school?

How might teacher teams use this data?

Share your thinking

Let’s look at our VA as a school

With a partner: What does this data suggest about how we are growing students in reading and in math?

Use your snipping tool to insert a screenshot of the top

section only of your own school VA report page 2 here…it will

look something like this.

Share your thinking

Let’s look at our VA by grade

With a partner: What does this data suggest about how we are growing students across grades in our school?

Use your snipping tool to insert a screenshot of the

bottom section only of your own school VA report

page 2 here…will look something like this.

Share your thinking

Pages 3 & 4

With a partner: What are some observations you can make about this subgroup data?

What questions do you have?

Let’s look at our reading VA with

subgroups

With a partner: How effective was our school in growing different groups of students in reading?

Use your snipping tool to insert a screenshot of your

own school VA report page 3 here…it will look

something like this.

Let’s look at our math VA with subgroups

With a partner: How effective was our school in growing different groups of students in math?

Use your snipping tool to insert a

screenshot of your own school VA report

page 4 here…it will look something like

this.

Share your thinking

Page5

Introduction to VA Scatter

Plots

With a partner: How might a teacher team use this data to identify an area of focus for their SLO?

Pages 6 & 7

Grade level VA and

Achievement

Let’s look at our VA and achievement plotted together

Use your snipping tool to insert a screenshot of your own school VA/Achievement scatter plots here…they will look something like this. If these are too small to see you may need to print colored copies for pairs or groups.

With a partner: What stands out in our school data when we look at achievement and growth together?

Share your thinking

How do/don’t these reports add to our total data picture?

How might today’s learning apply to your

own SLO?