PVAAS School Consultation Guide Fall 2010 Session B: School Level – All Data Tools

PVAAS School Consultation Guide

Fall 2010Session B:

School Level – All Data Tools

PVAAS Statewide Core [email protected]

mailto:[email protected]

PVAAS 2010 Consultation Guide - Session B

Agenda• Purpose of the Consultation• The Power of Two• The Guidebook• PA AYP Data Table Report• PSSA Data Interactive Reports – Getting Results

Data Packet• PVAAS Reports• Student Search and Projection Reports• Next Steps • Future Considerations• Questions9/15/2010


Purpose of Consultation

• Focus: Multiple Source Data Reports for Math and Reading in grades 4 through 8 including PAAYP, eMetric, and PVAAS.

• Intended to facilitate the inspection, analysis and interpretation of your 2010 data.

• To inform your investigation into root causes and assist in developing action plans to increase student achievement.

Consultation Guide Pg. 1

9/15/2010

The Power of Two!

Considering Achievement and Growth TOGETHER!


The Scatter Plot Coordinate System

Achievement and Growth - 4th Math

0

56

-20 0 20

PVAAS Growth Measure

% P

rofic

ient

or A

dvan

ced

Vertical AxisPSSA Percent Proficient or Advanced

Horizontal AxisPVAAS Growth

Measure

AYP Percent Proficient Target

Growth StandardBoundary

9/15/2010


Scatter Plot Quadrants and Their Meanings

Achievement and Growth - 4th Math

0

56

-20 0 20

PVAAS Growth Measure

% P

rofic

ient

or A

dvan

ced

Quad 1Adequate Achievement

Positive Growth

Quad 4Below Adequate

Achievement Positive Growth

Quad 2Adequate Achievement

Negative Growth

Quad 3Below Adequate

AchievementNegative Growth

9/15/2010


Statewide to IU Region to DistrictGrade 4 Math

Statewide Grade 4 Math

IU XX Grade 4 Math

9/15/2010

Let’s Look At Your Scatterplots!


Instructions – See Guide Book• Session focuses on Math and Reading, Grades 4

through 8. Options:– Divide the team with half focusing on math, half

focusing on reading– Choose to focus on one subject during the session and

complete other subjects at a later time.• About your inspection, analysis and interpretation

of YOUR data!• Purpose is to use the data to explore root causes

and move to action planning to enhance student achievement.

9/15/2010


PA AYP Reporthttp://paayp.emetric.net/

9/15/2010


Report # 1 – PAAYP Data Table

Guiding Statement: At least (63% Reading, 56% Math) of the students in the school were Advanced or Proficient in the targeted subject area. The school met the AYP target for participation in the targeted subject area for all relevant student groups.

Investigate your PAAYP Data Table and answer the questions in your guidebook.

C.G. Pg. 2

9/15/2010


Getting Results Data PacketPSSA Data Interactive – eMetric

https://solutions1.emetric.net/pssa/

9/15/2010


Report # 2 – Getting Results Data Packet

Guiding Statement: Each grade level, as well as each subgroup at each grade level, in the school met or exceeded the NCLB READING/MATH target (63% Reading, 56% Math) of Proficient or Advanced.

Investigate your Most Recent PSSA Results Report for each grade level and subgroup and answer the questions in the guidebook.

C.G. Pg. 3

9/15/2010



Guiding Statement: Every grade level trend for the past 3 years for all students and all subgroups reflects an increase each year in the percent of students Proficient or Advanced in the targeted subject area.

Investigate your Multi-year Report for each grade level and subgroup and answer the questions in your guidebook.

C.G. Pg. 4

9/15/2010



Guiding Statement:All students and all measurable subgroups are indicating consistently good performance (at least 60% correct) in each of the reporting categories in the targeted subject area.

Investigate your Reporting Categories Report at each grade level and subgroup and answer the questions in your guidebook.

C.G. Pg. 5

9/15/2010


Report # 5 – Matched Comparison

Guiding Statement: All grade levels moved more students to higher PSSA performance levels in the targeted subject area this past year.

Investigate your Matched Comparison Report and answer the questions in your guidebook.

C.G. Pg. 6

9/15/2010


PVAAS Reportshttps://pvaas.sas.com

C.G. Pg. 6

9/15/2010


TWO Types of PVAAS Information

Today

Looking Back/Evaluation…Value-added Growth Reports For

Cohorts of Students

Looking Forward/Planning…

PVAAS Projection Reports For Individual Students

and Cohorts of Students

PVAAS does NOT calculate growth of an individual student.

C.G. Pg. 6

9/15/2010


Legend for Growth MethodologyThe PA Growth Standard specifies the minimal

acceptable academic gain from grade to grade for a cohort of students. The Growth Standard is met when the students in a school or district on average maintain their relative position when compared to the 2006 statewide distribution of student scores (2006 is the base year).

Estimated mean NCE gain equal or greater than zero. There is evidence that the school has met or exceeded the Growth Standard. All schools can achieve this rating. Estimated mean NCE gain less than zero by one standard error or less. There is slight evidence that the school has not met the Growth Standard. Estimated mean NCE gain less than zero by between one and two standard errors. There is moderate evidence that the school has not met the Growth Standard. Estimated mean NCE gain more than two standard errors less than zero. There is significant evidence that the school has not met the Growth Standard.

9/15/2010


Report # 6 – School Value-added

Guiding Statement: All grades in your school met or exceeded the Growth Standard in Reading/Math.

Investigate your School Value-added Report and answer the questions in your guidebook.

C.G. Pg. 7

9/15/2010


Report # 7 – Performance Diagnostic

Guiding Statement: Every predicted PSSA performance category met or exceeded the Growth Standard in Reading/Math.

Investigate your Performance Diagnostic Reports for each grade level. Complete the table and answer the questions in your guidebook. There are multiple reports available depending on the grade levels tested in your school.

C.G. Pg. 8

9/15/2010


Interpretation of the Performance Diagnostic

Report

9/15/2010

+

─

0


Patterns of Growth

B

C

A

9/15/2010


Report # 7 – Performance Diagnostic

Guiding Statement: Every predicted PSSA performance category met or exceeded the Growth Standard in Reading/Math.

Investigate your Performance Diagnostic Reports for each grade level. Complete the table and answer the questions in your guidebook. There are multiple reports available depending on the grade levels tested in your school.

C.G. Pg. 8

9/15/2010


Report # 8 – Performance Diagnostic - Subgroups

Guiding Statement:

Every predicted PSSA performance category for this subgroup met or exceeded the Growth Standard in Reading/Math.

Investigate your Performance Diagnostic Reports by subgroup for each grade level. Complete the table and answer the questions in your guidebook. There are multiple reports available depending on the grade levels tested in your school and the appropriate subgroups based on your student population.

C.G. Pg. 9-11

9/15/2010


TWO Types of PVAAS Information

Today

Looking Back/Evaluation…Value-added Growth Reports For

Cohorts of Students

Looking Forward/Planning…

PVAAS Projection Reports For Individual Students

and Cohorts of Students

PVAAS does NOT calculate growth of an individual student.9/15/2010


Report # 9 – School (Single Grade) Projection Summary Report

Guiding Statement:

Each tested grade has at least (SY10-11 AYP targets: 72% Reading, 67% Math) of its students in the 70% -100% probability range of reaching proficiency in the targeted subject area at the next tested grade level.

Investigate your Single Grade Projection Summary Reports for each grade level tested and answer the questions in your guidebook. There are multiple reports available depending on the grade levels tested in your school.

C.G. Pg. 12

9/15/2010


Report # 10 – School (Single Grade) Projection Summary Report - Subgroups

Guiding Statement:

Each tested grade has at least (SY10-11 AYP targets: 72% Reading, 67% Math) of its students in the 70% -100% probability range of reaching proficiency in the targeted subject area at the next tested grade level. Investigate your Single Grade Projection Summary Reports for

each grade level tested and answer the questions in your guidebook. There are multiple reports available depending on the grade levels tested in your school.

C.G. Pg. 13-15

9/15/2010


See Data Tool Reference GuideExamples &

Non-Examples of Effective Use

of PVAAS Student

Projection Reports!

9/15/2010


Report # 10 – Projection Summary(Single Grade) - Subgroups

Guiding Statement:

Each tested grade has at least (72% Reading, 67% Math) of the students in this subgroup in the 70% -100% probability range of reaching proficiency in the targeted subject area at the next tested grade level.

Investigate your Single Grade Projection Summary Reports by subgroup for each grade level and answer the questions in your guidebook. There are multiple reports available depending on the grade levels tested in your school and the appropriate subgroups based on your student population.

C.G. Pg. 13-15

9/15/2010


How do I know that the projections

are accurate?• The projection is precise, and is created using a model that

has been reviewed and approved by four different peer review panels and the GAO (US Government Accountability Office).

• The most recent 2008 growth model proposal to USDOE includes information regarding the statistical model and projection reliability study.(

http://www.ed.gov/admins/lead/account/growthmodel/pa/index.html)

• Recent studies have confirmed that the PVAAS projections (even as far as 3 years into the future) are more reliable at looking at the future performance of a student than the most recent PSSA score.

9/15/2010

http://www.ed.gov/admins/lead/account/growthmodel/pa/index.html

http://www.ed.gov/admins/lead/account/growthmodel/pa/index.html


Student Search CapabilitiesThe Student Search capability allows you to search and investigate the probabilities of students reaching selected PSSA performance level ranges on future PSSA examinations.

This feature also allows you to narrow or expand your search based on various student demographic criteria of interest.

C.G. Pg. 16

For accounts with student

access!9/15/2010


Student Search Report

We recommend that you experiment with the different search options to focus on groups of students that are of interest to you. You may wish to reflect back on the reports and questions already addressed in this session to guide your search on groups of students you wish to investigate and discuss.

C.G. Pg. 17

9/15/2010


Next StepsDiscuss with your team the next steps in using these data to enhance educational programming for your students. Use the table in the guidebook to document your ideas for further actions.Actions: Involving Who? Other Data to Consider? TimelineExamples: Share results with

staffo Plan for sharing

Reconvene this team and go deeper

Discuss our results with SIP team

John/Sallyo Full team

Full team

Fred /Spot

• eMetric

• eMetric, 4sight • local assessment

1 montho Next Tuesday at

2PM Next Friday at midnight Next SIP team meeting

C.G. Pg. 18

9/15/2010


Considerations for the Future

• Discuss with your team what types of support you might find useful from your IU PVAAS contact(s), as well as any other resources or materials needed from the PDE PVAAS Statewide Team.

• When you are ready to discuss PVAAS with your faculty, you might want to consult the Faculty Roll-out Guide in the Data Tool Reference Guide.

• Detach and return page 19 of the Consultation Guide to your session facilitator.

C.G. Pg. 19

9/15/2010


See Data Tool Reference GuideDistrict and

building level faculty

roll-out guides!

9/15/2010


Questions:

PVAAS Materials or Statewide Implementation

[email protected]

717-606-1911

PVAAS Report Web Sitehttps://pvaas.sas.com

9/15/2010


Thomas Gluck

Acting Secretary of Education Commonwealth of Pennsylvania

www.pde.state.pa.us

333 Market Street Harrisburg, PA 17126

9/15/2010

PVAAS School Consultation Guide Fall 2010 Session B: School Level – All Data Tools

Documents

Transcript of PVAAS School Consultation Guide Fall 2010 Session B: School Level – All Data Tools