PVAAS Overview: Evaluating Growth, Projecting Performance

Pennsylvania Value-Added Assessment System (PVAAS):

PVAAS Public Site TourPVAAS Statewide Team for PDEFall 2011

1This webinar provides an overview of the PVAAS public reporting site.

(Announce date of release of public website for current year).PVAAS Webinar Fall 2011: Public Site TourSession DescriptionThis 60 minute session will provide an overview of the PVAAS public reporting site.

All data reported on the public site will be described as to the intent and meaning of the results. This includes the district and school level data, the School Search feature and the web-based scatter plots.

Materials and resources to use as tools for communication about PVAAS will be reviewed.

Opportunities for questions and discussion will be provided.This 60 minute session will provide an overview of the PVAAS public reporting site.

All data reported on the public site will be described as to the intent and meaning of the results. This includes the district and school level data, the School Search feature and the web-based scatter plots.

Materials and resources to use as tools for communication about PVAAS will be reviewed.

Opportunities for questions and discussion will be provided.

2PVAAS Webinar Fall 2011: Public Site TourAgendaAchievement and Progress DataWhats New?Available Data & FeaturesWebsite DemonstrationSuggested Resources for Communicating PVAASQuestions

Our agenda for todays session includes discussion of:Achievement and Progress DataWhats NewAvailable Data & FeaturesWebsite DemonstrationSuggested Resources for Communicating PVAASQuestions

(Poll the audience to find out if they all have background with PVAAS if they do, then consider skipping slides 4-14)3PVAAS Webinar Fall 2011: Public Site TourAchievement vs. ProgressAchievementThe final result of an academic experience

Highly correlated with demographic factors, such as socioeconomic status

Affected by factors outside the schoolProgressDependent upon what happens as a result of schooling

Not correlated with demographic factors

Is the concept underlying value-added analysis and reportingHere is a comparison of achievement and progress.

Achievement:The final result of an academic experienceHighly correlated with demographic factors, such as socioeconomic statusAffected by factors outside the school

Progress (Growth):Dependent upon what happens as a result of schoolingNot correlated with demographic factorsIs the concept underlying value-added analysis and reporting

4PVAAS Webinar Fall 2011: Public Site TourAchievement vs. ProgressAchievementMeasures students performance at a single point in time

Compares student performance to a standard

Critical to students post-secondary opportunitiesProgressMeasures students progress across time/years

Compares student performance to his/her own prior performance

Critical to ensuring students future and continued academic successAchievement:Measures students performance at a single point in timeCompares student performance to a standardCritical to students post-secondary opportunities

Progress (Growth):Measures students progress across time/yearsCompares student performance to his/her own prior performanceCritical to ensuring students future and continued academic success

5PVAAS Webinar Fall 2011: Public Site TourStair-Step Expectations Grade Three Grade Four Grade Five Grade 3 Test Grade 4 Test Grade 5 TestIn a perfect world students would start school at about the same academic level. Proficiency levels could simply be achieved by students gaining age appropriate knowledge and skills each year.

6In the perfect classroom, in the perfect school, in the perfect district - all students would come to us with the same skill levels.We would know where to begin instruction and be able to provide the same instruction for all students.This slide is used with permission from JHussey, Battelle for Kids. Copyright 2003PVAAS Webinar Fall 2011: Public Site TourDifferentiated Reality Grade Three Grade Four Grade FiveStudents begin school at different places, and they often progress at different rates. Yet all students are expected to achieve the same level of academic proficiency each year. Grade 3 Test Grade 4 Test Grade 5 Test

7We know that all students are unique.We know that students come to us as different starting points.We also have a minimum standard for all students to reach proficiency at the end of each grade as measured by state assessments in grades 3-8, and 11.This slide is used with permission from JHussey, Battelle for Kids. Copyright 2003PVAAS Webinar Fall 2011: Public Site TourThe Need for Progress Measures Grade Three Grade Four Grade FiveTo measure school effectiveness in this differentiated world, we need to pay attention not only to proficiency levels but also to how much progress students make in a given year. Grade 3 Test Grade 4 Test Grade 5 Test

8Because of these student differences, we need to pay attention not only to end of year proficiency levels, but also to how much progress students make in a given year, even if they havent reached the year-end proficiency goal. We need to be sure we are headed in the right direction.Our role in schools is to meet students where they are when they enter our schools, assess their skills and match our instruction to their instructional needs.

This slide is used with permission from JHussey, Battelle for Kids. Copyright 2003PVAAS Webinar Fall 2011: Public Site TourWhat is Value-Added?

Imagine a childs physical growth curve

Parent or doctor measures the childs height at various ages

A graph can be constructed to illustrate the height of the child as shown here

Imagine a childs physical growth curve.

Parent or doctor measures the childs height at various ages.

A graph can be constructed to illustrate the height of the child as shown here.

9PVAAS Webinar Fall 2011: Public Site TourWhat is Value-Added?

Lets apply the same process to education

This chart measures the growth, or progress, for a group of students at various grade levels

This is value-added following the growth, or progress, of students over time to estimate growth during a year of schooling.

With PVAAS, Pennsylvania educators get an indicator as to whether they are making appropriate academic progress for their students!Lets apply the same process to education.

This chart measures the growth, or progress, for a group of students at various grade levels.

This is value-added following the growth, or progress, of students over time to estimate their growth during a year of schooling.

With PVAAS, Pennsylvania educators get an indicator as to whether they are making appropriate academic progress for their students!

10PVAAS Webinar Fall 2011: Public Site TourValue-Added is

A statistical analysis used to measure a districts or schools impact on the academic progress rates of groups of students from year to year.

Conceptually, a growth measure is approximately the difference between current achievement (current results) and prior achievement (prior results) with achievement being measured by an appropriate assessment, such as the PSSA.

PVAAS is NOT a simple comparison of two scores!A statistical analysis used to measure a districts or schools impact on the academic progress rates of groups of students from year to year.

Conceptually, a growth measure is approximately the difference between current achievement (current results) and prior achievement (prior results) with achievement being measured by an appropriate assessment, such as the PSSA.

PVAAS is NOT a simple comparison of two scores!

11PVAAS Webinar Fall 2011: Public Site TourValue-Added & PVAAS

Pennsylvanias model for value-added is called PVAAS - the Pennsylvania Value-Added Assessment System.

PVAAS is based on the EVAAS Methodology the Education Value-Added Assessment System.

The EVAAS methodology has been nationally reviewed and published.

Pennsylvanias model for value-added is called PVAAS - the Pennsylvania Value-Added Assessment System.

PVAAS is based on the EVAAS Methodology the Education Value-Added Assessment System.

The EVAAS methodology has been nationally reviewed and published.

12PVAAS Webinar Fall 2011: Public Site TourBenefits of Value-AddedOffers an objective, more accurate way to measure the influence districts and schools have on students academic progress:

Administrators and Teachers can:Monitor the progress of all groups of students from low-achieving to high-achieving ensuring growth opportunities for all studentsMake more informed, data-driven decisions about where to focus resources to help students make greater progress and perform at higher levels.Align professional development efforts in the areas of greatest need.Identify best practices and implement instructional strategies and programs that best meet the needs of all students.

Offers an objective, more accurate way to measure the influence districts and schools have on students academic progress:

Administrators and Teachers can:Monitor the progress of all groups of students from low-achieving to high-achieving ensuring growth opportunities for all studentsMake more informed, data-driven decisions about where to focus resources to help students make greater progress and perform at higher levels.Align professional development efforts in the areas of greatest needIdentify best practices and implement instructional strategies and programs that best meet the needs of all students.

13PVAAS Webinar Fall 2011: Public Site TourKey Concepts in Understanding PVAAS Reporting PVAAS reporting reflects the effectiveness of your districts or schools Standards-Aligned System

PVAAS reporting reflects the district or schools system regarding curriculum, assessment, and instruction

The PVAAS reporting provided to districts and schools in Pennsylvania reflects the effectiveness of your district/schools curriculum, assessment and instruction the effectiveness of your standards-aligned system.

When the PVAAS reports are shared and/or analyzed by teachers it is important for them to know they are reports about your system and NOT about teacher effectiveness!

A different statistical methodology would be used to yield reports on teacher effectiveness from PVAAS.14PVAAS Webinar Fall 2011: Public Site TourOverview of PVAAS Public Reports & FeaturesLets start looking at the PVAAS public reporting!15PVAAS Webinar Fall 2011: Public Site TourAchievement + GrowthAchievement results (PSSA) and growth results (PVAAS) must be used together to get a complete picture of student learning. To view the achievement results for Pennsylvania's public districts/schools, go to: http://paayp.emetric.net/Achievement results (PSSA) and growth results (PVAAS) must be used together to get a complete picture of student learning. To view the achievement results for Pennsylvania's public districts/schools, go to: http://paayp.emetric.net/

16PVAAS Webinar Fall 2011: Public Site TourPVAAS Login Pagehttps://pvaas.sas.com

This is the PVAAS login page this page is where districts and schools can login to their protected website. This login page also has a link to access the public site (see red arrow).17PVAAS Webinar Fall 2011: Public Site TourPublic Home Screen

This slide displays the reports that are available on the Public reporting site. You can access any of the reports by clicking on the name of the report listed on this screen.

Not the link (highlighted with the red arrow) to a GUIDE to PVAAS Public Reporting.18PVAAS Webinar Fall 2011: Public Site TourPVAAS Public ReportsUse of Reports Tab to Select & View Reports

The reports tab is a second way to access all of the PVAAS public reports. 19PVAAS Webinar Fall 2011: Public Site TourPVAAS Public ReportsUse of Tests Tab to View Reports at Different Grade Levels for the District and School Value-Added Summaries

The tests tab is used to access reports at across different grade levels for the District and School Value-Added Summary reports. 20PVAAS Webinar Fall 2011: Public Site TourPVAAS Public ReportsValue-Added Summary ReportsDistrict/LEA and School Level data onlyMath and ReadingGrades 4-8 and 9-11Science and Writing, Grades 9-11

School Search CapabilityAllows users to find and view the progress of local schools, charter schools, and full-time CTCs across Pennsylvania.Can search for similar schools based on grade levels tested, various demographics, Intermediate Unit (IU) region and/or county.

This slide displays the reports that are currently available on the PVAAS public reporting site.

Value-Added Summary ReportsDistrict/LEA and School Level data onlyMath and Reading for Grades 4-8 and Grades 9-11Science and Writing for Grades 9-11

School Search CapabilityAllows users to find and view the progress of local schools, charter schools, and full-time CTCs across Pennsylvania.You can search for similar schools based on grade levels tested, various demographics, Intermediate Unit (IU) region and/or county.

21PVAAS Webinar Fall 2011: Public Site TourPVAAS Public Reports (continued)Web-based scatter plots Math, ReadingGrades 4-8 & Grades 9-11Science and Writing, Grades 9-1122PVAAS Webinar Fall 2011: Public Site TourReports on Public SiteThe data on the PVAAS public site come directly from the reports on the district/school password-protected site.This session will include a cross-walk between these two sites to show the source of the data on the public reporting.

The data on the PVAAS public site come directly from the reports on the district/school password protected site.We will cross walk between these two sites in this session.

This session will include a cross walk between these two sites to show the connections.

23PVAAS Webinar Fall 2011: Public Site TourPurpose of District & SchoolPVAAS Data

Provides users with information to assist them in evaluating the overall effectiveness of a district/LEA or school on the academic progress of groups of students.

This report is NOT a report on teacher effectiveness!

Provides users with information to assist them in evaluating the overall effectiveness of a district/LEA(Local education Agency) or school on the academic progress of groups of students.

This report is NOT a report on teacher effectiveness!

An additional statistical methodology would be needed to yield reports on teacher effectiveness from PVAAS. 24PVAAS Webinar Fall 2011: Public Site TourWhat is New?Since Feb 2011 Public Reporting Release:New: Web-based ScatterplotsNew: Color Scheme/LegendsNew: Addition of Science and Writing for Grades 9-11 New: Rollover Text FeatureNew: Redesigned School Search Feature

So, what is new since the original public reporting release in Feb 2011?

They new features and enhancements include:New: Web-based ScatterplotsNew: Color Scheme/LegendsNew: Addition of 9-11 Science and Writing ReportingNew: Rollover Text FeatureNew: Redesigned School Search Feature

25Web-based Scatter PlotsLets start by discussing web-based scatter plots on the PVAAS public site. Scatter plots provide a visual way for viewing achievement and growth together.

26PVAAS Webinar Fall 2011: Public Site TourAccessing Scatter PlotsThe scatter plot report can be accessed directly within the orange Reports tab

You will notice that the scatter plots is the first item listed under the reports tab.

These are a new feature for fall 2011 reporting.27PVAAS Webinar Fall 2011: Public Site TourCustomizing Scatter Plots

Users can switch subjectsUsers can also switch the the X and Y Axis The user will be able to customize their own scatter plots for districts or schools. Various options are available to the user including selections for:Can view data across grades for the following 4 Subjects Math, Reading, Science and WritingScience and writing are only available on the public site for 9-11 reporting, as grade specific reporting is not provided on the PVAAS public reporting site. Plotting growth for the current year, combined across grades.

Users can also reverse the x and y axis by using the toggle switch between the two axes.

28PVAAS Webinar Fall 2011: Public Site TourRoll-Over Feature!

The roll-over feature allows you to identify each school plotted.You can see the name of the school, district and the data for that district or school- based on your selection of the X and Y axis.29PVAAS Webinar Fall 2011: Public Site TourWebsite Demonstration

https://pvaas.sas.comWebsite demonstration of scatter plots

Be sure to showHow to change tests and subjectsHow to select districts and schoolsHow to remove AYP targetRollover feature on dotsRollover feature on name of district/school

30PVAAS Webinar Fall 2011: Public Site TourDistrict and School Value-Added ReportsNow lets look at the district and school value-added reports included on the PVAAS Public reporting site.. 31PVAAS Webinar Fall 2011: Public Site TourPVAAS Value-added Growth Descriptors

Grades 4-8 Math & ReadingGrades 9-11 Math, Reading, Science & Writing

32PVAAS District and School Value-Added reports are color-coded to provide educators with assistance in interpreting the data. While some people want to know where all of the numbers come from and how they are calculated, most people want to know what the report means and how to use it for local decision-making. This is the new legend for all PVAAS District and School Value-Added Reports on the public site.

This legend quickly allows schools and districts to determine whether all grade levels are meeting the standard for PA Academic Growth. Dark Blue indicates there is Significant evidence that the district/school exceeded the standard for PA Academic Growth

Light Blue indicates there is Moderate evidence that the district/school exceeded the standard for PA Academic Growth

Green indicates there is Evidence that the district/school met the standard for PA Academic Growth

Yellow indicates there is Moderate evidence that the district/school did not meet the standard for PA Academic Growth

Red (R) indicates there is Significant evidence that the district/school did not meet the standard for PA Academic Growth

The same legend is used for all PVAAS District and School Value Added reports on the public site. This is the quickest way to make meaning of the reporting results.PVAAS Webinar Fall 2011: Public Site TourExample of District Value-Added Summary ReportGrades 4-8, Math & Reading

This is an example of a District Value-Added Summary Report for Grades 4-8, Math & Reading

In lay terms, the Growth Measure over Grades Relative to the Growth Standard answers the question, how effective was the district/LEA this past year in impacting the academic progress of its students compared to the standard for PA Academic Growth?

The Growth Measure over Grades Relative to the Growth Standard is the average academic growth (or progress) across grades of the district/LEAs students, compared to the standard for PA Academic Growth. Specifically, the Growth Measure over Grades Relative to the Growth Standard is the average of all Growth Measures for that year across all reported grade levels (4 through 8) served by that district/LEA.

The 3-Yr-Avg Growth Measure differs from the most current years Growth Measure in that it represents the average growth (or progress) across grades for the past 3 years. Again lets consider the example of the district/LEA serving all grade levels 4 through 8. The 3-Yr-Avg Growth Measure over Grades Relative to the Growth Standard would be the average of the 3-Yr-Avg Growth Measure for 4th grade, 3-Yr-Avg Growth Measure for 5th grade, 3-Yr-Avg Growth Measure for 6th grade, 3-Yr-Avg Growth Measure for 7th grade, and the 3-Yr-Avg Growth Measure for 8th grade.

The 3-Yr-Avg Growth Measure over Grades Relative to the Growth Standard answers the question, how effective has the district/LEA been over the last 3 years in impacting the academic progress of its students compared to the standard for PA Academic Growth?Each of these values is color-coded to assist in the interpretation of the data (using the legend on the previous slide):Dark Blue, or DB, is an indication that there is significant evidence of exceeding the standard for PA Academic Growth.Light Blue, or LB, is an indication that there is moderate evidence of exceeding the standard for PA Academic Growth. Green, or G, is an indication that there is evidence of meeting the standard for PA Academic Growth. Yellow, or Y, is an indication that there is moderate evidence of not meeting the standard for PA Academic Growth. Red, or R, is an indication that there is significant evidence of not meeting the standard for PA Academic Growth. 33PVAAS Webinar Fall 2011: Public Site TourExample of School Value-Added Summary ReportGrades 4-8, Math & Reading

Here is an example School Value Added Summary Report for Grades 4-8, Math and Reading.

In lay terms, the Growth Measure over Grades Relative to the Growth Standard answers the question, how effective was the school this past year in impacting the academic progress of its students compared to the standard for PA Academic Growth? This is the same as the district report except it is a measure of the effectiveness of the school.

The Growth Measure over Grades Relative to the Growth Standard is the average academic growth (or progress) of the schools students across grades compared to the standard for PA Academic Growth. Specifically, the Growth Measure over Grades Relative to the Growth Standard is the average of all Growth Measures for that year across all reported grade levels (4 through 8) served by that school.

The 3-Yr-Avg value differs from the most current years value in that it represents the average growth (or progress) across grades for the past 3 years. Again lets consider the example of the school serving grade levels 6 through 8. The 3-Yr-Avg Growth Measure over Grades Relative to the Growth Standard would be the average of the 3-Yr-Avg Growth Measure for 6th grade, 3-Yr-Avg Growth Measure for 7th grade, and the 3-Yr-Avg Growth Measure for 8th grade.The 3-Yr-Avg Growth Measure over Grades Relative to the Growth Standard answers the question, how effective has the school been over the last 3 years in impacting the academic progress of its students compared to the standard for PA Academic Growth?As on the district report, the values are color-coded to assist in the interpretation of the data. 34PVAAS Webinar Fall 2011: Public Site TourWhere can I find this information on other reports?

Public Site: School Value-Added Summary ReportRestricted Site: School Value-Added Report

This is a crosswalk between the LEA site and the Public reporting site so you can see exactly which data on the restricted site is reported on the public site. 35PVAAS Webinar Fall 2011: Public Site Tour

Example: Growth Measure over Grades Relative to the Growth StandardGrowth Measure over Grades Relative to the Growth Standard (on the public report) is the SAME as the Growth Measure over Grades Relative to the Growth Standard on the School Value-Added Report (password-protected site)!

3.24th Grade Growth 0.05th Grade Growth 21.6 Growth Measure over Grades Relative to Growth StandardHere we show how the Growth Measure over Grades Relative to the Growth Standard is calculated.

(Review the equation)36PVAAS Webinar Fall 2011: Public Site TourWhat is the Growth Measure over Grades Relative to the State? Represents the average growth across the grade levels served between 4 and 8 compared to the average progress of all students in Pennsylvania at the same grade levels.

It is the average academic growth of the districts or schools students, compared to the academic growth of students statewide.

Answers the question, How much did the district/LEA/school impact the academic progress of its students compared to the progress of other students in Pennsylvania in those same grade levels?37PVAAS Webinar Fall 2011: Public Site Tour

Example: Growth Measure over Grades Relative to the StateGrowth Measure over Grades Relative to the State (on the public report) is the SAME as the Growth Measure over Grades Relative to the State on the School Value-Added Report (password-protected site)!

1.6Growth Measure over Grades Relative to Growth Standard for the school0.9 Growth Measure over Grades Relative to the State?Average Growth over Grades Relative to Growth Standard for the State(Review the equation)

On the next slide lets see how this is calculated.38PVAAS Webinar Fall 2011: Public Site Tour

What is Growth Measure over Grades Relative to the Growth Standard for the State?2.9Grade 4 State 3-Yr-Avg-1.4Grade 5 State3-Yr-Avg2.75 Average Growth over Grades Relative to Growth Standard for the StateThis is how the Growth across grades is calculated for the state. 39PVAAS Webinar Fall 2011: Public Site Tour

Example: Growth Measure over Grades Relative to the StateGrowth Measure over Grades Relative to the State (on the public report) is the SAME as the Growth Measure over Grades Relative to the State on the School Value-Added Report (password-protected site)!

1.6Growth Measure over Grades Relative to Growth Standard for the school0.9 Growth Measure over Grades Relative to the State.75Average Growth over Grades Relative to Growth Standard for the StateThis growth for the state is then compared to the growth of the school. The difference is 0.9.

The school grew more than the state.40PVAAS Webinar Fall 2011: Public Site TourExample of District Value-Added Summary ReportGrades 9-11, Math, Reading, Science & Writing

Now lets look at reporting for grades 9-11. This is the district report.

The Growth Measure is color-coded to assist districts/LEAS in the interpretation of the data. Dark Blue, or DB, is an indication that there is significant evidence of exceeding the standard for PA Academic Growth.

The same color code legend applies to this report. 41PVAAS Webinar Fall 2011: Public Site TourExample of School Value-Added Summary ReportGrades 9-11, Math, Reading, Science & Writing

This school level report looks the same as the district report for Grades 9-11, Math, Reading, Science & Writing42PVAAS Webinar Fall 2011: Public Site TourWhere can I find this information on other reports?

Public Site: School Value-Added Summary Report

Restricted Site: School Value-Added Report

This is a crosswalk between the restricted site and the public site -- you can see which data from the restricted site is reporting on the public site. 43PVAAS Webinar Fall 2011: Public Site TourIs it appropriate to compare the amount of progress made by a district/school to another district/school?

Without taking the Standard Error into account, it is NOT possible to directly compare growth measures across districts/schools.

The color-coding of the growth measures does in fact take into account the Standard Error. Note the link to the color code legends on each report.

The Average Growth Index found on the School Searchreport feature takes the Standard Error into account and allows a more direct comparison across schools. Without taking the Standard Error into account, it is NOT possible to directly compare these gain values across districts/schools.

The color-coding of the growth measures does in fact take into account the Standard Error. Note the link to the color code legends on each report.

The Average Growth Index found on the School Search report feature takes the Standard Error into account and allows a more direct comparison across schools.

44PVAAS Webinar Fall 2011: Public Site Tour

School Search Feature

Now lets look at the School Search feature on the public reporting site. 45PVAAS Webinar Fall 2011: Public Site TourPurpose of School Search

Users can find and view the progress of public schools across Pennsylvania and search for similar schools based on grade levels tested, various demographics, Intermediate Unit (IU) region, and/or county.

46PVAAS Webinar Fall 2011: Public Site TourWhich schools are included when I use School Search?Schools with at least one tested grade in common as the reference school you selected.Example: Your reference school is a grade 6-8 schoolOther schools included in the search may include grade 6-7 schools, grade 7-8 schools, K-6 schools, etc. unless you specific a grade range. 47PVAAS Webinar Fall 2011: Public Site TourAccessing School SearchPVAAS School Search is accessed the via links at the top of the page or using the orange Reports tab

You can access the schools search feature by clicking on search in the menu at the top of the page or under the orange Reports tab. 48PVAAS Webinar Fall 2011: Public Site TourPredictive Text to Assist in Locating SchoolsExample: the user enters the word Pink and school names containing the word Pink appear as options to select.

You can begin entering any part of the school name into the search box. The feature uses predictive text to begin listing any schools that contain the text you entered. In this example we entered Pink into the search box and all schools that include that word are listed below.49PVAAS Webinar Fall 2011: Public Site Tour

School Search Results

Once you click on the school, you will see table that includes the demographic information on file for the chosen school. 50PVAAS Webinar Fall 2011: Public Site TourSchool Search Results

When you scroll down the page, you find the school you have selected at the top of the list followed by all the schools in Pennsylvania with at least one tested grade in common with the school you chose (the reference school).

You can narrow your search by clicking on the restrict search button 51PVAAS Webinar Fall 2011: Public Site TourFinding Similar Schools

When you click on the restrict search a window will open allowing you to search by specific demographic information. Check the demographic information you want to include in your search and set the parameters for the search in the boxes on the right.

For example, we want to search for schools that have a % of Tested Economically Disadvantaged students between 70% and 100%

And a % of Tested Minority students between 70% and 100%. After making your selection, click submit.

You can also specific a grade range for schools.

There is also a pull down option to narrow your search to schools within an IU or county region.52PVAAS Webinar Fall 2011: Public Site Tour

Comparison SchoolsUnder the Title Comparison Schools you will see the parameters you included in your restricted search. Your new search is listed below.53PVAAS Webinar Fall 2011: Public Site TourWebsite Demonstration

https://pvaas.sas.comWebsite demonstration of school search

School SearchHow to conduct searchHow to sort AGI in results listRolloversHow to restrict search

54PVAAS Webinar Fall 2011: Public Site TourHow are schools compared?PVAAS: Average Growth IndexWhat is an Index?A numerical scale used to compare variables with one another or with some reference number Analogy: Consumer Price IndexA measure of the average change over a period of timeStatistical IndicatorReflects patternsThe PVAAS Average Growth Index allows viewers to compare growth across schools.

How are schools compared?

PVAAS: Average Growth IndexWhat is an Index?A numerical scale used to compare variables with one another or with some reference number Analogy: Consumer Price IndexA measure of the average change over a period of timeStatistical IndicatorReflects patternsThe PVAAS Average Growth Index allows viewers to compare growth across schools.

55PVAAS Webinar Fall 2011: Public Site TourWhat is the Average Growth Index? A measure of student progress across the tested grade levels in a school.

This index is a value based on the average growth across grade levels and its relationship to the standard error so that comparison among schools is meaningful. If the standard error is not accounted for, users might get a skewed picture of the relative effectiveness of different schools.

For grades 4 through 8, the Average Growth Index is calculated by dividing the Growth Measure over Grades Relative to the Growth Standard by the corresponding Standard Error.

For grades 9 through 11, the Average Growth Index is calculated by dividing the Growth Measure by the corresponding Standard Error.56 A measure of student progress across the tested grade levels in a school.

This index is a value based on the average growth across grade levels and its relationship to the standard error so that comparison among schools is meaningful. If the standard error is not accounted for, users might get a skewed picture of the relative effectiveness of different schools.

For grades 4 through 8, the Average Growth Index is calculated by dividing the Growth Measure over Grades Relative to the Growth Standard by the corresponding Standard Error.

For grades 9 through 11, the Average Growth Index is calculated by dividing the Growth Measure by the corresponding Standard Error.PVAAS Webinar Fall 2011: Public Site TourExample: Average Growth Index, Grades 4-8

Average Growth Index= Growth Measure over Grades Relative to the Growth Standard divided by the Standard Error

This is where the Average Growth Index is reported on the public site on the School Search feature. This screen shot is the result of a school search. 57PVAAS Webinar Fall 2011: Public Site TourWhat does the Average Growth Index mean?Average Growth Index (AGI) = 0: The average achieving student in this school met the standard for PA Academic Growth.

Average Growth Index (AGI) > 0: The average achieving student in this school exceeded the standard for PA Academic Growth. A larger AGI provides more evidence that the average achieving student in this school exceeded the standard for PA Academic Growth.

Average Growth Index (AGI) < 0: The average achieving student in this school did not meet the standard for PA Academic Growth. A smaller AGI provides more evidence that the average achieving student in this school did not meet the standard for PA Academic Growth.58What does the AGI mean? How do I interpret it?

Average Growth Index (AGI) = 0 : The average achieving student in this school met the standard for PA Academic Growth.

Average Growth Index (AGI) > 0 : The average achieving student in this school exceeded the standard for PA Academic Growth. A larger AGI provides more evidence that the average achieving student in this school exceeded the standard for PA Academic Growth.

Average Growth Index (AGI) < 0 : The average achieving student in this school did not meet the standard for PA Academic Growth. A smaller AGI provides more evidence that the average achieving student in this school did not meet the standard for PA Academic Growth.

PVAAS Webinar Fall 2011: Public Site TourWhy can I not find a district/school on the PVAAS public site?Reporting was suppressed for the following schools:Districts/schools with less than 10 studentsPA public reporting requirementsDistricts/schools serving one grade levelAct 104 legislative intent was district and building level dataExample: Grade 11 only schoolExample: Grade 11-12 schoolsExample: Grade 6 only schoolReporting was suppressed for the following schools:Districts/schools with less than 10 studentsPA public reporting requirementsDistricts/schools serving one grade levelAct 104 legislative intent was district and building level dataExample: Grade 11 only schoolExample: Grade 11-12 schoolsExample: Grade 6 only school

59PVAAS Webinar Fall 2011: Public Site TourSuggested Resources for Communicating PVAASLastly, we want to let you know about the resources available for you to use regarding PVAAS. 60PVAAS Webinar Fall 2011: Public Site TourPVAAS Help Menus onPublic Reporting

Each report on the Public reporting site has a Help Menu specific to that report- you can also print these out while looking at any of the PVAAS public reports. 61PVAAS Webinar Fall 2011: Public Site TourPDE PVAAS Webpage

Help Menus PowerPoint Presentationswith Trainer Notes

Resource Materials

Video Clips

District Case Studies

The PDE PVAAS webpage houses all PVAAS support materials such as those listed.

To access the PDE PVAAS Webpage, click on the following selections in the blue area on the left-hand side of the screen.ProgramsPrograms O-RPA Value-Added Assessment System (PVAAS)

62PVAAS Webinar Fall 2011: Public Site TourSuggested ResourcesGuide for PVAAS Public Reporting 2011Differences between Achievement and ProgressConcept of Value-AddedBenefits of Value-AddedDescription of Reporting Frequently Asked QuestionsGlossary of Key Terms & Acronyms

Available on the PVAAS login page!As indicated earlier in the session there is a link to a Guide to Public Reporting.

The guide for PVAAS Public Reporting 2011 includes:Differences between Achievement and ProgressConcept of Value-AddedBenefits of Value-AddedDescription of Reporting Frequently Asked QuestionsGlossary of Key Terms & Acronyms

63PVAAS Webinar Fall 2011: Public Site Tour24/7 Suggested ResourcesArchived webinars and PowerPoint presentations detailing the public reporting site

One-page handout titled What is PVAAS?

PVAAS Podcasts, FREE on iTunesUIntroduction to PVAASValue-Added ReportingSchool Search

There are several resources for you to Listen and view PVAAS professional development!

Archived webinars and PowerPoint presentations detailing the public reporting site are available.

As well as FREE Podcasts on iTunes U!

With topics such as:Introduction to PVAASValue-Added ReportingSchool Search

64PVAAS Webinar Fall 2011: Public Site TourWhy PVAAS?Provides users with information to assist them in evaluating the overall effectiveness of a public district or public school on the academic progress of groups of students.

In summary- why PVAAS?

PVAAS provides users with information to assist them in evaluating the overall effectiveness of a public district or public school on the academic progress of groups of students.

65PVAAS Webinar Fall 2011: Public Site TourQuestions?

Comments?Please let us know if you have any questions or comments. 66PVAAS Webinar Fall 2011: Public Site TourQuestions:

PVAAS Materials or Statewide Implementation

pdepvaas@iu13.org

717-606-1911

PVAAS Report Web Site

https://pvaas.sas.com67Questions related to the statewide implementation of PVAAS or PVAAS materials can be directed to pdepvaas@iu13.org or 717-606-1911.

PVAAS Webinar Fall 2011: Public Site Tour

www.pde.state.pa.us333 Market Street Harrisburg, PA 17126

68PVAAS is provided by the Department of Education as a data tool for continuous school improvement.

PVAAS Webinar Fall 2011: Public Site Tour