PVAAS Train-the-Trainer

Jennifer Ross, PVAAS Statewide Core Team for PDECristine Wagner-Deitch, IU27 Director of CurriculumCindy Goldsworthy, Consultant with PVAAS Statewide Core Team

July 24, 2013PVAAS Train-the-TrainerTodays AgendaWelcome & PurposeOverview of New Reporting in 2013Self-Guided Professional Development: Activity & DiscussionIn-Depth Questions and Concepts: Activity & DiscussionTips & Checklist for Training Staff on PVAASUpdate on Professional Development for Teacher Reporting in SY2013-14Wrap-Up & Next Steps

Purpose of Todays SessionTo deepen your understanding of key PVAAS conceptsTo improve your skills in explaining key PVAAS conceptsTo develop your ability to answer questionsTo gain knowledge of available resources for obtaining information and answers unknown to youTo provide resources and support for participants to deliver professional development within their LEA

It is NOT a PVAAS Overview session!It is NOT a training on new reporting!It is NOT a training on teacher-specific reporting!Release Date: SY12-13 Reporting

September 17, 2013

New Reporting in 2013

NEW PVAAS Launchpad!See multiple SCHOOL reports in a consolidated format

Provides a user-friendly visual representation of school level data The PVAAS Launchpad is an exciting new feature to PVAAS Reporting. Some of you may recall last years Fall sessions where we walked you through the creation of consolidated reports via an Excel template. This year, SAS has developed for us the PVAAS Launchpad, which does the work for us!- Allows the user to see multiple SCHOOL reports in a consolidated format- Provides a user-friendly visual representation of school level data

6

16 Reports7

Go to actual site dont use screen shots Illustrate the following features while demonstrating on live site:Can view by grade or by subjectCan highlight specific slice of pieCan view value added separate from performance diagnosticCan also view both togetherCan collapse rows to see specific subjects

8

Same data in a graph or tableKristen, did not know if youd want a shot will side by side to talk about how they display the same data in different visual formats.10

NEW PVAAS Launchpad!Does not include:looking ahead data i.e. projectionssubgroup informationDoes not preclude the user from going to actual reports to see student names or dig more deeply!Does not include:- looking ahead side i.e., projections- subgroup informationDoes not preclude the user from going to actual reports to see student names or dig more deeply!

While the Launchpad doesnt replace each and every PVAAS report, it does provide a consolidation of at least 6 reports and makes it easier for users to identify patterns and trends.11

NEW PVAAS Launchpad!Released with SY11-12 PVAAS data on the night of August 8thReleased again with SY12-13 PVAAS reporting in fall 2013Join a live WebEx sessionAugust 1st, 9:30am-10:30amAugust 5th, 2:30pm-3:30pmDoes not include:- looking ahead side i.e., projections- subgroup informationDoes not preclude the user from going to actual reports to see student names or dig more deeply!

While the Launchpad doesnt replace each and every PVAAS report, it does provide a consolidation of at least 6 reports and makes it easier for users to identify patterns and trends.12Keystone Reporting: Value-Added

Keystone Reporting: Diagnostic

Keystone Reporting: Projection Summary

Keystone Reporting: Student Projections

Current Year Growth Reporting OnlyPAs state assessment system transitioning to include Keystone end-of-course exams and statewide assessments aligned to PA Common CoreStarting with fall 2013 reporting and continuing with fall 2014 and fall 2015 reporting, base year will be reset each year.Growth from previous years NOT reported in fall 2013 reporting. Also, NO 3-year average will be reported.Anticipating that Growth from previous years will be reported starting with fall 2014 reporting.Resource: FAQs PVAAS and the Transition of PAs Assessment System handoutCurrent Year Growth Reporting Only

Self-Guided Professional DevelopmentActivity and DiscussionEssential UnderstandingConcept of GrowthHigh Achievement & GrowthGrowth and Student DemographicsInterpreting and Using ScatterplotsInterpreting and Using Value-Added ReportsInterpreting and Using Performance Diagnostic ReportsInterpreting and Using ProjectionsAvailable ResourcesPVAAS Login Pagehttps://pvaas.sas.com/Links for recent and updated materialsUpdated professional development scheduleHelp MenusAvailable online within PVAAS web-based systemAvailable on PDE PVAAS website as PDF documentsVirtual Learning ModulesPDE PVAAS Websitewww.education.state.pa.us/pvaasLinks to archived webinarsPPTs with trainer notesActivityWork individually or in pairs Multiple choice questions in PPT formatBlank answer sheet with notes sectionAnswer questions, using resources or small group discussion as neededFor each question, ask yourself How would you describe why the selected answer is correct and other answers are incorrect?DiscussionSelf-check your answers with answer keyPick top 3 questions you would like to reviewPlace your sticker on newsprint beside your top 3 questionsLarge group discussionHow would you describe why the selected answer is correct and other answers are incorrect?In-Depth Questions and ConceptsActivity and Discussion

Activity & DiscussionWork in pairsConsider the question we pose to youPractice answering the questionDiscuss and clarify as large groupDo you have further questions about this issue/concept?What are some of the key differences betweenachievement and growth?How would you describe the Concept of Growth?My students are really high achieving. How is it possible for them to show growth?Is it easier to show growth for low-achieving groups of students (i.e., are performing at the Basic and Below Basic levels)?How are student demographics accounted for in PVAAS?Why do we have two different ways of measuring growth in PVAAS? What are those two ways?What does the Growth Measure number mean on a Value-Added Report? For grades 4-8, Reading and Math? For Science, Writing, and Keystone content areas?Why do we not have a measure of growth for individual students?Why do we not have a measure of growth in grade 3?Why do we use NCEs when measuring growth in Reading and Math for grades 4-8?How are students placed into the four groups on a Performance Diagnostic Report?Why is there no bar or whisker on some of the Performance Diagnostic Reports?Why are some of the whiskers bigger or longer than the others on the Performance Diagnostic Reports?How reliable are the student projections?What data are used in student projections?Underlying BeliefsAs you answer questions from staff, ask yourself What is this person REALLY asking?LISTEN for the real underlying question

Concerns expressed about state assessmentsConcerns expressed about accountabilityConcerns expressed about specific groups of studentsConcerns expressed about non-tested grades, subjects, or courses

TAKE TIME TO RESPOND!Implications of Not Responding to MisunderstandingsNo response IS a response to the group as a wholeNo response means each person in the larger group thinks that misunderstanding may be trueIf not 100% sure of the appropriate and accurate response, indicate that you will get clarification on the answer and get the information to themIt is better to get back to themthan to give them a wrong answer!

Tips & Checklist for Training Staff on PVAASResource: Quick Reference Guide for LEA/District-wide Roll-out of PVAASPVAAS AccountsDoes each staff member have their OWN unique username and password for PVAAS?There can no longer be sharing of accounts!Type of accessAdmin or User?Access to district level data?Access to school level data? Which schools?Access to student level data?Stay tuned for information on SY13-14 PIMS manual for batch PVAAS account creationResource: Creating User Accounts handout

Key Concepts & Reports to CoverConcept of GrowthHigh Achievement & GrowthGrowth and Student DemographicsScatterplotsNew! LaunchpadValue-Added Reports: Reading and Math, grades 4-8Value-Added Reports: Science, Writing, and Keystone content areasPerformance Diagnostic ReportsProjection SummariesStudent ProjectionsStudent SearchDecisions to Make Prior to TrainingWhat will be the main goal or focus of the session?Who will serve as facilitators?Will you train everyone together at one time? Or, school administrators and lead teachers first?Will you have separate sessions for elementary, middle, and high school staff?Will you have separate sessions for those teaching and supporting Reading and Math versus Science, Writing, and Keystone content areas?Tips When TrainingHave participants practice on the PVAAS demo site first BEFORE they look at their own district, school, and student reportsConsider a series of smaller sessions that focus on 2-3 key concepts or reports rather than one large informational session that tries to cover everythingProvide homework assignments that allow staff to practice what theyve learned and make use of the data for a purposeUse Digging Deeper questions so staff can see connection of using PVAAS with other data for a purpose!Resource: Digging Deeper handoutProfessional Development for Teacher ReportingSY2013-14Resources for Teacher ReportingFound on PVAAS Login Page (https://pvaas.sas.com/)PVAAS Pilot: FAQsA History of Value-Added Assessment and its Research-Based Implications for Policy and Practice on Teaching Effectiveness

PVAAS PILOT LEA Trainings

Coming Soon!

Series of trainings

Pilot LEAs ONLYWill be emailed to PILOT LEA Participants ONLYStaggered Release of PILOT Teacher ReportingNovember 11: PILOT LEA District and School Admin receive access to PVAAS teacher specific reportingDec 2: LEA PILOT Teachers receive access to PVAAS teacher specific reporting

Rationale for staggered release: Feedback from LEA Superintendents to give PILOT LEA administrators an opportunity to review reports and participate in webinars - to prepare for questions from teachers

PILOT LEA District and School AdministratorsSeries of webinars

Introduce District and School Teacher Level Summary Report

Introduce PVAAS Teacher Reports

PVAAS PILOT LEA TrainingsLIVE on-site training at each IU

ONLY for teachers and admin that participated in the PVAAS Roster Verification Pilot in Spring 2013

Half-day, in-person trainings to be held at each Intermediate Unit in December and January for PILOT Administrators and Teachers ONLY!IU27: January 27, 8:30am-11:30amIU27: January 27, 12:30pm-3:30pm

Review of the concept of growth and introduce the PVAAS Teacher Reports

Focus is to address key understandings and use of PVAAS teacher specific reporting

LEA Guide to SY13-14 Implementation of PVAAS Teacher Specific ReportingAnticipate release August 1

Dissemination by IUs to all LEAs

Will be emailed to all PVAAS account holders and posted on PVAAS login page

Wrap-Up and Next StepsWhat questions have we not answered for you?What additional support do you foresee needing?

Follow-up session proposed for September 30, 9am-12pmPractice training staff before follow-up sessionCome back with your questions and concepts in which you need further clarificationVirtual or Face-to-Face?

Please be sure to complete the evaluation form!