Virginia’s

Alternative

Assessments

Presented by:

Judy Honaker

7-18-2007

Alternative Assessments NCLB states that “an alternate assessment is an

assessment designed for the small number of students with disabilities who are unable to participate in the regular State assessment, even with appropriate accommodations.”

Further, that “alternate assessments may be needed for students who have a broad variety of disabling conditions; consequently, a State may employ more than one alternate assessment. An alternate assessment may be scored against grade level standards…”

3 Types of Alternative Assessments

VAAP (students well below grade level)VGLA (students in grades 3-8-- who do

not have to earn verified credits by passing SOL tests)

VSEP (students who are enrolled in grade level classes that require an End Of Course Standard of Learning test to earn a verified credit)

Virginia's Alternate Assessment for Students NOT ON GRADE LEVEL

Only students with disabilities who have an IEP and who are not participating in any Standards of Learning assessments at their grade level (3, 5 and 8) may be considered for participation in the Virginia Alternate Assessment Program. (VAAP)

The student must demonstrate impairments that prevent the completion of curriculum based on the Standards of Learning even with program and assessment accommodations.

Also, the student's present level of performance must indicate a need for extensive, direct instruction and/or intervention in a life skills curriculum.

Finally, the student must require intensive, frequent, and individualized instruction in a variety of settings to show progress and acquire, maintain, or generalize life and/or functional academic skills.

Virginia Grade Level Alternative (VGLA) and Virginia Substitute Evaluation Program

(VSEP)

Both the VGLA and VSEP are grade level alternative assessment options allowing a student to demonstrate individual achievement and proficiency on Virginia’s SOLs through a collection of student evidence.

The VGLA is available at grades 3 – 8 in all content areas.

The VSEP is available for ALL End-of-Course tests at the high school level and/or the Modified Standard Diploma requirements for math and/or reading.

Identify Tests VGLA and VSEP

The content areas tested are dependent on the student’s grade and the local school division’s policies regarding testing of the general student population.

• VGLA and VSEP content areas mirror those of the division:Grades 3, = Reading, Mathematics, Science,

History/Social ScienceGrades 5, 8 = Reading, Mathematics, ScienceGrades 4, 6, and 7 = Reading and MathematicsContent Specific HistoryGrade 11 = Reading, Mathematics, Science, and

History

Identify Tests (cont’d)

History = VGLA and VSEP administered at the corresponding grade levels as history is assessed division-wide.

e.g., Virginia Studies SOL test administered division-wide at grade 4, then grade 4 VGLA students would submit a History entry at grade 4.

Identify Tests (cont’d)

Procedures: VGLA and VSEP

A student’s IEP team/504 committee examines the participation criteria established for the VGLA OR VSEP and finds that a student meets the criteria for participation.

The student’s properly composed IEP team/504 committee makes the determination of which assessment program/accommodation(s) are appropriate for a student with a disability.

AFTER participation decisions have been made and noted in the student’s current IEP…

VGLA: Grades 3 - 8 Participation Criteria

The student must have a current IEP/504-plan; As a result of a disability, the student demonstrates

his/her individual achievement of SOL content through means other than multiple-choice formats;

As a result of a disability, the student is unable to demonstrate his/her individual achievement on the SOL test for the assigned course or grade level using available accommodations and formats.

VAAP: Select ASOL

The teacher and student review and select Aligned Standards of Learning (ASOL) in each content area from grade level blueprints.

Consideration of ASOL for any test begins by reviewing the student’s grade level ASOL blueprint; before moving to lower or higher level blueprints.

The number of required ASOL selected is based on the content area reporting categories in the ASOL grade level blueprints.

ONE ASOL must be defended from EACH reporting category within a grade level blueprint.

VAAP: Select ASOL (cont’d)

VAAP: ASOL Per Content Area

Reading – 2

Mathematics – 5

History – 4

Science – 4

VAAP : Identify Evidence Types

Identify type of evidence that will best demonstrate individual achievement in the selected ASOL.

VAAP : Instruction in Content

Teacher instructs the student in the appropriate content and the student generates evidence of achievement related to skills and/or knowledge listed in the selected ASOL.

Collect Evidence

Throughout the school year, the student and teacher select the strongest evidence to demonstrate that the student can perform all or part of the stated skill.

• Data Identification System (DIS) Sticker required on each piece of evidence.

Evidence:

The VGLA and VSEP requires evidence that the student can demonstrate a level of achievement related to the selected standards.

Types of Evidence

A collection may consist of any of the following types of evidence:

Work sample Audiotape Videotape Anecdotal Record Interview Charts/Graphs

Evidence Continued Evidence must demonstrate knowledge

and/or skills in the SOL addressed.

Students should submit evidence for all of the SOL assessed from the test blueprints.

Evidence may prove more than one SOL.

All evidence must be solely the student’s work completed in the presence of a teacher or authorized school personnel.

Evidence: Data Identification System (DIS)

stickersDIS stickers are REQUIRED to be placed

on each piece of evidence submitted for the VGLA and VSEP.

DIS stickers will be provided based on enrollment counts to your DDOT

Evidence without DIS stickers will NOT be considered in scoring entries.

Data Identification System (DIS) Sticker

Content Area being submitted

Standard of Learning being defended

Bullet of SOL being defended (if applicable)

Check one or both

Content Area:SOL:Bullet:Inferred: Demonstrated

 

Content Area: MathematicsSOL: 8.14Bullet: cInferred: Demonstrated

 Example:

VGLA/VSEP DIS

VGLA/VSEP DIS

COE Submission

5.4 The student will read fiction and nonfiction with fluency and accuracy.

a) Use context to clarify meaning of unfamiliar words;

b) Use knowledge of root words, prefixes, and suffixes;

c) Use dictionary, glossary, thesaurus, and other word- reference materials.

Evidence submitted must include everything in the stem as well as all of the bullets.

VGLA/VSEP DISContent Area: ReadingSOL: 5.4Bullet: bInferred: Demonstrated: X

5.4 b The student will read fiction and nonfiction with fluency and accuracy by using

knowledge of root words, prefixes, and suffixes.

5.4 c

The student will read fiction and nonfiction with fluency and accuracy by using a dictionary, glossary, thesaurus, and other word-reference materials.

5.4 a The student will read fiction and nonfiction with fluency and accuracy by using

context to clarify meaning of unfamiliar words.

VGLA/VSEP DISContent Area: ReadingSOL: 5.4Bullet: cInferred: Demonstrated: X

VGLA/VSEP DISContent Area: ReadingSOL: 5.4Bullet: aInferred: Demonstrated: X

SOL Disaggregation

5.7 The student will demonstrate comprehension of information from a variety of print resources.

b) Organize information on charts, maps, and graphs.

5.7 The student will demonstrate comprehension of information from a variety of print resources.

b)

Organize information on

charts,

maps, and

graphs.

SOL Check Sheet

Optional

SOL Dividers

Optional

VGLA Checklist

Optional

1.6 The student will identify and represent the concepts of one-half and one-fourth, using appropriate materials or a drawing.

2.4 The student will identify the part of a set and/or region that represents fractions for one-half, one-third, one-fourth, one-eighth, and one-tenth and write the corresponding fraction.

Because it is not properly labeled

EvidenceMayNot Be

Scored

EvidenceMayNot Be

Scored

K.6 The student will add and subtract whole numbers, using up to 10 concrete items.

1.9 The student will create and solve story and picture problems involving one-step solutions, using basic addition and subtraction facts.

EvidenceWillNotBe

Scored

EvidenceWillNotBe

ScoredBecause this worksheet doesnot include directions orteacher comments aboutthe activity.

3.4 The student will use strategies to read a variety of fiction and nonfiction materials.d) Use context to clarify meaning of unfamiliar words.Evidence

MayNotBe

Scored

EvidenceMayNotBe

Scored Because it is not properly labeled

Because it is not properly labeled

6.3 The student willb) identify and describe prime and composite numbers

Should not be the

sole piece of

evidence for 6.3b

Should not be the

sole piece of

evidence for 6.3b

Because this activity identifies

but does not describe prime and composite

numbers.

Required Components

Optional Components

Submit COE

At the end of the “testing window,” the collection of evidence (COE) is submitted to the local Division Director of Testing.

(Amy Merrihue & Committee)

Submit COE

A signed affidavit must accompany each VGLA/VSEP area submission stating that the work is that of the student alone using his/her accommodations. Work samples submitted must be solely that of the

student.

In the presence of a teacher and/or paraprofessional.

Submit COE

Affidavit of Student Performance I did not: fabricate, alter, or modify student work samples; present evidence that provides a negative image

of the student; provide accommodation/assistive device that is

not a part of daily instruction; and I am not aware that anyone else did so.

Affidavit ConsiderationsHand over hand instruction is NOT evidence

of student performanceCopying notes or information from other

sources DOES NOT demonstrate individual student achievement of the content, but rather the students ability to copy information

Information gained or restated during open-book, internet research, or guided reading activities DOES NOT demonstrate individual achievement with the content

VGLA Collection ComponentsA VGLA collection submitted for scoring to the local scoring team must contain the following:

A signed VGLA Affidavit of Student Performance that demonstrates the student’s sole ownership/authorship.

Types of evidence that demonstrate individual achievement on all SOL addressed.

A Virginia Grade Level Alternative (VGLA)Assessment Worksheet to be used for scoring.

VSEP Collection ComponentsA VSEP Course Work Compilation submitted for scoring to the Virginia Department of Education must contain the following:

A signed VSEP Affidavit of Student Performance that demonstrates the student’s sole ownership/authorship.

A completed Course Work Compilation Form indicating evidence and SOL associations.

Types of evidence that demonstrate individual achievement on all SOL addressed.

TIPS TO IMPROVE INSTRUCTION

Label, Label, Label!Read the stem & bullet completely and

address everything.Avoid “shortcuts.”Use SOL check sheets to guide

instruction.We are all in this together, so LET’S

WORK TOGETHER!

Scoring VGLA and VSEP Submissions

VGLA Procedures • The student’s VGLA collection and the

signed affidavit confirming that the work is that of the student alone are submitted to the LEA scoring committee.

A complete collection that provides evidence for all SOL from a given content/grade level that the student has addressed during the course of study must be submitted.

VGLA Scoring Teams Scoring teams must consist of at least three

members. At least one or more members must have

knowledge of the content area being scored. Scoring teams must come to consensus on

score points assigned for each Standard Of Learning contained within the blueprint for a specific test.

Scores for individual Standards Of Learning are weighted based on the general Blueprint established for each test.

VGLA Procedures • Based on the documentation and collection

review, the school division scoring team will assign the appropriate scores based on the scoring rubric identified by the Virginia Department of Education.

The Division Director of Testing is responsible for maintaining a local scoring team.

After receipt of all required materials, documentation, and collection evidence, the local scoring team will set up a date for review of submitted VGLA entries.

The local scoring team will use the online scoring system to rate student individual achievement in each SOL addressed for specific content/grade level VGLA submitted collection.

VSEP: EOC and Modified Standard Diploma Grades 9-12 : Participation Criteria

The student has a current IEP or 504 plan. The student is enrolled in a course or has passed a

course that has a Standards of Learning End-of-Course test and/or the student is pursuing a Modified Standard Diploma and seeking certification for having met the literacy and/or numeracy requirements.

The impact of the student’s disability demonstrates to the IEP team or 504 committee that the student will not be able to access the Standards of Learning assessments even with accommodations and therefore requires a substitute evaluation.

VGLA/VSEP Modified Standard Diploma Options

If a student, as an 8th grader, has passed the grade 8 Reading and/or mathematics test(s) using the VGLA; he or she may use the scores earned during that administration to meet the requirements for literacy and/or numeracy when identified as seeking an MSD;

Scores awarded VGLA submissions by local scoring teams are acceptable for MSD purposes. Student VGLA submissions do NOT have to be submitted to the Department for review.

Students in ninth grade or above earning an MSD who did not participate in the VGLA in eighth grade are required to participate in the VSEP to meet the MSD reading and math requirements.

VSEP Procedures The student and teacher use established

procedures to identify collection components to demonstrate individual achievement and proficiency of SOL for the EOC grade level and content area(s) (and/or numeracy and/or literacy) considered for the VSEP. examine the addressed SOL for the assessment(s) being

considered (Blueprint). select appropriate work samples that demonstrate content

stated in the blueprint. reflect demonstration of student knowledge and skills related

to the specific SOL. complete a Course Work Compilation that represents the

student's level of individual achievement and proficiency.

VSEP Procedures The student and teacher MUST use a Course

Work Compilation form to indicate evidence submitted for scoring. The CWC should mirror the Evaluation Plan submitted and

approved by the VDOE. Additional evidence may be submitted using the CWC, but a

CWC MUST contain evidence indicated and approved from the original Evaluation Plan

Evidence should demonstrate the student’s level of individual achievement and proficiency with EOC SOL

Score

Local scorers use a state-developed rubric to rate student achievement on the aligned standards included in each collection of evidence.

Ratings are entered into online scoring sheet.

VSEP ScoringVSEP entries are scored during scoring

events throughout the school year.Trained scorers will read and review each

submitted entry.All entries are scored at least twice by

different scorers with content area expertise.

Scores for individual Standards Of Learning are weighted based on the general Blueprint established for each test.

VSEP Procedures • The student’s VSEP Course Work Compilation

form, evidence, and the signed affidavit confirming that the work is that of the student alone are submitted to the school division Director of Testing based on the established testing date(s) for each division.

A complete Course Work Compilation provides evidence for all SOL from a given EOC and/or literacy and/or numeracy blueprint that the student has addressed during the course of study.

VSEP Procedures • Based on the documentation and

Course Work Compilation review, trained and authorized scorers will assign appropriate scores based on the scoring rubric. The Division of Assessment and Reporting and

Pearson Educational Measurement will establish a scoring institute.

All VSEP entries will be scored during the scoring institute, dates to be determined.

The VSEP Scoring System will weight and calculate proficiency levels.

Report

After local scorers complete score sheets, DDOT or designee enters scores into online scoring system.

Real-time reporting will allow the DDOT to print copies of the student’s Official Score Report immediately after entering scores.

Report (cont’d)

DDOT distributes Official Score Reports to schools, parents, and students.

Alerts resolved online.Summary reports for students will be

made available online after receipt of the Division Authorization To Proceed (ATP) from the DDOT.

VGLA Reporting

The online scoring system provides scoring and reporting for the Local School Division and directly to the Division of Assessment and Reporting.

Division Directors of Testing will be given log-on information and procedures for accessing and reporting scores for VGLA Administrations during spring score training.

VSEP Reporting

The computerized scoring system used during the scoring event provides real-time scoring to Department of Education authorized scoring teams. Pearson Educational Measurement will print out Official Score Reports during the scoring event. Scorers will sign Official Score Reports. Division Directors of Testing will receive Official Score Reports for VSEP students at the close of the scoring event.

VGLA Audit Procedures • All school divisions will be subject to

VDOE audits to monitor program implementation, scoring, and application of participation criteria. 10 to 15 percent of student submissions. provide VDOE audit staff with evidence used to

establish ratings. agreement or non-agreement between submitted

evidence and ratings provided. School divisions may appeal scores and/or audits

through an established appeals process.

Divisions will receive audit rosters from Pearson. Student entries identified for audits should be set

aside and maintained until instructed to send to the Division of Assessment and Reporting VGLA Audit Institute

DDOTs will receive shipping materials, instructions, and labels prior to the audit institute.

VGLA Audit Procedures (cont’d)

VSEP Procedures

• VSEP entries will not be audited. Each VSEP will be scored by state identified,

trained, and authorized scorers. Each VSEP entry will be scored by two scorers. Inter-rater reliability will be established by

examining the first and second scores on proficiency assigned to each VSEP entry.

If required, VSEP entries will be read a third time by a third scorer to resolve disagreements in proficiency levels.

Review reports

Appeal scoring, reporting, and/or process Who can initiate an appeal?

Parent, Student, Teacher, Division Justification for appeals?

Errors

Timelines-30 days after reports/audits

Resources

VAAP Procedural Manual Virginia Alternate and Alternative Test

Administrator’s Manual ASOL Blueprints www.doe.virginia.gov VDOE Office:

Division of Assessment and Reporting Virginia Alternate Assessment Program (VAAP)

Questions