Getting Ready 2008-2009 PSSA Math

Edward G. Rendell, Governor ▪ Dr. Gerald L. Zahorchak, Secretary of Education www.pde.state.pa.us

PSSA Assessment 2009

Getting Ready2008-2009

PSSA Math

11



2008–2009PSSA Testing Window

22

Assessment Dates Grade(s)

PSSA Grade 12 Retest in Math,Reading, & Writing

October 20 - 31, 2008 12

PSSA Writing February 9 - 20, 2009 5, 8, 11

PSSA Reading & Math March 16 - 27, 2009 3 through 8, 11

PSSA Science April 27 - May 8, 2009 4, 8, 11

PASA Math & Reading February 16 - March 27, 2009 3 through 8, 11

PASA Science May 4 - 29, 2009 4, 8, 11

ACCESS for ELLs January 12 - February 20, 2009 K - 12

NAEP - in selected schools January 26 - March 6, 2009 4, 8, 12



2009-2010 PSSA Testing Window

33

Assessment Dates Grade(s)

PSSA Grade 12 Retest in Math,Reading, Science, & Writing

October 26 - November 6, 2009 12

PSSA Reading & Math and PSSA-Modified Reading & Math

April 12 - 16, 2010 3 through 8, 11

PSSA Writing April 19 - 23, 2010 5, 8, 11

PSSA Science and PSSA-Modified Science

April 26 - 30, 2010 4, 8, 11

PSSA and PSSA-Modified Make-Ups for All Subjects

May 3 - 7, 2010 As Applicable

PASA Math & Reading TBD 3 through 8, 11

PASA Science TBD 4, 8, 11

ACCESS for ELLs TBD K - 12

NAEP - in selected schools TBD TBD



• Academic Standards – Revised– Mathematics– Reading, Writing, Speaking and Listening

• Assessment Anchors/Eligible Content– Existing Anchors Have Not Changed– Assessment Anchors for Writing will be developed

44

Academic Standards and Anchors



PSSA Test Design

• Data Recognition Corporation (DRC) is contractor• Embedded Field Test• Multiple Choice and Open Ended Items• Equating Block

– Items that enable scores to be compared from last year to this year

• Matrix has been eliminated

55



Scoring• Multiple Choice Items are Machine Scored

• Open Ended Items are Hand Scored– Item Specific Scoring Guidelines for Math,

Reading, and Science– Mode Specific Scoring Guidelines for Writing

66



Accommodations• Accommodations Guidelines for Students with IEPs

and 504 Plans

• Posted on PDE website

• Training presentation– January 7, 2009– Broadcast from 3 PaTTAN sites

• Accommodations Guidelines for ELLs77



Modified Test Format• Braille and Large Print Books

– Order from DRC

• Spanish Side By Side Translated Versions for Math and Science

88



Performance Levels

• Cut Scores remain the same for all subjects.

• Performance Level Descriptors remain the same for all subjects.

99



Pennsylvania Information Management System (PIMS)

• All student information for pre-code labels will come from PIMS.

• IMPORTANT – Information in PIMS must be correct.

• Questions about PIMS, contact the PIMS Help Desk.– http://remedyweb.state.pa.us/PDESubmit.jsp

1010



MONITORING

• In 2007, PDE began monitoring schools and districts regarding test security, administration, etc. This process will continue in 2009 and beyond. All visits will be unannounced.

• PDE representatives were treated very well.

1111



PSSAMATH

ASSESSMENT2008-2009

1212



2008-2009• Student score comes from:

– 60 Multiple Choice questions– 3 Open-Ended questions

• Students take:– 72 MC at grades 3 - 8 and 11– 4 Open-Ended

• All Grades will alternate subject areas with Math coming first.

1313



2008-20092008 PSSA Mathematics Test Format

Number of Multiple Choice Items per

Student (1 pt. each)

Number of Open-Ended Items per

Student (4 pts. each)

GradeEstimated

Time of Test

Common Multiple Choice Items

Equating Block Items

Field Test

Items

Common Open-Ended Items

Equating Block Items

Field Test

Items

Total Number of Score Points

3-8 and 11

2.5 hours

3 sessions60 2 10 3 0 1

60+12=

72

Scores come from the COMMON ONLY.Scores come from the COMMON ONLY.1414



Test Blueprint

1515

Reporting Category

Grade

3

Grade

4

Grade

5

Grade

6

Grade

7

Grade

8

Grade

11

Numbers and Operations

40-50% 43-47% 41-45% 28-32% 20-24% 18-22% 12-15%

Measurement 12-15% 12-15% 12-15% 12-15% 12-15% 12-15% 12-15%

Geometry 12-15% 12-15% 12-15% 15-21% 15-21% 15-20% 12-18%

Algebraic Concepts

12-15% 12-15% 13-17% 15-20% 20-27% 25-30% 36-42%

Data Analysis and

Probability13-16% 12-15% 12-15% 15-20% 15-20% 15-20% 12-18%

Total Points72

Points72

Points72

Points72

Points72

Points72

Points72

Points



2008-2009• Criterion Referenced• Based on the Assessment Anchor Content Standards• 5 Reporting Categories

– Numbers and Operations– Measurement– Geometry– Algebra– Data Analysis

1616



2008-2009• MC items are based solely on the Eligible Content

• OE items are based on the Anchor. The Content comes from EC but what students are asked to do, the Verbs (such as show, explain, create), can come from the Eligible Content, the Descriptor, or the Anchor.

• Have students read the OE items carefully and answer exactly what is being asked.

1717



2008-2009• Examples of how OE items might be phrased:

– Show or explain all your work.– Show all your work. Explain why you did each

step.– Explain why [something is true or false]– Explain how [doing something affects something

else; to find something, etc]

1818



2008-2009• Examples of how OE items might be phrased: (cont.)

– List…– Graph…– Determine…– Tell…– Shade…– Complete…

1919

– Describe…– Solve…– Complete…– Show….– Create…– Estimate…



2008-2009• Embedded Field Test• Open-Ended items scored on a 0-4 scale• Item-specific scoring guidelines but no general

rubric.• Formula sheets will be provided for grades 7, 8 and

11. Formulas needed in grades 5 and 6 are provided with the item.– See Resource Materials on our website for the

formula sheets and item samplers.

2020



Example OE Item• Roy is running for class president. He polls 50 students. 60%

of them say they will vote for him.

A. There are 350 students in Roy’s class. Based on his survey, how many students should he expect to vote for him? Show or explain all your work.

B. Roy will sell fruit drinks to raise money for his campaign. A fruit drink cost $0.10 and he sells it for $0.50. How many fruit drinks does Roy need to sell to earn $80? Show all your work. Explain why you did each step.

2121



RubricPart A:

½ point for correct answer1 point for complete and correct work OR

½ point for correct but incomplete work.Part B:

1/2 point for correct answer1 point for correct and complete work OR

½ point for correct but incomplete work.1 point for correct and complete explanation.

½ point for correct but incomplete explanation.2222



Rubric MetricTotal Points (within) Score (on)

4 4

3 – 3 ½ 3

2 – 2 ½ 2

½ - 1 ½ 1

0 0

2323



2008-2009• Testing time is approximately 2.5 – 3 hours for Math.

• Testing in Grades 3 - 8 and 11.

• Can have a “blemish” and still get a score of 4.

• “e.g. missing $” may or may not be a blemish depending on the item and grade.

2424



2008-2009• Grade 4 and up: calculators ARE permitted on all but

the beginning few items.• Rulers will be provided at grades where needed.

Students must use the rulers provided for the PSSA.• Rulers scaled in Metric and US Customary. • Protractors are provided as needed within the item

itself.

2525



Rulers

2626

Grade Scaled to Measure to

3 ¼th inch and

centimeter

Nearest ½ inch

4 1/8th inch and centimeter

Nearest ¼th inch or centimeter

5 1/16th inch and centimeter

Nearest 1/8th inch or centimeter

6 1/16th inch and millimeter

Nearest 1/16th inch or millimeter



2008-2009• CALCULATOR POLICY

– The PSSA is designed so that calculators are not necessary for students to be successful. If students choose to use a calculator on the portions of the PSSA for which calculators are permitted then they must adhere to the guidelines listed below. It is incumbent upon the school test coordinator to ensure that all calculator policies are implemented and followed, including making sure calculators have no programs stored in their memory. Please note that if a student wants to restore the deleted programs he or she will have to back them up prior to the assessment.

2727



2008-2009The following are NOT allowed for the PSSA:

– Non-calculators such as cell phones, PDAs, laptops, minicomputers, pocket organizers, etc.

– Beaming capabilities. (These must be disabled.)– Wireless communication technologies. Calculators having wireless

communication technologies may be used if those technologies are disabled.

– Calculators with QWERTY keyboards or other typewriter-like keyboards or keypads (e.g. Dvorak).

– Calculators with built in Computer Algebra Systems – CAS.– Calculators that make noise, have paper tape, need to be plugged in or

talk unless these specific calculators are required as an accommodation. (Please refer to the Accommodations Manual.)

– Sharing calculators by students during a test session. – All programs / information stored in a calculator. These must be

deleted prior to using that calculator on any section of the PSSA. Typically these are graphing calculators but scientific calculators may also contain stored programs.

2828



2008-2009• This is intended to be a general description of

what is not allowed. It is not meant to be an exhaustive list of specific calculators, devices or technologies that cannot be used on the PSSA.

• As technology changes this policy will be reviewed and may also change.

2929



2008-2009• Grade 3:

– Cannot use calculators

– Mark answers in the test booklet

3030



Performance Level Cut Scores – All Grades

3131

Mathematics

Performance Level

Grade 3

Grade4

Grade 5

Grade 6

Grade 7

Grade 8

Grade 11

Advanced1370

and up1445

and up1483

and up1476

and up1472

and up1446

and up1509

and up

Proficient1180-1369

1246-1444

1312-1482

1298-1475

1298-1471

1284-1445

1304-1508

Basic1044-1179

1156-1245

1158-1311

1174-1297

1183-1297

1171-1283

1167-1303

Below Basic750-1043

700-1155

700-1157

700-1173

700-1182

700-1170

700-1166



Who is Excused?• Those who qualify to take the PASA

• Students must meet 6 criteria in order to take the alternate assessment for students who have significant cognitive disabilities. See www.pasaassessment.org .

• ELLs in their first 12 months of enrollment in a US School (not including PR)• Must take PSSA Math. Participation counts for AYP;

performance does not.• Are not required to take PSSA Reading• Reading scores will not count

for AYP performance. See www.pde.state.pa.us/esl/ .

3232



Who oversees the ACCESS for ELLs?

Pennsylvania participates in the WIDA consortium; the consortium provides tester training and manages the test development, distribution, scoring, and score reporting processes with its partner, Metritech.

WIDA is accessible at this web address: http://www.wida.us/, by emailing [email protected], or calling toll free 1-866-276-7735.

At the PDE website you can find more information about ACCESS and testing for ELLs at the ESL program page, http://www.pde.state.pa.us/esl/ .

3333



PSSA - Modified

3434

• Data Recognition Corporation (DRC) is test contractor

• Field tests in all grades.– May 18-22, 2009

• Operational in 2010• Focused Sample• Cognitive Labs



PVAASHas been approved for determining AYP• If a subgroup does not make AYP by any of the existing 7

methods, then the Growth Model (really Projections) are applied.

• The projection for each student to a future PSSA is calculated – the target grade is specified in the proposal.

• If the student does not have enough data to calculate a projection, the student’s actual test score is used.

• Actual score for 3rd grade and 11th grade are used since projections cannot be calculated for these grades.

• The percent of students in the subgroup that are projected to be proficient (or actually proficient only if no projection can be calculated) is then computed. If this percent is greater than or equal to the AMO target for that subject, the subgroup is identified as making AYP.



NATIONAL ASSESSMENT OF EDUCATIONAL PROGRESS

2008-2009

3636



National Assessment of Educational Progress (NAEP)

• NAEP is a congressionally mandated project overseen by the National Center for Education Statistics (NCES) to continuously monitor the knowledge, skills, and performance of the nation’s children and youth.

• As the “Nation’s Report Card” it measures and reports on a regular basis what America’s students know and can do in core subjects like reading, mathematics, writing and science

• http://nces.ed.gov/nationsreportcard 3737



NAEP 2008-2009• In Pennsylvania, NAEP is required of the randomly

selected schools.

• Grades tested are 4, 8 and 12.

• Main subjects are Mathematics, Reading & Science

• Additionally – U. S. History, Civics, Geography, Science (hands on test -HOT), Science (interactive computer test-ICT), and a high school transcript study (HSTCS)

3838



NAEP 2008-2009

• NAEP is administered by Westat Inc., the contractor for the U. S. Department of Education.

• Testing window January 26 to March 6, 2009.

• Testing time is usually 90 minutes. Additional time may be needed for Science HOT & ICT and students with special needs.

3939



NAEP 2008-2009• Grades and schools are randomly selected according

to criteria from the U. S. Department of Education

• Reporting for Mathematics will be in the Fall of 2009

• Reporting for Reading will be in the Spring of 2010, due to new framework for NAEP.

• Reporting for Science will be in the Summer of 2010.

4040



Is NCLB working?



PA NAEP Grade 4



PA NAEP Grade 8

42510011 0010 1010 1101 0001 0100 1011

TIMSS 2007

http://nces.ed.gov/timss/results07.asp

4251

0011 0010 1010 1101 0001 0100 1011

Overall

Significant progress in 4th & 8th Grade Math

US performed above the international avg

US scores have risen since 1995

# of countries outperforming US declining

US’s relative standing in math increase

US’s relative standing in science steady

4251

0011 0010 1010 1101 0001 0100 1011

Overall

US is heading in the right direction in math and science

Still has a ways to go to catch up to high-performing Asian counterparts

US had made greater achievement gains over the past 12 years than Japan and Singapore

4251

0011 0010 1010 1101 0001 0100 1011

4th Grade Math

Performed as well or better than 23 of 35 participating countriesOutperformed Australia, Italy, Sweden & Hungary, which outperformed US in 2003US outperformed by 8 countries compared to 11 in 2003Scores have risen 11 points since 1995 (increase all came b/w 2003 & 2007). Singapore had an increase of 9 points.10% of students score at the Advanced level. Only 7 other countries had a greater percentage.

4251

0011 0010 1010 1101 0001 0100 1011

8th Grade Math

Performed as well or better than 37 of 47 participating countriesOutperformed Australia, Sweden, Scotland & Malaysia, which outperformed US in 2003US outperformed by just 5 countries compared to 9 in 2003Scores have risen 16 points since 1995. Only 3 countries made greater gains. Hong Kong (4 pts), Japan (-11 pts), Russia (-11 pts), Singapore (-16 pts)6% of students score at the Advanced level. Only 7 other countries had a greater percentage.

4251

0011 0010 1010 1101 0001 0100 1011

Keep in mind…..

Similar students are not being compared (e.g. a country may score higher b/c it enrolls more students from a higher SES)

Differences in scores may be a result of differences in curricula, not quality of instruction

4251

0011 0010 1010 1101 0001 0100 1011

National Math Panel Report

Let’s count to 4…

“1,2,3,4”

4251

0011 0010 1010 1101 0001 0100 1011

National Math Panel Report

Executive Summary

• Curricular Content• Benchmarks for Critical Foundations (pg. 20)

• Major Topics of School Algebra (pg.16)

• Learning Processes• Conceptual understanding, computational fluency,

and problem-solving

• Fractions (decimals and percents)

4251

0011 0010 1010 1101 0001 0100 1011

1. Teachers and Teachers Education (xx)

2. Instructional Practices (xxii)

3. Instructional Materials (xxiv) & Assessment (xxv)

4. Research Policies and Mechanisms (xxvi)



Resource Materials• Assessment Handbook

– http://www.pde.state.pa.us/a_and_t/lib/a_and_t/2007-2008_Assessment_Handbook.pdf

• Performance Level Descriptors– http://www.pde.state.pa.us/a_and_t/cwp/view.asp?a=108&q=114348

• Performance Level Cut Scores– http://www.pde.state.pa.us/a_and_t/cwp/view.asp?a=108&q=114026

• Getting Ready 2008-2009 Presentation – http://www.pde.state.pa.us/a_and_t/lib/a_and_t/2008_PSSA_Rollout.ppt

• Calculator Policy– http://www.pde.state.pa.us/a_and_t/lib/a_and_t/Calculator_Policy.pdf

• Math Formula Sheets– http://www.pde.state.pa.us/a_and_t/cwp/view.asp?a=108&Q=73314&a_and_tNa

v=|680|&a_and_tNav=| 5454



Resource Materials• Item and Scoring Samplers

– http://www.pde.state.pa.us/a_and_t/cwp/view.asp?a=108&Q=73314&a_and_tNav=|680|&a_and_tNav=|

• Standards-Aligned Strategies and Lesson Plans for the Teaching of Writing– http://www.pawritingprojectnetwork.org/

• Pennsylvania Writing Project Network Writing Strategies– http://www.pawritingprojectnetwork.org/

• Assessment Anchor Content Standards (Assessment Anchors)– http://www.pde.state.pa.us/a_and_t/cwp/view.asp?a=108&q=103127&a_and_t

Nav=|6309|&a_and_tNav=|

• Interpretation Aids– http://www.pde.state.pa.us/a_and_t/cwp/view.asp?

a=108&Q=45153&a_and_tNav=|681|&a_and_tNav=| • Accommodations Guidelines

– http://www.pde.state.pa.us/a_and_t/lib/a_and_t/2008AccommodationsGuidelines.pdf

5555



Resource Materials• Assessment Anchor Toolkits

– http://www.pde.state.pa.us/a_and_t/cwp/view.asp?a=108&Q=108454&a_and_tNav=|6404|&a_and_tNav=|

• Target Passage Types for Reading– http://www.pde.state.pa.us/a_and_t/lib/a_and_t/

Target_Passage_Types_for_Reading_PSSA.pdf

• General Scoring Guidelines– http://www.pde.state.pa.us/a_and_t/cwp/view.asp?

a=108&Q=73314&a_and_tNav=|680|&a_and_tNav=|

5656



Contact InformationDivision of Assessment

Jay Gift 717-783-1144 [email protected]

Jack Hoerner 717-787-4865 [email protected]

Kevin Nlemchi 717-346-3290 [email protected]

Diane Simaska 717-346-8064 [email protected]

Stephanie Stauffer 717-346-7167 [email protected]

Charles Wayne 717-783-0358 [email protected]

5757



Office of Elementary/Secondary Education Diane Castelbuono, Deputy Secretary

Bureau of Assessment and Accountability Shula Nedley, Ph.D, Director

Division of Assessment Ray Young, Division Chief

5858

Getting Ready 2008-2009 PSSA Math

Documents

Transcript of Getting Ready 2008-2009 PSSA Math