PISA AND THE OECD TEST FOR SCHOOLSInternational benchmarking for schools and school districts

Atlanta, October 2, 2014

Tue HalgreenDirectorate for Education and SkillsOECD

THE GLOBAL CONTEXT

3 The structure of the PISA assessment

2000 2003 2006 2009 2012

Reading Reading Reading Reading Reading

Mathematics Mathematics Mathematics Mathematics Mathematics

Science Science Science Science Science

Problem Solving

Digital Reading

Problem Solving, Financial literacy,

Digital Math, Digital reading

Helen the CyclistHelen has just got a new bike. It has a speedometer which sits on the handlebar. The speedometer can tell Helen the distance she travels and her average speed for a trip.

Helen rode 6 km to her aunt’s house. Her speedometer showed that she had averaged 18 km/h for the whole trip.

PISA 2012 Sample Question

Which one of the following statements is correct?

A.It took Helen 20 minutes to get to her aunt’s house.

B.It took Helen 30 minutes to get to her aunt’s house.

C.It took Helen 3 hours to get to her aunt’s house.

D.It is not possible to tell how long it took Helen to get to her aunt’s house.

Percent of 15-year-olds who scored Level 3 or Above

PISA 2012 Sample Question

Fig I.2.133

High mathematics performance

Low mathematics performance

… Shanghai-China is above this level (613)

Mean performance in mathematics – PISA 2012

…12 countries perform below this line

Low mathematics performance

Fig I.2.134

High mathematics performance

Performance and equity: a tradeoff ?

High impact of socio-economic

condition on student outcomes

Low impact of socio-economic condition on outcomes

Percentage of top performers in mathematics in 2003 and 2012

Fig I.2.238

What makes schools andschool systems

successful?

9

Cumulative expenditure per student (6 to 15) and maths performance in PISA 2012

Cumulative expenditure per student below USD 50 000

Cumulative expenditure per student above USD 50 000

Fig IV.1.8

1111 Align the resources with the challenges

Greater equityLess equity

Adjusted by per capita GDP

Countries with better performance in mathematics tend to allocate educational resources more equitably

Source: PISA 2012

1212 Adequate resources to address disadvantage

Disadvantaged schools reported more teacher shortage

Advantaged schools reported more teacher shortage

A shortage of qualified teachers is more of concern in disadvantaged schools

Among high-income countries high-performers pay teachers more

Per capita GDP less than USD 20 000

Per capita GDP over USD 20 000

Fig IV.1.10

Countries that grant schools autonomy over curricula and assessments tend to perform better in mathematics  

Fig IV.1.15

Schools with more autonomy perform better than schools with less autonomy in systems with more accountability arrangements

Score points

School autonomy for curriculum and assessment x system's level of posting achievement data publicly

Fig IV.1.16

HOW MUCH DO YOU KNOW ABOUT HOW YOUR SCHOOL / DISTRICT

COMPARES INTERNATIONALLY?

OECD TEST FOR SCHOOLS (BASED ON PISA)

OECD Test for Schools (based on PISA)Overview

Based on international PISA test of 15-year olds. All results are comparable to international PISA scales

Can be used by schools, networks of schools and districts

Goes beyond testing whether students can reproduce what they were taught to assess students’ capacity to extrapolate from what they know and creatively apply their knowledge in novel situations

Provides information on students’ engagement and the learning environment at the school

OECD Test for Schools (based on PISA)What does the assessment look like?

• Experience for students similar to that of the main PISA tests: 3h 15min

• Three assessment domains: reading, math, science

• Student sample size per school: 75 (some schools may test over 100 students)

• A comprehensive (150 pages) school report for each participating school

OECD Test for Schools (based on PISA)Timeline

Pilot

126 schools across US, UK, Canada

Roll out

285 schools in the US

2nd round

Open for sign up

Global Learning Network

Future plans

Computer-based delivery

New item formats

International availability

OECD Test for Schools (based on PISA)2013-2014 School Year Participation

• 285 schools tested between November 2013 and April 2014, representing:– 27 states– 119 school districts

OECD Test for Schools (based on PISA)2013-2014 School Year Participation

285 schools participated

22

3343

27 > 20 schools

10-19 schools

1-9 schools

OECD Test for Schools (based on PISA)School performance

Per

form

ance

on

PIS

A s

cale

Mathematics

PISA 2012

10% above

10% above

25 % above

25 % above

50% above/below

50% above/below

25% below

25% below

10% below

10% below

Schools in the United States

Schools in Shanghai-

China

OECD Test for Schools

OECD TFS2013/14

Socioeconomic status (ESCS)

Per

form

ance

on

PIS

A s

cale

OECD Test for Schools (based on PISA)Performance and socio-economic status

Schools that participated in OECD TfS 2013-2014

Schools that participated in the US in PISA 2012

Schools above the diagonal line perform better than what would be expected given the socio-economic status of their students

Mathematics

OECD Test for Schools (based on PISA)Measuring socio-economic background

• ESCS is an international measure of students’ socio-economic and cultural status, based on the parents’ educational level parents’ occupational status home possessions including cultural and

educational resources

Socioeconomic status (ESCS)

% o

f s

tud

en

ts e

lig

ible

fo

r fr

ee

/re

du

ce

d l

un

ch

pri

ce

s Schools that participated in OECD TfS 2013-2014

OECD Test for Schools (based on PISA)Measures of socio-economic status

Socioeconomic status (ESCS)

Per

form

ance

on

PIS

A s

cale

OECD Test for Schools (based on PISA)Comparison with schools in Mexico

Schools that participated in OECD TfS 2013-2014

Schools that participated in Mexico in PISA 2012

Mathematics

Socioeconomic status (ESCS)

Per

form

ance

on

PIS

A s

cale

OECD Test for Schools (based on PISA)Comparison with schools in Shanghai-China

Schools that participated in OECD TfS 2013-2014

Schools that participated in Shanghai-China in PISA 2012

Mathematics

OECD Test for Schools (based on PISA)Timeline

Pilot

126 schools across US, UK, Canada

Roll out

285 schools in the US

2nd round

Open for sign up

Future plans

Computer-based delivery

New item formats

International availability

OECD Test for Schools (based on PISA)International availability

• Spain: Pilot study carried out in 2013 Spanish version to be made available to other

Spanish-speaking countries.

• United Kingdom: • Available from this school year (2014/15)

• Growing interest from other countries

UNDERSTANDING YOUR RESULTS FROM THE

OECD TEST FOR SCHOOLS

OECD Test for Schools (based on PISA)School report

• 150 page eBook:

1. Introduction: Understanding Your School’s Results2. What Students at Your School Know and Can Do in

Reading, Mathematics and Science3. Student Engagement and the Learning Environment at

Your School in an International Perspective4. Your School Compared with Similar Schools in Your

Country5. Your School’s Results in an International Context

School nameSchool DistrictStateUnited States

How your school compares internationally

OECD Test for Schools2014 - 2015

Proficiency levels

OECD Test for Schools (based on PISA)Overview of results (from the pilot)

What does the same mean mean? 543 and 543

Reading

Level 1 and be`low Level 2 Level 3 Level 4 Level 5 Level 6

Six reader profiles

Quality of teacher-student relations

Disciplinary climate and student performancce

Motivation of students to learn science

Instrumental motivation and performance at your school

OECD Test for SchoolsSchool Reports

HOW TO PARTICIPATE

OECD Test for Schools (based on PISA)2014-2015 School Year Testing

• Testing to begin on October 15, 2014

• CTB accredited service provider

• New version of school report eBook: Newest international evidence andcomparison data, 42 updated figures School name

School DistrictStateUnited States

How your school compares internationally

OECD Test for Schools2014 - 2015

OECD Test for Schools (based on PISA)Sign up

ctb.com/OECDTestforSchools

OECD Test for Schools (based on PISA)Implementation Toolit

1. Leading your OECD Test Program2. Interpreting Your School Results3. Case Studies4. Additional Resources

OECD Test for Schools (based on PISA)Leading Your OECD Test Program

• Communicate the VISION and PURPOSE of the program

• Practice effective collaboration and coordination between the district office and individual schools

• Promote trust and safety for participants• Provide appropriate time and resources for your team• Include teachers in every step• Establish the team and assign clear roles and

responsibilities• Focus on the schedule, as well as student and parent

buy-in

OECD Test for Schools (based on PISA)

Thank you!