Image Source: ThinkStock

PISA2012Reflections

SummaryImplicationsQuestions

PISAProgram for International Student Assessment

• Started in 2000 by Organization for Economic Cooperation and Development (OECD)

o testing 15 year olds (3 year rotation)o evaluate international educational systems;o reading, mathematics, and science;o provide useful background information; o contextual reports – equity, for example.

Source: www.oecd.org/pisa

PISA 2012

492 (MB)

522 (BC)

494 (OECD)

518 (Can)

Source: adapted from p. 19 of “Measuring Up: Canadian Results of the OECD PISA Study – 2012 First Results”

524 (Cdn gr.10)

487 (Cdn gr.9)

QC 536

479 (PEI)

PISA 2012Economic, Social, & Cultural Status

(ESCS)

Source: Table II.2.4a from “PISA 2012 Results: Excellence Through Equity”

Botto

m Q

uartile

2nd

Qua

rtile

3rd

Qua

rtile

Top

Qua

rtile

440

480

520

560

PISA 2012 Scores vs ESCS

Canada 518 (Cdn mean)

Almost 2 grade levels

difference

My Curiosity Questions

1. How many students have family demands preventing out-of-school math (home)work? What is their mean PISA score?

2. How many students are “voting with their feet”? (attendance) What is their mean PISA score?

3. How many students believe they are “bad at math”? What is their mean PISA score?

4. How many students are regularly late for school/class? What is their mean PISA score?

Using online PISA tool, I obtained the following data …

PISA 2012Data Exploration: Student Survey

Family De-

mands

Skip a Day (3+)

Not Good at Math

Late (3+)

05

1015202530354045

Canada %OECD %

Source: OECD PISA Data Exploration Tool, December 2013

471-491464-481462-489499-508 Cdn Mean 518

PISA 2012Some Points

• Gr.10 students performed better than gr.9o Manitoba had 2060 students write – combination of gr.9/10

• Those with lowest SES are two grade levels behind in PISA achievement scoreso Manitoba has highest % of children using food banks (WFP 2014)o in top 3 for highest % of families and individuals living in low income

for past 25 years (Make Poverty History 2014)

• 33% of Canadian students say family or other demands prevent them from “doing math”o Mean score close to Cdn Mean

• 35% of Canadian students believe they are not good at matho Mean score 2 grade levels below Cdn Mean

PISA 2012More Points

• Well written qualitative questions targeting low SES students are largely absento E.g. students asked about parent occupation, not given choice of

“unemployed”

• More boys achieved highest levels (5 & 6) than girlso 19% vs 14% (Canada)

• Cities ranked alongside countrieso Hong Kong, Shanghai, Singapore, Macao, Chinese Taipei …

PISA 2012Even More Points

• Quebec data did not meet international sample size standards (75%, not 80%)o Initial sample size met PISA standards, but after assessment completed, sample

size too smallo Conversation with PISA reps and QUE Minister of Ed: “PISA data set does not

address differences by SES and ‘may marginally impact the results for Quebec’”

• Rasch statistical analysis methods questionedo 2060 MB students extrapolated to represent 11000+ MB studentso 3850 QC students extrapolated to represent 50500+ QC studentso 1288 PEI students extrapolated to represent 1288 PEI studentso Methodology behind Rasch itself is questioned (S. Kreiner, 2014)

o NOTE: Rasch method NOT used for qualitative surveys

PISA 2012: Further Curiosity Questions

• How do we support/teach students persistence? o Attendanceo Engagemento Problem solving

• What does our (school, divisional) data look like for key populations:o AAAo EALo Low SES

Thank YouWhat questions do you have?