2015 Massachusetts PISA Results2015 PISA in Brief 4 In 2015, over half a million students… -...
Transcript of 2015 Massachusetts PISA Results2015 PISA in Brief 4 In 2015, over half a million students… -...
![Page 1: 2015 Massachusetts PISA Results2015 PISA in Brief 4 In 2015, over half a million students… - Representing 28 million 15-year-olds in 72 countries/economies … took an internationally](https://reader033.fdocuments.us/reader033/viewer/2022060401/5f0e2c707e708231d43df63d/html5/thumbnails/1.jpg)
2015 Massachusetts PISA Results
Released December 6, 2016
![Page 2: 2015 Massachusetts PISA Results2015 PISA in Brief 4 In 2015, over half a million students… - Representing 28 million 15-year-olds in 72 countries/economies … took an internationally](https://reader033.fdocuments.us/reader033/viewer/2022060401/5f0e2c707e708231d43df63d/html5/thumbnails/2.jpg)
2
• About PISA • PISA Aggregate Results • PISA Results Disaggregated • Policy & Practice
Implications
![Page 3: 2015 Massachusetts PISA Results2015 PISA in Brief 4 In 2015, over half a million students… - Representing 28 million 15-year-olds in 72 countries/economies … took an internationally](https://reader033.fdocuments.us/reader033/viewer/2022060401/5f0e2c707e708231d43df63d/html5/thumbnails/3.jpg)
About PISA
3
• International assessment of 15-year-olds
• Administered by OECD every 3 years in: Science (2015 focal subject) Reading Mathematics
![Page 4: 2015 Massachusetts PISA Results2015 PISA in Brief 4 In 2015, over half a million students… - Representing 28 million 15-year-olds in 72 countries/economies … took an internationally](https://reader033.fdocuments.us/reader033/viewer/2022060401/5f0e2c707e708231d43df63d/html5/thumbnails/4.jpg)
2015 PISA in Brief
4
In 2015, over half a million students… - Representing 28 million 15-year-olds in 72 countries/economies
… took an internationally agreed 2-hour test… - Goes beyond testing whether students can reproduce what they were
taught to assess students’ capacity to extrapolate from what they know and creatively apply their knowledge in novel situations
- Total of 390 minutes of assessment material
… and responded to questions on… - Their personal background, their classes and schools, their well-being
and their motivation
… while parents, principals, teachers and system leaders provided data on:
- School policies, practices, resources, and institutional factors that help explain performance differences
- 89,000 parents, 93,000 teachers and 17,500 principals responded
![Page 5: 2015 Massachusetts PISA Results2015 PISA in Brief 4 In 2015, over half a million students… - Representing 28 million 15-year-olds in 72 countries/economies … took an internationally](https://reader033.fdocuments.us/reader033/viewer/2022060401/5f0e2c707e708231d43df63d/html5/thumbnails/5.jpg)
About PISA
5
• U.S. has participated since 2000 240 schools
• MA has participated twice: 2012 & 2015
• In MA in 2015: 1,700 students 49 schools Principal questionnaire Teacher questionnaire o 10 science per school o 15 non-science per school
![Page 6: 2015 Massachusetts PISA Results2015 PISA in Brief 4 In 2015, over half a million students… - Representing 28 million 15-year-olds in 72 countries/economies … took an internationally](https://reader033.fdocuments.us/reader033/viewer/2022060401/5f0e2c707e708231d43df63d/html5/thumbnails/6.jpg)
About PISA Science
6
Three dimensions Content: explain phenomena
scientifically Systemic: evaluate & design
scientific inquiry Epistemic: interpret data & evidence
scientifically
“the ability to engage with science-related issues, and with the ideas of science, as a reflective citizen”
![Page 7: 2015 Massachusetts PISA Results2015 PISA in Brief 4 In 2015, over half a million students… - Representing 28 million 15-year-olds in 72 countries/economies … took an internationally](https://reader033.fdocuments.us/reader033/viewer/2022060401/5f0e2c707e708231d43df63d/html5/thumbnails/7.jpg)
7
• About PISA • PISA Aggregate Results • PISA Results Disaggregated • Policy & Practice
Implications
![Page 8: 2015 Massachusetts PISA Results2015 PISA in Brief 4 In 2015, over half a million students… - Representing 28 million 15-year-olds in 72 countries/economies … took an internationally](https://reader033.fdocuments.us/reader033/viewer/2022060401/5f0e2c707e708231d43df63d/html5/thumbnails/8.jpg)
The “League Table” 72 participating education systems
SCIENCE READING MATH US MA US MA US MA
Higher 40 1 44 0 30 11
Similar 12 10 13 8 5 20
Lower 19 60 14 63 36 40 8
All comparisons are statistically significant
![Page 9: 2015 Massachusetts PISA Results2015 PISA in Brief 4 In 2015, over half a million students… - Representing 28 million 15-year-olds in 72 countries/economies … took an internationally](https://reader033.fdocuments.us/reader033/viewer/2022060401/5f0e2c707e708231d43df63d/html5/thumbnails/9.jpg)
PISA Science Finding
9
• Since 2012: Across OECD, science performance
declined MA science performance increased
slightly (not statistically significant)
![Page 10: 2015 Massachusetts PISA Results2015 PISA in Brief 4 In 2015, over half a million students… - Representing 28 million 15-year-olds in 72 countries/economies … took an internationally](https://reader033.fdocuments.us/reader033/viewer/2022060401/5f0e2c707e708231d43df63d/html5/thumbnails/10.jpg)
PISA Science Performance
10
Baseline (Level 2) proficiency students can: Draw on basic science content &
procedures Explain, interpret data, & identify
question addressed in experiment Top performers (Levels 5 & 6) can: Apply scientific knowledge & skills To variety of situations, including
unfamiliar ones
![Page 11: 2015 Massachusetts PISA Results2015 PISA in Brief 4 In 2015, over half a million students… - Representing 28 million 15-year-olds in 72 countries/economies … took an internationally](https://reader033.fdocuments.us/reader033/viewer/2022060401/5f0e2c707e708231d43df63d/html5/thumbnails/11.jpg)
PISA Science Performance
11
Low performers (Level 1) 12% of MA students 20% of US students 21% of OECD students
Top performers (Levels 5 & 6) 14% of MA students 9% of US students 8% of OEDC students
![Page 12: 2015 Massachusetts PISA Results2015 PISA in Brief 4 In 2015, over half a million students… - Representing 28 million 15-year-olds in 72 countries/economies … took an internationally](https://reader033.fdocuments.us/reader033/viewer/2022060401/5f0e2c707e708231d43df63d/html5/thumbnails/12.jpg)
PISA Science Findings
12
• Only 14% of variance in MA science performance attributable to students’ socio-economic background
• 86% of variance in MA science performance attributable to instructional strategies, school practices, and student attitudes about science
![Page 13: 2015 Massachusetts PISA Results2015 PISA in Brief 4 In 2015, over half a million students… - Representing 28 million 15-year-olds in 72 countries/economies … took an internationally](https://reader033.fdocuments.us/reader033/viewer/2022060401/5f0e2c707e708231d43df63d/html5/thumbnails/13.jpg)
PISA Science Findings
13
• Student performance is substantially stronger in classes where teachers: Explain scientific ideas frequently Frequently adapt lessons to students’
needs and knowledge • Student performance is substantially
stronger in schools that: Offer extracurricular science activities
(such as clubs) Sponsor science competitions
![Page 14: 2015 Massachusetts PISA Results2015 PISA in Brief 4 In 2015, over half a million students… - Representing 28 million 15-year-olds in 72 countries/economies … took an internationally](https://reader033.fdocuments.us/reader033/viewer/2022060401/5f0e2c707e708231d43df63d/html5/thumbnails/14.jpg)
14
• About PISA • PISA Aggregate Results • PISA Results Disaggregated • Policy & Practice
Implications
![Page 15: 2015 Massachusetts PISA Results2015 PISA in Brief 4 In 2015, over half a million students… - Representing 28 million 15-year-olds in 72 countries/economies … took an internationally](https://reader033.fdocuments.us/reader033/viewer/2022060401/5f0e2c707e708231d43df63d/html5/thumbnails/15.jpg)
PISA MA Highlights
15
• Compared to 2012 (not all are statistically significant) Hispanic performance improved in all
3 subjects African-American performance
improved in science & reading Gender gap in reading narrowed Asian performance declined in all 3
subjects
![Page 16: 2015 Massachusetts PISA Results2015 PISA in Brief 4 In 2015, over half a million students… - Representing 28 million 15-year-olds in 72 countries/economies … took an internationally](https://reader033.fdocuments.us/reader033/viewer/2022060401/5f0e2c707e708231d43df63d/html5/thumbnails/16.jpg)
90th, 50th, and 10th percentile scores on the 2015 PISA assessment
Massachusetts Department of Elementary and Secondary Education
16
![Page 17: 2015 Massachusetts PISA Results2015 PISA in Brief 4 In 2015, over half a million students… - Representing 28 million 15-year-olds in 72 countries/economies … took an internationally](https://reader033.fdocuments.us/reader033/viewer/2022060401/5f0e2c707e708231d43df63d/html5/thumbnails/17.jpg)
“Resilience” Percent of students in the bottom quarter of the OECD economic, social, & cultural status index who scored in top quarter of the PISA 2015 science assessment
Massachusetts Department of Elementary and Secondary Education
17
![Page 18: 2015 Massachusetts PISA Results2015 PISA in Brief 4 In 2015, over half a million students… - Representing 28 million 15-year-olds in 72 countries/economies … took an internationally](https://reader033.fdocuments.us/reader033/viewer/2022060401/5f0e2c707e708231d43df63d/html5/thumbnails/18.jpg)
PISA MA Highlights
18
• Compared to 2012 (not all are statistically significant) Higher poverty schools largely
improved in all three subjects The lowest poverty schools (less
than 10 % free/reduced lunch) declined in all three subjects
![Page 19: 2015 Massachusetts PISA Results2015 PISA in Brief 4 In 2015, over half a million students… - Representing 28 million 15-year-olds in 72 countries/economies … took an internationally](https://reader033.fdocuments.us/reader033/viewer/2022060401/5f0e2c707e708231d43df63d/html5/thumbnails/19.jpg)
PISA Science: Gender Findings
19
• No gender gap in MA science performance
• MA girls (36%) more likely than boys (30%) to expect to pursue science-related career Higher than OECD Lower than US
![Page 20: 2015 Massachusetts PISA Results2015 PISA in Brief 4 In 2015, over half a million students… - Representing 28 million 15-year-olds in 72 countries/economies … took an internationally](https://reader033.fdocuments.us/reader033/viewer/2022060401/5f0e2c707e708231d43df63d/html5/thumbnails/20.jpg)
20
• About PISA • PISA Aggregate Results • PISA Results Disaggregated • Policy & Practice
Implications
![Page 21: 2015 Massachusetts PISA Results2015 PISA in Brief 4 In 2015, over half a million students… - Representing 28 million 15-year-olds in 72 countries/economies … took an internationally](https://reader033.fdocuments.us/reader033/viewer/2022060401/5f0e2c707e708231d43df63d/html5/thumbnails/21.jpg)
PISA Policy Implications (from the International Data)
21
• Commitment to universal achievement • Incentive structures & accountability • Capacity at point of delivery • Coherence • Learning system • Resources where they yield most • Gateways, instructional systems
![Page 22: 2015 Massachusetts PISA Results2015 PISA in Brief 4 In 2015, over half a million students… - Representing 28 million 15-year-olds in 72 countries/economies … took an internationally](https://reader033.fdocuments.us/reader033/viewer/2022060401/5f0e2c707e708231d43df63d/html5/thumbnails/22.jpg)
PISA Policy Implications
22
Aligned incentive structures & accountability
• Students Gateways Incentives to study hard
• Teachers Continuous individual improvement Collective responsibility
![Page 23: 2015 Massachusetts PISA Results2015 PISA in Brief 4 In 2015, over half a million students… - Representing 28 million 15-year-olds in 72 countries/economies … took an internationally](https://reader033.fdocuments.us/reader033/viewer/2022060401/5f0e2c707e708231d43df63d/html5/thumbnails/23.jpg)
PISA Policy Implications
23
Capacity at point of delivery • Class size versus student/teacher
ratio • Large class size (e.g., Singapore,
China, Vietnam) coupled with low student/teacher ratio yields more time for: Teacher development Teacher collaboration Customized student intervention
![Page 24: 2015 Massachusetts PISA Results2015 PISA in Brief 4 In 2015, over half a million students… - Representing 28 million 15-year-olds in 72 countries/economies … took an internationally](https://reader033.fdocuments.us/reader033/viewer/2022060401/5f0e2c707e708231d43df63d/html5/thumbnails/24.jpg)
PISA Policy Implications
24
Learning system • Rigorous, coherent, focused learning
standards Progression to mastery Supported by instructional system
• Characterized by Policy alignment and coherence Consistency and fidelity of
implementation
![Page 25: 2015 Massachusetts PISA Results2015 PISA in Brief 4 In 2015, over half a million students… - Representing 28 million 15-year-olds in 72 countries/economies … took an internationally](https://reader033.fdocuments.us/reader033/viewer/2022060401/5f0e2c707e708231d43df63d/html5/thumbnails/25.jpg)
PISA Policy Implications
25
Resources where they yield most • Alignment of resources with key
challenges Japan, Singapore, & China tie
teacher advancement to willingness to move to higher challenge assignments
• Effective spending choices that prioritize teacher efficacy over smaller classes
![Page 26: 2015 Massachusetts PISA Results2015 PISA in Brief 4 In 2015, over half a million students… - Representing 28 million 15-year-olds in 72 countries/economies … took an internationally](https://reader033.fdocuments.us/reader033/viewer/2022060401/5f0e2c707e708231d43df63d/html5/thumbnails/26.jpg)
PISA Policy Implications
26
• Capable central authority with authority to act
• Robust mechanisms for tackling low performance
![Page 27: 2015 Massachusetts PISA Results2015 PISA in Brief 4 In 2015, over half a million students… - Representing 28 million 15-year-olds in 72 countries/economies … took an internationally](https://reader033.fdocuments.us/reader033/viewer/2022060401/5f0e2c707e708231d43df63d/html5/thumbnails/27.jpg)
PISA Science Implications
27
• Ensure that teachers: Explain scientific ideas frequently Adapt lessons to students’ needs
and knowledge • Promote: Extracurricular science activities
(such as clubs) Science competitions
![Page 28: 2015 Massachusetts PISA Results2015 PISA in Brief 4 In 2015, over half a million students… - Representing 28 million 15-year-olds in 72 countries/economies … took an internationally](https://reader033.fdocuments.us/reader033/viewer/2022060401/5f0e2c707e708231d43df63d/html5/thumbnails/28.jpg)
PISA Science Implications
28
• Support widespread engagement with science while aiming for scientific excellence
• Improve both skills and attitudes • Challenge gender stereotypes of STEM
occupations
![Page 29: 2015 Massachusetts PISA Results2015 PISA in Brief 4 In 2015, over half a million students… - Representing 28 million 15-year-olds in 72 countries/economies … took an internationally](https://reader033.fdocuments.us/reader033/viewer/2022060401/5f0e2c707e708231d43df63d/html5/thumbnails/29.jpg)
PISA Testing Finding
29
• MA and US fall in middle of frequency of mandatory testing among high-performing systems.
• In other nations, mandatory testing is often high stakes for students and not for educators
![Page 30: 2015 Massachusetts PISA Results2015 PISA in Brief 4 In 2015, over half a million students… - Representing 28 million 15-year-olds in 72 countries/economies … took an internationally](https://reader033.fdocuments.us/reader033/viewer/2022060401/5f0e2c707e708231d43df63d/html5/thumbnails/30.jpg)
OECD/PISA for Schools
30
• Individual school feedback Performance Practice & policies
• Network with other schools MA schools meet summer 2017 US schools meet fall 2017
• Offered internationally 17 MA high schools committed Approximately 30 considering MA participation underwritten by
foundations