Developing Systems of Assessment - National Academies
Transcript of Developing Systems of Assessment - National Academies
![Page 1: Developing Systems of Assessment - National Academies](https://reader030.fdocuments.us/reader030/viewer/2022012505/6180bd20446f79579f7c518d/html5/thumbnails/1.jpg)
NRC Workshop
Washington, DC– September 13, 2012
Joan Herman
Developing Systems of
Assessment
![Page 2: Developing Systems of Assessment - National Academies](https://reader030.fdocuments.us/reader030/viewer/2022012505/6180bd20446f79579f7c518d/html5/thumbnails/2.jpg)
2 / 17
• Assessment systems: two views
• Examples of each
• Validity issues
• Implementation challenges
Overview
![Page 3: Developing Systems of Assessment - National Academies](https://reader030.fdocuments.us/reader030/viewer/2022012505/6180bd20446f79579f7c518d/html5/thumbnails/3.jpg)
3 / 17
Systems Serving Multiple Purposes
1. Formative: Integrate instruction and
assessment to facilitate significant science
learning
2. Summative: multiple measures to provide
comprehensive, standards-based view
3. Multi-level: feedback to serve accountability
and improvement for multiple stakeholders
![Page 4: Developing Systems of Assessment - National Academies](https://reader030.fdocuments.us/reader030/viewer/2022012505/6180bd20446f79579f7c518d/html5/thumbnails/4.jpg)
4 / 17
Coherent Systems: Formative and
Summative
Formative Assessment
Interim
End of the Year Assessment
Builds K–12 to College Readiness
Student
![Page 5: Developing Systems of Assessment - National Academies](https://reader030.fdocuments.us/reader030/viewer/2022012505/6180bd20446f79579f7c518d/html5/thumbnails/5.jpg)
5 / 17
Examples of Integrated Systems
• SimScientists
• IQWST
• 3-Dimensional Fused Knowledge
• Display-based reasoning
• AP Exam
![Page 6: Developing Systems of Assessment - National Academies](https://reader030.fdocuments.us/reader030/viewer/2022012505/6180bd20446f79579f7c518d/html5/thumbnails/6.jpg)
6 / 17
Validity Criteria for Coherent
Formative Systems
• Focused on rich goals
• Learning-based
• Aligned/coherent
• Reliable
• Valid
• Accessible/fair
• Diagnostic
• Actionable
• Credible/meaningful
• Consequences
![Page 7: Developing Systems of Assessment - National Academies](https://reader030.fdocuments.us/reader030/viewer/2022012505/6180bd20446f79579f7c518d/html5/thumbnails/7.jpg)
Coherence: Accountability and Classroom
Evidence
Summative
Task/Project
Student
Formative
Assessment
Formative
Assessment
Summative
Task/Project
Summative
Task/Project
Summative
Task/Project
Formative
Assessment
Formative
Assessment
may tell us more
about student
capability.
Combination of
year long work
![Page 8: Developing Systems of Assessment - National Academies](https://reader030.fdocuments.us/reader030/viewer/2022012505/6180bd20446f79579f7c518d/html5/thumbnails/8.jpg)
8 / 17
System Examples Combining
Classroom and On-Demand Tasks
• RI Diploma System
• Queensland
• Both rely largely on educator judgment
![Page 9: Developing Systems of Assessment - National Academies](https://reader030.fdocuments.us/reader030/viewer/2022012505/6180bd20446f79579f7c518d/html5/thumbnails/9.jpg)
9 / 17
Rhode Island High School
Diploma Requirement (2014)
• District designed, standards aligned
• Proficiency requirements, based on two of three:
Exhibition
Portfolio
Comprehensive end of course exams
• State assessment score at least partially proficient
• Rigorous criteria and quality control
![Page 10: Developing Systems of Assessment - National Academies](https://reader030.fdocuments.us/reader030/viewer/2022012505/6180bd20446f79579f7c518d/html5/thumbnails/10.jpg)
10 / 17
Portfolio Tasks
• Variety of task types
On-demand task
Extended task
Mini-exhibition
Exhibition
• Developmental progression/rigor
Classroom
School
PBGR
![Page 11: Developing Systems of Assessment - National Academies](https://reader030.fdocuments.us/reader030/viewer/2022012505/6180bd20446f79579f7c518d/html5/thumbnails/11.jpg)
11 / 17
Exhibition: Senior Project
• Applied learning goals:
Problem solving
Communication tools and techniques
ICT tools and techniques
Self management
• Personalized, choice
• Project examples: Core question -design a
product/service, improve a system, trouble shoot,
plan and organize an event/activity
![Page 12: Developing Systems of Assessment - National Academies](https://reader030.fdocuments.us/reader030/viewer/2022012505/6180bd20446f79579f7c518d/html5/thumbnails/12.jpg)
12 / 17
Queensland Senior Certificate
• State establishes content standards/goals for 2-year syllabus
in each content area
• Local schools develop specific, locally adapted course of
work, specifying content, instruction and assessment
(formative and summative) activities
• Local course accredited by external review board
• Teachers evaluate their students on a 5-point standards-
based scale
• Teacher ratings reviewed through moderation cycles
• General, standardized test supports moderation and
comparability
![Page 13: Developing Systems of Assessment - National Academies](https://reader030.fdocuments.us/reader030/viewer/2022012505/6180bd20446f79579f7c518d/html5/thumbnails/13.jpg)
13 / 17
Queensland Assessment
• Varied task types:
Extended experimental investigations: 4 weeks +
Extended response tasks involving research and
secondary data: 2 weeks +
Supervised (on-demand) tasks
• Curriculum-based, formative activities, with
feedback, build to summative success
![Page 14: Developing Systems of Assessment - National Academies](https://reader030.fdocuments.us/reader030/viewer/2022012505/6180bd20446f79579f7c518d/html5/thumbnails/14.jpg)
14 / 17
Queensland Assessment
• 11th
grade “monitoring” tasks build to more
demanding 12th
grade “verification” tasks
• Final assessment based on work products
distributed over time
• Exit standards assessed through principles of
fullness (fully represent expected standards)
Latest (recent accomplishment supercedes)
![Page 15: Developing Systems of Assessment - National Academies](https://reader030.fdocuments.us/reader030/viewer/2022012505/6180bd20446f79579f7c518d/html5/thumbnails/15.jpg)
15 / 17
Validity Criteria for Multi-purpose
Systems
• Meaningful, transferable scientific knowledge,
practices and predispositions
• 3 C’s: Comprehensive, Coherent, Continuous
• Instructionally sensitive
• Valid/fair for each intended purpose
• Useable/useful for intended purposes
• Feasible
• Consequences
![Page 16: Developing Systems of Assessment - National Academies](https://reader030.fdocuments.us/reader030/viewer/2022012505/6180bd20446f79579f7c518d/html5/thumbnails/16.jpg)
16 / 17
Challenges in Moving Ahead
• Coherence of standards’ tri-part progression
• Availability of instructional resources
• Teacher capacity
• Technical dilemmas
• Socio-political dispositions