PADI: Principled Assessment Designs for Inquiry · PADI: Principled Assessment Designs for Inquiry...
Transcript of PADI: Principled Assessment Designs for Inquiry · PADI: Principled Assessment Designs for Inquiry...
PADI: Principled Assessment Designs for Inquiry Geneva Haertel, PI
SRI International
This material is based upon work supported by the National Science Foundation under Grant No. REC-0129331. Any opinions, findings, and conclusions or recommendations expressed in this material are those of the author(s) and do not necessarily reflect the views of the National Science Foundation.
ACKNOWLEDGMENTS
P A D I
M I C H I G A NM I C H I G A N
Robert J. Mislevy, PIUniversity of Maryland
General Specific
Student Model
Evidence Model
Task Model
Development of FOSS/ASK Assessments Using the PADI Design System
PADI Gradebook
Student Database
Task Specs
Assessment Management Information
Instantiated Tasks
Repository
PADI Scoring Engine
PADI Calibration
Engine
Assessment Delivery System
(4 process model)
Assessment Authoring
System
Concrete Tasks
scoresscores +
design info
PADI Design System is used to:• Articulate the purpose and rationale of a
particular assessment• Develop design patterns, task templates, and task
specifications detailing the qualities required in the assessment tasks
Authoring System is used to:• Generate instantiated tasks that will be delivered
to students following the task specifications• Calibrate instantiated tasks before widespread
administration
Assessment Delivery System is used to:• Present tasks to students and gather student
responses• Evaluate student work and compute estimates of
student proficiency or access separate applications to perform those functions
• Update the Student Database with new proficiency estimates
Kathy LongFOSS Project,
Lawrence Hall of Science
Cathleen Kennedy & Mark WilsonUniversity of California,
Berkeley
Nancy Butler SongerBioKIDS Project,
University of Michigan
Assessment Design and Implementation
Using PADI ToolsAbility to plan investigations
Ability to gather and organize data
Multidimensional Item Response
Modeling
Some dichotomous and some partial credit responses
Materials include sample lab report to be
evaluated by student
Grade level will determine complexity
of items
Multiple choice items and short constructed
responses
Ability to interpret data and build explanations
Evaluation Phase
Observable Variables
Measurement Model
Materials and Presentation
Work Products
Student Model with Three Proficiencies
PADI Scoring Engine
PADI Gradebook
ScoredResponse
ScoredResponseScored
Response
Scored Responses of Students
Derived from the Principles of Scientific Inquiry Design Pattern Derived from Student Model, Activities, and Task Specifications
Update
ScoredResponse
NSF REC Grant #0129331
PADI Design Products
Repository
Student Model
Flow of Design Decisions
PADI Design System
Project site: http://padi.sri.com/
ScoredResponse
Implementation