Post on 21-Jan-2018
Kristen DiCerbo, Ph.D.Vice-President, Education Research@KristenDiCerbo
July 2017Image by Ruben Alvarado
Building Engaging Games for Learning and Assessment
Game-Based Assessment
2
2
3
The ability to capture data from everyday events should fundamentally change how we think about learning and assessment.
4
New Ways of Thinking
5
Item Paradigm Activity Paradigm
Problem Formulation Items pose questions Activities request action
Output Items have answers Activities have features
Interpretation Items indicate correctness Activities provide attributes
Information Items provide focused information Activities provide multi-dimensional information
Some Things We’ve Figured Out
6
You need assessment experts, content experts, and game designers
Some Things We’ve Figured Out
7
Evidence-Centered Design works… sort of
Some Things We’ve Figured Out
8
The process must be iterative
Some Things We’ve Figured Out
9
Think About Systems
5 Key Elements
10
10
Domain and Student Models
11
Task Model
12
Evidence Model – Evidence Identification and Scoring
13
Evidence Model – Evidence Identification and Scoring
14
Student Time Attempts Mean Space
Median Space
Min Space
Evidence Model – Evidence Accumulation
15
Communication
16
Some Things We Haven’t Figured Out
17
■ Despite promises of “hundreds of data points,” we always end up with relatively few in our measurement models. Why is that?
■ How do we define evidence for validity and reliability?
■ How do we scale development?▪ Costs▪ Time▪ Staff