Kristen DiCerbo, Ph.D.Vice-President, Education Research@KristenDiCerbo

July 2017Image by Ruben Alvarado

Building Engaging Games for Learning and Assessment

Game-Based Assessment

2

2

3

The ability to capture data from everyday events should fundamentally change how we think about learning and assessment.

4

New Ways of Thinking

5

Item Paradigm Activity Paradigm

Problem Formulation Items pose questions Activities request action

Output Items have answers Activities have features

Interpretation Items indicate correctness Activities provide attributes

Information Items provide focused information Activities provide multi-dimensional information

Some Things We’ve Figured Out

6

You need assessment experts, content experts, and game designers

Some Things We’ve Figured Out

7

Evidence-Centered Design works… sort of

Some Things We’ve Figured Out

8

The process must be iterative

Some Things We’ve Figured Out

9

Think About Systems

5 Key Elements

10

10

Domain and Student Models

11

Task Model

12

Evidence Model – Evidence Identification and Scoring

13

Evidence Model – Evidence Identification and Scoring

14

Student Time Attempts Mean Space

Median Space

Min Space

Evidence Model – Evidence Accumulation

15

Communication

16

Some Things We Haven’t Figured Out

17

■ Despite promises of “hundreds of data points,” we always end up with relatively few in our measurement models. Why is that?

■ How do we define evidence for validity and reliability?

■ How do we scale development?▪ Costs▪ Time▪ Staff