Michael B. Bunch
23
Michael B. Bunch onstruct Maps In Acti
description
Construct Maps In Action. Michael B. Bunch. Three Applications of Construct Maps. Body of Work Bookmark Something Else. Body of Work. MEAP Writing Grades 4 and 7 (2011) MEAP-Access Writing (2012) Body of Work with Construct Maps BoW/CM : BoW :: Bookmark : Angoff. Round 1. - PowerPoint PPT Presentation
Transcript of Michael B. Bunch
Michael B. Bunch
Construct Maps In Action
Three Applicationsof Construct Maps
•Body of Work
•Bookmark
•Something Else
Body of Work
• MEAP Writing Grades 4 and 7 (2011)• MEAP-Access Writing (2012)• Body of Work with Construct Maps• BoW/CM : BoW :: Bookmark : Angoff
Round 1Round 1
Work SampleScale Score C1/2 C2/3
W1 120
130
W2 140
150
160
W3 170
W4, W5 180
190
W6 200
210
W7, W8 220
After Round 1Round 1
Work SampleScale Score C1/2 C2/3
W1 120
130 R1
W2 140 R8
150 R3, R4
W3 160 R2
170 R5, R6, R9
W4, W5 180 R1, R2
190 R7 R3, R5, R7
W6 200 R4, R8
210 R9
W7, W8 220 R6
After Round 1Round 1
Work SampleScale Score C1/2 C2/3
W1 120
130 R1
W2 140 R8
150 R3, R4
W3 160 R2
170 R5, R6, R9
W4, W5 180 R1, R2
190 R7 R3, R5, R7
W6 200 R4, R8
210 R9
W7, W8 220 R6
Round 2
PACRound 2
Work SampleRound 1
Work SampleScale Score C1/2 C2/3
99 W1 120
91 W31 130
83 W2 140
77 W32, W33 150
71 W34, W35 W3 160
63 W36 170
52 W4, W5 180
41 W37 190
33 W38 W6 200
18 W39 210
10 W7, W8 220
After Round 2
PACRound 2
Work SampleRound 1
Work SampleScale Score C1/2 C2/3
99 W1 120
91 W31 130 R1
83 W2 140 R8
77 W32, W33 150 R3, R4
71 W34, W35 W3 160 R2
63 W36 170 R5, R6, R9
52 W4, W5 180 R1, R2
41 W37 190 R7 R3, R5
33 W38 W6 200 R4, R7, R8
18 W39 210 R9
10 W7, W8 220 R6
After Round 2
PACRound 2
Work SampleRound 1
Work SampleScale Score C1/2 C2/3
99 W1 120
91 W31 130 R1
83 W2 140 R8
77 W32, W33 150 R3, R4
71 W34, W35 W3 160 R2
63 170 R5, R6, R9
52 W36 W4, W5 180 R1, R2
41 W37 190 R7 R3, R5
33 W38 W6 200 R4, R7, R8
18 W39 210 R9
10 W7, W8 220 R6
Bookmark
1. MEAP-Access Reading/Math 3-82. Bookmark with Construct Maps
Round 1
ItemScale Score C1/2 C2/3
1 110
2 120
3 130
140
4 150
5 160
170
180
6 190
7 200
210
8 220
9 230
After Round 1
ItemScale Score C1/2 C2/3
1 110
2 120 R1, R2
3 130 R3
140
4 150 R4, R5
5 160 R6
170 R2, R3
180 R7, R9 R1
6 190 R5, R6
7 200 R8 R4, R7
210 R9
8 220
9 230 R8
After Round 1
ItemScale Score C1/2 C2/3
1 110
2 120 R1, R2
3 130 R3
140
4 150 R4, R5
5 160 R6
170 R2, R3
180 R7, R9 R1
6 190 R5, R6
7 200 R8 R4, R7
210 R9
8 220
9 230 R8
Round 2
PAC ItemScale Score C1/2 C2/3
99 1 110
93 2 120
87 3 130
81 140
74 4 150
69 5 160
61 170
55 180
47 6 190
36 7 200
21 210
10 8 220
5 9 230
After Round 2
PAC ItemScale Score C1/2 C2/3
99 1 110
93 2 120
87 3 130 R1, R3
81 140 R2
74 4 150 R5
69 5 160 R6
61 170 R4, R7
55 180 R9 R1, R3
47 6 190 R8 R2, R5
36 7 200 R7
21 210 R4, R9
10 8 220 R6, R8
5 9 230
After Round 2
PAC ItemScale Score C1/2 C2/3
99 1 110
93 2 120
87 3 130 R1, R3
81 140 R2
74 4 150 R5
69 5 160 R6
61 170 R4, R7
55 180 R9 R1, R3
47 6 190 R8 R2, R5
36 7 200 R7
21 210 R4, R9
10 8 220 R6, R8
5 9 230
Something Else
1. A concept2. Bookmark meets EBSS3. Online
• Order entire pool of items• Create 4–6 OIBs• Select and train panelists by webinar• Deliver OIB online• Complete bookmarks online• Centralize data analysis online• View round results online
Virtual Bookmark+
• Teacher ratings• Course grades• NAEP scores• Other test scores• Expert vs. novice
+ = Validation Information
Round 1OIB
#Bank
ID RP67 V Info
11 4207 -2.47 Mean for D students
12 1936 -2.05
-1.63
13 2779 -1.17 C/D Cut
14 5112 -0.79
15 6329 -0.37
0.05 NAEP Basic
16 2777 0.47
17 1087 0.89
18 5440 1.31 Min. Exp. Grade 5 Ts
1.73 B/C Cut
19 1054 2.15
20 1492 2.58 Mean score for 5th graders
OIB Page
C/D Cut
• Construct maps provide a focus and organization for panelists.
• Construct maps are applicable across a range of methods.
• Construct maps are flexible enough to accommodate a variety of information.
Summary
Michael B. Bunch, Ph.D.Senior Vice PresidentMeasurement Incorporated423 Morris StreetDurham, NC 27701(919) 683-2413 x [email protected]
Session Title: Improving Standard-Setting Processes Through the Use of Construct Maps 2013 National Conference on Student Assessment
Contact Information
