Designing Classroom Tests: 6 Critical Questions

39
Designing Classroom Language Tests: 6 Cri&cal Ques&ons Eddy White, Ph.D. Assessment Coordinator Center for English as a Second Language University of Arizona

description

This slide show was used for classroom based assessment teacher training at Universidad del Norte in Barranquilla, Colombia (April, 2012).

Transcript of Designing Classroom Tests: 6 Critical Questions

Page 1: Designing Classroom Tests: 6 Critical Questions

DesigningClassroom

LanguageTests:6Cri&calQues&ons

EddyWhite,Ph.D.AssessmentCoordinator

CenterforEnglishasaSecondLanguage

UniversityofArizona

Page 2: Designing Classroom Tests: 6 Critical Questions
Page 3: Designing Classroom Tests: 6 Critical Questions

Thegoalofassessmentisto...

Page 4: Designing Classroom Tests: 6 Critical Questions

The goal of assessment has to be, above all, to support the improvement of

learning and teaching.

(Fredrickson&Collins,1989)

Page 5: Designing Classroom Tests: 6 Critical Questions

2010

Bestresourceforclassroom‐basedassessmentfor

ESL/EFL

[Source]

Page 6: Designing Classroom Tests: 6 Critical Questions
Page 7: Designing Classroom Tests: 6 Critical Questions

Whatisatest?

Page 8: Designing Classroom Tests: 6 Critical Questions

:theword‘test’

•  canrefertotradiPonal‘paperandpencil’orcomputerbasedtests(e.g.mulPplechoice,fill‐ins,shortanswers,essays,etc.)

•  or‘performanceassessments’(presentaPons,projects,interviews,orotheralternaPveassessments)

Page 9: Designing Classroom Tests: 6 Critical Questions

Atest...•  isamethodofmeasuringaperson’sability,knowledge,orperformanceinagivendomain.

•  isaninstrument–asetoftechniques,procedures,oritems–thatrequiresperformanceonthepartofthetest‐taker.

Page 10: Designing Classroom Tests: 6 Critical Questions

Tests–measuringfunc&on

Page 11: Designing Classroom Tests: 6 Critical Questions

Atestmustmeasure•  Sometestsmeasuregeneralability,whileothersfocusonveryspecificcompetenciesorobjecPves.

•  Examples

•  AmulP‐skillproficiencytestmeasuresgeneralability;

•  aquizonrecognizingcorrectuseofdefinitearPclesmeasuresveryspecificknowledge.

Page 12: Designing Classroom Tests: 6 Critical Questions

•  Atestmeasuresperformance,...

• but,theresultsimplythetest‐takersability,orcompetence.

Page 13: Designing Classroom Tests: 6 Critical Questions

•  Performance‐basedtestssamplethetest‐takersactualuseoflanguage,

•  butfromthosesamplesthetestadministratorinfersgeneralcompetence.

Page 14: Designing Classroom Tests: 6 Critical Questions

•  Awell‐constructedtestisaninstrumentthatprovidesanaccuratemeasureofatest‐taker’sabilitywithinaparPculardomain.

•  Construc&ngagoodtestisacomplextask.

Page 15: Designing Classroom Tests: 6 Critical Questions

TestsareessenPalcomponentsofa

successfulcurriculum.

Page 16: Designing Classroom Tests: 6 Critical Questions
Page 17: Designing Classroom Tests: 6 Critical Questions

‘Assessmentneedstobe‘fitforpurpose’

Page 18: Designing Classroom Tests: 6 Critical Questions

Assessmentisanareawherecontextisofparamountimportance.

(Brown&Abeywickrama,2010)

 Assessmentthatisfitforpurposeusesthebestmethodsofassessmentappropriateto:

 ‐thecontext  ‐thestudents  ‐thelevel  ‐thesubject  ‐theinsPtuPon

Page 19: Designing Classroom Tests: 6 Critical Questions

DesigningClassroomLanguageTests:6CriPcalQuesPons

Page 20: Designing Classroom Tests: 6 Critical Questions

ThesesixquesPonsshouldformthebasisofyourapproachtodesigning,administering,andmakingmaximumuseoftestsinyourclassroom.

Page 21: Designing Classroom Tests: 6 Critical Questions

1.Whatisthepurposeofthetest?

Page 22: Designing Classroom Tests: 6 Critical Questions

1.TestPurpose?•  WhyareyoucreaPngthistest,orwhywasitcreatedbyatextbookwriter.

•  WhatisitssignificancerelaPvetoyourcourse(forexample,toevaluateoverallproficiencyorplaceastudentinacourse)?

•  Howimportantisthetestcomparedtootherstudentperformance?

•  Whatwillitsimpactbeonyouandyourstudentsbeforeanda`ertheassessment?

Page 23: Designing Classroom Tests: 6 Critical Questions

Onceyouhaveestablishedthemajorpurposeofatest,itthenbecomeseasier

tospecifyitsobjecPves.

Page 24: Designing Classroom Tests: 6 Critical Questions

2.Whatarethe

objecPvesofthetest?

Page 25: Designing Classroom Tests: 6 Critical Questions

2.Testobjec&ves?

• Whatexactlyareyoutryingtofindout?

• Whatlanguageknowledgeand/orskillsareyouassessing?

Page 26: Designing Classroom Tests: 6 Critical Questions

3.HowwillthetestspecificaPonsreflectboththepurposeandtheobjecPves?

Page 27: Designing Classroom Tests: 6 Critical Questions

3.Testspecifica&ons?•  Todesignorevaluateatest,youmustmakesurethatthetesthasastructurethatlogicallyfollowsfromtheunitorlessonitistesPng.

•  TheclassobjecPvesshouldbepresentinthetestthroughappropriatetasktypesandweights,alogicalsequence,andavarietyoftasks.

Page 28: Designing Classroom Tests: 6 Critical Questions

4.Howwillthetestitemtypes

(tasks)beselectedandtheseparate

itemsarranged?

Page 29: Designing Classroom Tests: 6 Critical Questions

4.Selec&on&ArrangementofTasks?

•  ThetesttasksneedtobepracPcal.•  Forthetesttobevalid,theyshouldalsomirrortasksofthecourse,lessonorsegment.

•  TheyshouldbeauthenPc(i.e.reflectreal‐worldlanguageuse).

•  Thetasksmustbeonesthatcanbeevaluatedreliablybytheteacher.

Page 30: Designing Classroom Tests: 6 Critical Questions

5.Inadministeringthetest,whatdetailsshouldI

ahendtoinordertohelpstudentsachievetheirbestperformance?

Page 31: Designing Classroom Tests: 6 Critical Questions

5.HelpingStudentsAchieveBestPerformance?

•  Oncethetesthasbeencreatedandisreadytoadminister,studentsneedtofeelwellpreparedfortheirperformance.

•  AnotherwiseeffecPve,validtestmightfailtoreachitsgoalifthecondiPonsfortesttakingareinadequatelyestablished.

•  Howwillyoureduceunnecessaryanxietyinstudents?

•  Howwillyouraisetheirconfidence?•  Howwillyouhelpthemviewthetestasanopportunitytolearn?

Page 32: Designing Classroom Tests: 6 Critical Questions

6.Whatkindofscoring,

grading,and/orfeedbackisexpected?

Page 33: Designing Classroom Tests: 6 Critical Questions

6.Scoring,Grading,Feedback?

•  Theappropriateformoffeedbackontestswillvary,dependingonthepurpose.

•  Foreverytest,thewayresultsarereportedisanimportantconsideraPon.

•  Undersomecircumstances,alehergradeorscoremaybeappropriate.

•  Othercircumstancesmayrequirethattheteacherprovidedetailedfeedbacktothestudents.

Page 34: Designing Classroom Tests: 6 Critical Questions

DesigningClassroomLanguageTests:6CriPcalQuesPons

Page 35: Designing Classroom Tests: 6 Critical Questions

ThesesixquesPonsshouldformthebasisofyourapproachtodesigning,administering,andmakingmaximumuseoftestsinyourclassroom.

Page 36: Designing Classroom Tests: 6 Critical Questions
Page 37: Designing Classroom Tests: 6 Critical Questions
Page 38: Designing Classroom Tests: 6 Critical Questions

2010[Source]

Page 39: Designing Classroom Tests: 6 Critical Questions

DesigningClassroom

LanguageTests:6Cri&calQues&ons

EddyWhite,Ph.D.AssessmentCoordinator

CenterforEnglishasaSecondLanguage

UniversityofArizona