What is CCT?
14
2007 Annual Conference Considerations for Continuous CBT É Grady Colson Barnhill, Directo Recertification & Professional Assessmen Commission on Dietetic Registrat
description
What is CCT?. CBT = Computer-Based Testing CCT = Computerized Classification Test Competent or Not Competent? Focus on measurement precision near cut score Focus on reliability of decision. The Testing Programs. (CBT since 9/1/99). The Testing Programs. - PowerPoint PPT Presentation
Transcript of What is CCT?
2007 Annual Conference
Considerations forContinuous CBTÉ
Grady Colson Barnhill, Director,Recertification & Professional Assessment
Commission on Dietetic Registration
What is CCT?CBT = Computer-Based TestingCCT = Computerized Classification Test
• Competent or Not Competent?• Focus on measurement precision near cut score • Focus on reliability of decision2007 Annual Conference
Council on Licensure, Enforcement and Regulation
Atlanta, Georgia
The Testing Programs
2007 Annual Conference
Council on Licensure, Enforcement and Regulation
Atlanta, Georgia
Program # Items#
Pretest Items
Time allowed
RD 100-120 25 3 hours
DTR 80-100 30 3 hours
(CBT since 9/1/99)
The Testing Programs
2007 Annual Conference
Council on Licensure, Enforcement and Regulation
Atlanta, Georgia2007 Annual Conference
Council on Licensure, Enforcement and Regulation
Atlanta, Georgia
ProgramTotal # Items
Minimum
sec./item
Avg. Item
Latency
RD 125-145 74 sec. 46 sec.
DTR 110-130 83 sec. 51 sec.
The Testing Blueprints
2007 Annual Conference
Council on Licensure, Enforcement and Regulation
Atlanta, Georgia2007 Annual Conference
Council on Licensure, Enforcement and Regulation
Atlanta, Georgia
Content RD DTRFood &
Nutrition15% 10%
Nutrition Srvcs:Commun./
Clinical40% 38%
Educ. (& Research)
7% 7%
Foodservice Sys.
18% 25%
Management 20% 20%
The Testing Programs
2007 Annual Conference
Council on Licensure, Enforcement and Regulation
Atlanta, Georgia2007 Annual Conference
Council on Licensure, Enforcement and Regulation
Atlanta, Georgia2007 Annual Conference
Council on Licensure, Enforcement and Regulation
Atlanta, Georgia
ProgramTotal #
Examinees/yr.
% Passing
RD 4,221 72%
DTR 351 57%
2007 Annual Conference
Council on Licensure, Enforcement and Regulation
Atlanta, Georgia2007 Annual Conference
Council on Licensure, Enforcement and Regulation
Atlanta, Georgia2007 Annual Conference
Council on Licensure, Enforcement and Regulation
Atlanta, Georgia
Sequential Probability Ratio
Test (SPRT)RD DTR
Min. Ability Level -0.69 -0.34
Zone of Indifference +/-0.20 +/-0.20
Acceptable Error Rate
5% 5%
The Pros
Candidates love instant results!
Helps control item exposure (esp. with no review)
Year-round testing provides more flexibility - more locations
Computer testing provides more potential for creativity - fidelity
2007 Annual Conference
Council on Licensure, Enforcement and Regulation
Atlanta, Georgia
2007 Annual Conference
Council on Licensure, Enforcement and Regulation
Atlanta, Georgia
The ConsQuality control usually = once/yr.
Item analysis/review corrective “for next time” - not linked to candidate score
Expense
Sometimes variable-length test seen as disadvantage
2007 Annual Conference
Council on Licensure, Enforcement and Regulation
Atlanta, Georgia
Security Considerations
Innocent Conversations
Internet Brain Dump sites
Test Prep AgenciesTechnology (text
message, camera phones, tie cams)
2007 Annual Conference
Council on Licensure, Enforcement and Regulation
Atlanta, Georgia
Item Exposure Over-exposure of items at popular ability
levels Computer routines to control item over-
exposure (Simpson-Header Control)
2007 Annual Conference
Council on Licensure, Enforcement and Regulation
Atlanta, Georgia
Challenges
•Small sample size = Hard to get sufficient N for item analysis
•Small sample size = Hard to get sufficient N for pretest items
•Small sample size = Hard to get sufficient $ for program
2007 Annual Conference
Council on Licensure, Enforcement and Regulation
Atlanta, Georgia
Text
Future?
•More candidates!
•Dietetics Education Task Force
•Minimum for 3 Parameter = 300?
•Rasch?
Council on Licensure, Enforcement and RegulationAtlanta, Georgia2007 Annual Conference
Speaker Contact InformationThank you for your attention..
Grady Colson Barnhill, Director
Recertification & Professional Assessment
Commission on Dietetic Registration
(312)-899-4768
