CCT Certification Process 2012 NCSLI Workshop and Symposium Shawn Mason.

CCT Certification Process2012 NCSLI Workshop and Symposium

Shawn Mason

Boston Scientific Confidential -- For Internal Use Only. Do Not Copy, Display or Distribute Externally 2

CCT Certification Process

Topics Covered:• The four steps in the Test Development process• The objectives of the Test Specification, Item Writing,

Item Review, and Exam Review workshops• Steps in how to prepare and pass the CCT Exam• Recertification Process

Boston Scientific Confidential -- For Internal Use Only. Do Not Copy, Display or Distribute Externally


Training Objectives and Lessons Learned:• Gain a better understanding of the development process• Have the tools to prepare and pass the CCT exam• Know what to do to maintain your certification



Background:• ASQ certification is a formal recognition by ASQ that an

individual has demonstrated a proficiency, and comprehension of a specific body of knowledge.

• Certified Calibration Technician tests, calibrates, maintains and repairs electrical, mechanical, electromechanical, analytical and electronic measuring, recording and indicating instruments and equipment for conformance to established standards.

4



Background Continued:• Many industry job description and education

requirements for a Metrologist or Engineer include the following:

• 2 year (AAS) degree in Metrology Engineering or equivalent education or military training

• Four year degree with course in Physics and Algebra • (CCT) Certified Calibration Technician

5



Background Continued:• Fourteen steps in the Test Development process• 50 (SME) Subject Matter Experts are involved in some

phase of the exam development process• First step is to recruit qualified individuals, then

maintain their status • Attended four Workshops in the Test Development

process: Test Specification, Item Writing, Item Review and Exam Review

6



Volunteers:• Recruit qualified individuals• Certified in a specific exam (CCT)• Provide valuable input• Ability to attend complete

2-day workshop session

7



Volunteers Continued:• Good team and communication skills• New and experienced volunteers• Not teaching/authoring exam review materials• Many Industries (Diversity)

8



Certification vs Certificate:

ASQ Certification Training Certificate

Requires passing an exam based on a body of knowledge

Attending particular training or course by a particular training provider at a particular point in time

Exam formerly administrated under scheduled conditions

Course content as demonstrated by student’s participation and the specific provider’s knowledge assessment method

ASQ Trademarked certification Can be referenced on a resume for a job application

ASQ certifications recognized by 125 corporations

Employee’s recognition of the completed training based on the training provider



Test Specification:

The objective of the Test Specification Workshop is “To use the TASK and KNOWLEDGE identified in the Job Analysis to establish categories of information representing the Body of Knowledge (BOK) required for the certification being tested”.

10



11



Test Specification:• Review (BOK) Body of Knowledge

• Topics and depth for each category

• Review references

• Subtext for each parameter– What will be tested – Not what the candidates need to know– Provide more in depth explanation – Direction for item writers

• Number of questions for each topic

• Topics to be removed



Test Specification Continued:

13



Item Writing:

The objective of the Item Writing Workshop is “To write VALID and RELIABLE items, for use in evaluating a candidate’s knowledge and ability or skill level on a variety of topics”.

14



15



Item Writing:• Review Item Writing Manual

• Comprehensive collection of

instructions and information

• Verify validity of the question– Test question classification, reference,

and rationale

• Items (question) for each (BOK)

• Write extra questions for future exams



Item Review:

The objective of the Item Review Workshop is “To ensure the quality of newly created items, as well as items rejected in subsequent reviews”.

17



18



Item Review:• Review raw question • Verify part of (BOK) Body of Knowledge• Verify and update the reference • Rewrite items• Verify only one correct answer• Reviewing item for clarity, accuracy, appropriateness, and

diversity



Exam Review:

The objective of the Exam Review Workshop is “To produce a final exam that meets the test specification and accepted assessment standards”.

20



21



Exam Review:• Take two exams

• Same number of questions

• Same time frame

• Same open book references– Fill out comments– Note if more than one correct answer– Verify references

Maintain Reliability:• Test Length• Consistency in Test Administration• Clarity of the Questions• Appropriateness of the Questions



Maintain Reliability Continued:• Equators

• Control measure• 25 to 30 questions from previous exam

Problem items:• Test questions reviewed• Score all • Remove



Slide 54 of 84

Problem Item

5th

4th

3rd

2nd

1st

10% 25% 50% 75% 100%Percent Correct

Qui

ntile

s



Slide 51 of 84

Good Item

5th

4th

3rd

2nd

1st

10% 25% 50% 75% 100%Percent Correct

Qui

ntile

s



CCT Prep for Exam: • CCT Primer Book, Quiz CD and the Solutions Text

from the Quality Council of Indiana• Other possible CCT resources:

Workplace Training @ wptraining.com, ASQ @ ASQ.org, Emc3 Solutions www.emc3solutions.com, Gary Meyer @ [email protected].

• ASQ Website to review Body of Knowledge, References, and purchase the appropriate Reference Materials

27



CCT Prep for Exam Continued:• Study and take quizzes • Take quiz in lowest question amount first • Work your way up to 25-30 questions• Complete all sections• Study time should be about 2-3 times a week for 2-3

months to cover all of the material

28



CCT Prep for Exam Continued:• 3 Day Refresher class (just before the Exam)• Practice the full exam without the primer questions

(just before the exam)

29



CCT Prep for Exam Continued:• Organize your reference materials by tabbing each

section per the BOK• Bring the following minimum reference materials:

NCSLI Z540-1, ISO/IEC 17025, Metrology Handbook, Fluke Calibration Philosophy in Practice, Measure for Measure ISBN 188979600X (units of measure), primer book without the quizzes (have index ready), and a designated calculator• List of NCSLI RP’s

30



CCT Prep for Exam Continued:• Easy questions first and save the hard ones for last• Always go with your first instinct

31



Maintaining your Certification:• ASQ requires that you recertify every three years,

either by journal or exam • Recertification by RU is a process of obtaining a

minimum of 18 recertification units (RU’s) within a three year period

32



Maintaining your Certification Continued:

The certification journal is listed on the ASQ Website, www.asq.org.

33




Example Journal:

Full Time Employment 10.8 RUs

Company sponsored training (2) 6.0 RUs

ASQ or NCSLI section meetings (3 per qtr) 2.7 RUs

Total 19.5 RUs

34




35




36



Questions?

37

CCT Certification Process 2012 NCSLI Workshop and Symposium Shawn Mason.

Documents

Transcript of CCT Certification Process 2012 NCSLI Workshop and Symposium Shawn Mason.