TCD20: Creating Tests

Creating Tests

Creating TestsDesigning training for the first time?

[email protected]

v1.0 – Feb 2016

mailto:[email protected]

Creating Tests

TECADI Training Technologies Ltd – FEB 2016. v1.0 2

Is It a Good Idea?Do you need to include a test element in your training?

To what degree participants acquired the intended knowledge and skills

To improve training

To track scores

To check if learning took

place

Track performance for certification

Redesign topics where results are below expectations

Why?

Creating Tests

Define General Design

Create Test

Create Information

BlocksStructure

InformationAdd

InstructionDevelop Training

Implement & Evaluate

Context

3TECADI Training Technologies Ltd – FEB 2016. v1.0

Develop a set of questions for each learning objective...

Online Test _ X

Test Item 1.3

Option 1Option 2Option 3Option 4

Stem

Feedback

Online Test _ X

Test Item 1.2


Stem

Feedback

Online Test _ X

Test Item 1.1


Stem

Feedback

Online Course _ X

Topic 3


Stem

Feedback

Online Course _ X

Topic 2


Stem

Feedback

Online Course _ X

Topic 1

Online Course

This is what you need to learn:

(learning objectives)1.

2.

3.

... and then identify and develop content needed to support each learning objective.

Once you have identified what the audience needs to learn (learning objectives ) ...

1 2 3

Creating tests in the context of a systematic approach to design and development of good training.

Creating Tests

User

Online Course _ X

Topic 3


Stem

Feedback

Online Course _ X

Topic 2


Stem

Feedback

Online Course _ X

Lesson #1

Online Test _ X

Test #1.3


Stem

Feedback

Online Test _ X

Test #1.2


Stem

Feedback

Online Test _ X

Test #1.1


Stem

Feedback

Online Course _ X

Topic 3


Stem

Feedback

Online Course _ X

Topic 2


Stem

Feedback

Online Course _ X

Lesson #2

Online Test _ X

Test #2.3


Stem

Feedback

Online Test _ X

Test #2.2


Stem

Feedback

Online Test _ X

Test #2.1


Stem

Feedback

Online Course _ X

Topic 3


Stem

Feedback

Online Course _ X

Topic 2


Stem

Feedback

Online Course _ X

Lesson #3

Online Test _ X

Test #3.3


Stem

Feedback

Online Test _ X

Test #3.2


Stem

Feedback

Online Test _ X

Test #3.1


Stem

Feedback

Online Test _ X

Pre Test 3


Stem

Feedback

Online Test _ X

Pre Test 2


Stem

Feedback

Online Test _ X

Pre Test 1


Stem

Feedback

Online Test _ X

Final Exam 3


Stem

Feedback

Online Test _ X

Final Exam 2


Stem

Feedback

Online Test _ X

Final Exam 1


Stem

Feedback

You can use tests at different moments of the training process, each time with specific purposes.

Uses of Tests in Training Courses


Creating Tests

User

Online Course _ X

Topic 3


Stem

Feedback

Online Course _ X

Topic 2


Stem

Feedback

Online Course _ X

Lesson #1

Online Test _ X

Test #1.3


Stem

Feedback

Online Test _ X

Test #1.2


Stem

Feedback

Online Test _ X

Test #1.1


Stem

Feedback

Online Course _ X

Topic 3


Stem

Feedback

Online Course _ X

Topic 2


Stem

Feedback

Online Course _ X

Lesson #2

Online Test _ X

Test #2.3


Stem

Feedback

Online Test _ X

Test #2.2


Stem

Feedback

Online Test _ X

Test #2.1


Stem

Feedback

Online Course _ X

Topic 3


Stem

Feedback

Online Course _ X

Topic 2


Stem

Feedback

Online Course _ X

Lesson #3

Online Test _ X

Test #3.3


Stem

Feedback

Online Test _ X

Test #3.2


Stem

Feedback

Online Test _ X

Test #3.1


Stem

Feedback

Online Test _ X

Pre Test 3


Stem

Feedback

Online Test _ X

Pre Test 2


Stem

Feedback

Online Test _ X

Pre Test 1


Stem

Feedback

Online Test _ X

Final Exam 3


Stem

Feedback

Online Test _ X

Final Exam 2


Stem

Feedback

Online Test _ X

Final Exam 1


Stem

Feedback




Pre-TestPlace a test before training takes place to:

Determine if training is needed. Identify if audience have the pre-requisites for the

course.

It could also help the audience to confirm if they need to take the course (a motivational element).

Creating Tests

User

Online Course _ X

Topic 3


Stem

Feedback

Online Course _ X

Topic 2


Stem

Feedback

Online Course _ X

Lesson #1

Online Test _ X

Test #1.3


Stem

Feedback

Online Test _ X

Test #1.2


Stem

Feedback

Online Test _ X

Test #1.1


Stem

Feedback

Online Course _ X

Topic 3


Stem

Feedback

Online Course _ X

Topic 2


Stem

Feedback

Online Course _ X

Lesson #2

Online Test _ X

Test #2.3


Stem

Feedback

Online Test _ X

Test #2.2


Stem

Feedback

Online Test _ X

Test #2.1


Stem

Feedback

Online Course _ X

Topic 3


Stem

Feedback

Online Course _ X

Topic 2


Stem

Feedback

Online Course _ X

Lesson #3

Online Test _ X

Test #3.3


Stem

Feedback

Online Test _ X

Test #3.2


Stem

Feedback

Online Test _ X

Test #3.1


Stem

Feedback

Online Test _ X

Pre Test 3


Stem

Feedback

Online Test _ X

Pre Test 2


Stem

Feedback

Online Test _ X

Pre Test 1


Stem

Feedback

Online Test _ X

Final Exam 3


Stem

Feedback

Online Test _ X

Final Exam 2


Stem

Feedback

Online Test _ X

Final Exam 1


Stem

Feedback




During training(Formative test – Reinforcing learning)

Place test during training to determine if audience is learning or if you need to adjust your teaching. Test appears at the end of a lesson as part of the learning experience.

It provides an opportunity to practice and to confirm understanding.

Formative feedback in each test item are used to reinforce key messages.

Creating Tests

User

Online Course _ X

Topic 3


Stem

Feedback

Online Course _ X

Topic 2


Stem

Feedback

Online Course _ X

Lesson #1

Online Test _ X

Test #1.3


Stem

Feedback

Online Test _ X

Test #1.2


Stem

Feedback

Online Test _ X

Test #1.1


Stem

Feedback

Online Course _ X

Topic 3


Stem

Feedback

Online Course _ X

Topic 2


Stem

Feedback

Online Course _ X

Lesson #2

Online Test _ X

Test #2.3


Stem

Feedback

Online Test _ X

Test #2.2


Stem

Feedback

Online Test _ X

Test #2.1


Stem

Feedback

Online Course _ X

Topic 3


Stem

Feedback

Online Course _ X

Topic 2


Stem

Feedback

Online Course _ X

Lesson #3

Online Test _ X

Test #3.3


Stem

Feedback

Online Test _ X

Test #3.2


Stem

Feedback

Online Test _ X

Test #3.1


Stem

Feedback

Online Test _ X

Pre Test 3


Stem

Feedback

Online Test _ X

Pre Test 2


Stem

Feedback

Online Test _ X

Pre Test 1


Stem

Feedback

Online Test _ X

Final Exam 3


Stem

Feedback

Online Test _ X

Final Exam 2


Stem

Feedback

Online Test _ X

Final Exam 1


Stem

Feedback




After training(Post-Test)

Include tests at the end of the training experience to:

Determine if there has been a change in knowledge Confirm if compliance requirements have been met Provide final feedback according to result (pass/fail) Send back score to administrative module (LMS).

Creating Tests

Online Test _ X

Test #1.3


Stem

Feedback

Online Test _ X

Test #1.2


Stem

Feedback

Online Test _ X

Test #1.1


Stem

Feedback

Online Test _ X

Final Exam 3


Stem

Feedback

Online Test _ X

Final Exam 2


Stem

Feedback

Online Test _ X

Final Exam 1


Stem

Feedback

Online Test _ X

Pre Test 3


Stem

Feedback

Online Test _ X

Pre Test 2


Stem

Feedback

Online Test _ X

Pre Test 1


Stem

Feedback

Re-Using Test ItemsDevelopment of good tests takes time.Re-using test items in the different test events helps getting more out of your time investment.


Author

Learning Objective

Each test item can be re-used and be part of different tests

Creating Tests


A Test Item Anatomy

Stem

Lesson name

Options (correct answerand distractors)

Feedback area

Navigationarea

Question placewithin the test

Creating Tests


Test Item Recommendations

Write questions in a positive tone

Check that questions are related to learning objectives

Feedback options:Explain why the selection is wrong or correctProvide additional information about the topicInclude motivation messages

Move to the stem those words that appear in all optionsAll options should be feasible Make sure right answer is not the longest answerMake credible distractors.

Creating Tests


InstructionsPage

Test Items

Results Page

Test ComponentsMake sure that your test includes, in addition to the test items, an instruction and a result page.

Creating Tests


InstructionsPage

Test Items

Results Page

Test Components: Instructions PageInclude an instructions page at the beginning of your test that includes:

• Welcome message Course or lesson name Why is this test important

• Instructions – what the user is suppose to do

Number of questions to answer Number of attempts. Navigation (going back, leaving, etc.) Estimated required timed (if applicable)

• Test rules: How scores will be calculated Minimum score to pass Are scores saved or discarded

Creating Tests


InstructionsPage

Test Items

Results Page

Test Components: Test Items• Develop several test items from each of the

learning objectives• Present a randomly selected subset of items• Include a feedback message

Creating Tests


InstructionsPage

Test Items

Results Page

Test Components: Results PageScore as a percentage of correct answers:

• Acknowledge end of the activity • Feedback (text and image) according to

score (excellent, good or poor)• Suggest next steps according to result

(fail, pass)Good

Acceptable

Unacceptable

100%

UpperLimit %

LowerLimit %

0%

Define test performance areas

Creating Tests


Multiple Choice

Here are some of the most used question types and when to use them.

Match

Drag and Drop

Sequence

Hot Spot

Fill in the Blank

Most Used Test Item Types

Creating Tests

Multiple Choice


Match

Drag and Drop

Sequence

Hot Spot

Fill in the Blank

Multiple Choice


Variations:• Only one option is correct• True or false

It is the easiest type of question

• More than one option could be correct The most difficult type Make explicit in the question

that more than one option can be selected

Tip:Do not use all of the above or none of the above when randomizing options.

Multiple Choice

Creating Tests


Multiple Choice


Match

Drag and Drop

Sequence

Hot Spot

Fill in the Blank

Match

User must drag one element and dropt it in its corresponding match.

Best used when: Identifying terms, concepts,

graphical symbols or representations

Components: Two columns of items

Match

Creating Tests


Multiple Choice


Match

Drag and Drop

Sequence

Hot Spot

Fill in the Blank

Drag and Drop

Purpose: Comparison and contrast User has to determine

correct category per each item

Components: Scenario and problem

description (text) + instructions

Item list Drop areas

Behaviour Items return automatically if

dropped into wrong area.

Drag and Drop

Creating Tests


Multiple Choice


Match

Drag and Drop

Sequence

Hot Spot

Fill in the Blank

Sequence

Purpose: User must drag and drop a

number of options so they display in the correct order from first to last.

Best used: For process based

assessment where a distinct order was taught.

Sequence

Creating Tests


Multiple Choice


Match

Drag and Drop

Sequence

Hot Spot

Fill in the Blank

Hot Spot

Hot Spot

Purpose: Click an area of the graphic

as an answer.

Best used: Good for system related test

items.

Creating Tests


Multiple Choice


Match

Drag and Drop

Sequence

Hot Spot

Fill in the Blank

Fill in the Blank

Purpose: To force user to supply the

answer (reduces guessing).

Best used to check knowledge of:

Terms Principles, methods, or

procedures Specific facts

Fill in the Blank

Creating Tests


Test Development is EasyThe design and development of tests has a relatively low development time, because often text is the only media used.

Author

Tools Knowledge

Tests authors find on the internet an abundance of development tools (many of them free) and research based

knowledge, that makes easy the creation of tests.

Creating Tests

Define General Design

Create Test

Create Information

BlocksStructure

InformationAdd

InstructionDevelop Training

Implement & Evaluate

Conclusions


• If you are developing a training solution, you should include test modules.

• Tests are flexible, they can be used: As part of eLearning, blended or traditional training. To check if learning took place or to reinforce learning.

• Remember to develop your test items after you have identified learning objectives and before creating the content.

Creating Tests

Creating TestsDesigning training for the first time?

[email protected]

v1.0 – Feb 2016

mailto:[email protected]

TCD20: Creating Tests

Education

Transcript of TCD20: Creating Tests