Kirkpatrick. The Four Levels n Reaction n Learning n Behavior n Results.
-
date post
19-Dec-2015 -
Category
Documents
-
view
225 -
download
1
Transcript of Kirkpatrick. The Four Levels n Reaction n Learning n Behavior n Results.
![Page 1: Kirkpatrick. The Four Levels n Reaction n Learning n Behavior n Results.](https://reader035.fdocuments.us/reader035/viewer/2022062221/56649d3b5503460f94a15df4/html5/thumbnails/1.jpg)
Kirkpatrick
![Page 2: Kirkpatrick. The Four Levels n Reaction n Learning n Behavior n Results.](https://reader035.fdocuments.us/reader035/viewer/2022062221/56649d3b5503460f94a15df4/html5/thumbnails/2.jpg)
The Four Levels
Reaction Learning Behavior Results
![Page 3: Kirkpatrick. The Four Levels n Reaction n Learning n Behavior n Results.](https://reader035.fdocuments.us/reader035/viewer/2022062221/56649d3b5503460f94a15df4/html5/thumbnails/3.jpg)
All about Kirkpatrick
In 1959, Kirkpatrick wrote four articles describing the four levels for evaluating training programs. He was working on his dissertation for a Ph.D. when he came up with the idea of defining evaluation.
Evaluation, as according to Kirkpatrick, seems to have multiple meanings to training and developmental professionals. Some think evaluation is a change in behavior, or the determination of the final results.
![Page 4: Kirkpatrick. The Four Levels n Reaction n Learning n Behavior n Results.](https://reader035.fdocuments.us/reader035/viewer/2022062221/56649d3b5503460f94a15df4/html5/thumbnails/4.jpg)
All about Kirkpatrick (continued) Kirkpatrick says they are all right, and
yet all wrong. All four levels are important in understanding the basic concepts in training. There are exceptions, however.
![Page 5: Kirkpatrick. The Four Levels n Reaction n Learning n Behavior n Results.](https://reader035.fdocuments.us/reader035/viewer/2022062221/56649d3b5503460f94a15df4/html5/thumbnails/5.jpg)
Kirkpatrick: Evaluating Training Programs
“What is quality training?”
“How do you measure it?”
“How do you improve it?”
![Page 6: Kirkpatrick. The Four Levels n Reaction n Learning n Behavior n Results.](https://reader035.fdocuments.us/reader035/viewer/2022062221/56649d3b5503460f94a15df4/html5/thumbnails/6.jpg)
Evaluating
“The reason for evaluating is to determine the effectiveness of a training program.” (Kirkpatrick, 1994, pg. 3)
![Page 7: Kirkpatrick. The Four Levels n Reaction n Learning n Behavior n Results.](https://reader035.fdocuments.us/reader035/viewer/2022062221/56649d3b5503460f94a15df4/html5/thumbnails/7.jpg)
The Ten Factors of Developing a Training Program
1. Determine needs
2. Set objectives
3. Determine subject content
4. Select qualified applicants
5. Determine the best schedule
![Page 8: Kirkpatrick. The Four Levels n Reaction n Learning n Behavior n Results.](https://reader035.fdocuments.us/reader035/viewer/2022062221/56649d3b5503460f94a15df4/html5/thumbnails/8.jpg)
The Ten Factors of Developing a Training Program
6. Select appropriate facilities
7. Select qualified instructors
8. Select and prepare audiovisual aids
9. Co-ordinate the program
10. Evaluate the program
![Page 9: Kirkpatrick. The Four Levels n Reaction n Learning n Behavior n Results.](https://reader035.fdocuments.us/reader035/viewer/2022062221/56649d3b5503460f94a15df4/html5/thumbnails/9.jpg)
Reasons for Evaluating
Kirkpatrick gives three reasons ‘why’ there is a need to evaluate training:
1.“To justify the existence of the training department by showing how
it contributes to the organizations’ objectives and goals.”
![Page 10: Kirkpatrick. The Four Levels n Reaction n Learning n Behavior n Results.](https://reader035.fdocuments.us/reader035/viewer/2022062221/56649d3b5503460f94a15df4/html5/thumbnails/10.jpg)
Reasons for Evaluating
2. “To decide whether to continue or discontinue training programs.”
3. “To gain information on how to improve future training programs.”
(Kirkpatrick, 1994, pg. 18)
![Page 11: Kirkpatrick. The Four Levels n Reaction n Learning n Behavior n Results.](https://reader035.fdocuments.us/reader035/viewer/2022062221/56649d3b5503460f94a15df4/html5/thumbnails/11.jpg)
The Four Levels
Reaction Learning Behavior Results
![Page 12: Kirkpatrick. The Four Levels n Reaction n Learning n Behavior n Results.](https://reader035.fdocuments.us/reader035/viewer/2022062221/56649d3b5503460f94a15df4/html5/thumbnails/12.jpg)
“The Four Levels represent a sequence of ways to evaluate (training) programs….As you move from one level to the next, the process becomes more difficult and time-consuming, but it also provides more valuable information.” (Kirkpatrick, 1994, pg. 21)
![Page 13: Kirkpatrick. The Four Levels n Reaction n Learning n Behavior n Results.](https://reader035.fdocuments.us/reader035/viewer/2022062221/56649d3b5503460f94a15df4/html5/thumbnails/13.jpg)
Reaction:
is the measuring of the reaction of the participants in the training program.
is “a measure of customer satisfaction.” (Kirkpatrick, 1994, pg. 21)
![Page 14: Kirkpatrick. The Four Levels n Reaction n Learning n Behavior n Results.](https://reader035.fdocuments.us/reader035/viewer/2022062221/56649d3b5503460f94a15df4/html5/thumbnails/14.jpg)
Learning:
is the change in the participants’ attitudes, or an increase in knowledge, or greater skills received, as a result of the participation of the program.
![Page 15: Kirkpatrick. The Four Levels n Reaction n Learning n Behavior n Results.](https://reader035.fdocuments.us/reader035/viewer/2022062221/56649d3b5503460f94a15df4/html5/thumbnails/15.jpg)
Learning
The measuring of learning in any training program is the determination of at least one of these measuring parameters:
Did the attitudes change positively? Is the knowledge acquired related and
helpful to the task? Is the skill acquired related and helpful to
the task?
![Page 16: Kirkpatrick. The Four Levels n Reaction n Learning n Behavior n Results.](https://reader035.fdocuments.us/reader035/viewer/2022062221/56649d3b5503460f94a15df4/html5/thumbnails/16.jpg)
Behavior
Level 3 attempts to evaluate how much transfer of knowledge, skills, and attitude occurs after the training.
![Page 17: Kirkpatrick. The Four Levels n Reaction n Learning n Behavior n Results.](https://reader035.fdocuments.us/reader035/viewer/2022062221/56649d3b5503460f94a15df4/html5/thumbnails/17.jpg)
The four conditions Kirkpatrick identifies for changes to occur:
Desire to change
Knowledge of what to do and how to do it
Work in the right climate
Reward for (positive) change
![Page 18: Kirkpatrick. The Four Levels n Reaction n Learning n Behavior n Results.](https://reader035.fdocuments.us/reader035/viewer/2022062221/56649d3b5503460f94a15df4/html5/thumbnails/18.jpg)
When all conditions are met, the employee must:
Realize an opportunity to use the behavioral changes.
Make the decision to use the behavioral changes.
Decide whether or not to continue using the behavioral changes.
![Page 19: Kirkpatrick. The Four Levels n Reaction n Learning n Behavior n Results.](https://reader035.fdocuments.us/reader035/viewer/2022062221/56649d3b5503460f94a15df4/html5/thumbnails/19.jpg)
When evaluating change in behavior, decide:
When to evaluate
How often to evaluate
How to evaluate
![Page 20: Kirkpatrick. The Four Levels n Reaction n Learning n Behavior n Results.](https://reader035.fdocuments.us/reader035/viewer/2022062221/56649d3b5503460f94a15df4/html5/thumbnails/20.jpg)
Guidelines for evaluating behavior: Use a control group Allow time for change to occur Evaluate before and after Survey/interview observers Get 100% response or sampling Repeat evaluation, as appropriate Consider cost versus benefits
![Page 21: Kirkpatrick. The Four Levels n Reaction n Learning n Behavior n Results.](https://reader035.fdocuments.us/reader035/viewer/2022062221/56649d3b5503460f94a15df4/html5/thumbnails/21.jpg)
Results
Level 4 is the most important and difficult of all - determining final results after training.
![Page 22: Kirkpatrick. The Four Levels n Reaction n Learning n Behavior n Results.](https://reader035.fdocuments.us/reader035/viewer/2022062221/56649d3b5503460f94a15df4/html5/thumbnails/22.jpg)
Evaluation Questions:
Increased production? Improved quality? Decreased costs? Improved safety numbers? Increased sales? Reduced turnover? Higher profits?
![Page 23: Kirkpatrick. The Four Levels n Reaction n Learning n Behavior n Results.](https://reader035.fdocuments.us/reader035/viewer/2022062221/56649d3b5503460f94a15df4/html5/thumbnails/23.jpg)
Guidelines for evaluating results: Use a control group. Allow time for results to be achieved. Measure before and after the program. Repeat the measurements, as needed. Consider cost versus benefits. Be satisfied with evidence if proof is not
possible.
![Page 24: Kirkpatrick. The Four Levels n Reaction n Learning n Behavior n Results.](https://reader035.fdocuments.us/reader035/viewer/2022062221/56649d3b5503460f94a15df4/html5/thumbnails/24.jpg)
Case Study #1
INTEL CORPORATION
![Page 25: Kirkpatrick. The Four Levels n Reaction n Learning n Behavior n Results.](https://reader035.fdocuments.us/reader035/viewer/2022062221/56649d3b5503460f94a15df4/html5/thumbnails/25.jpg)
Intel’s Compromise of the Kirkpatrick Model
Intel uses the four-level model as an analysis instrument to determine the initial training needs and design of its training program; as well as using the model for evaluations.
![Page 26: Kirkpatrick. The Four Levels n Reaction n Learning n Behavior n Results.](https://reader035.fdocuments.us/reader035/viewer/2022062221/56649d3b5503460f94a15df4/html5/thumbnails/26.jpg)
Intel’s Compromise of the Kirkpatrick Model
Their uniqueness of using the model is in the fact that the designers of the training program worked backwards in the analysis of the training, starting with Level Four.
![Page 27: Kirkpatrick. The Four Levels n Reaction n Learning n Behavior n Results.](https://reader035.fdocuments.us/reader035/viewer/2022062221/56649d3b5503460f94a15df4/html5/thumbnails/27.jpg)
The Model
This implementation of the Kirkpatrick Model stands as vivid testimony to the versatility of the model as a training tool, and in developing fledgling training programs.
![Page 28: Kirkpatrick. The Four Levels n Reaction n Learning n Behavior n Results.](https://reader035.fdocuments.us/reader035/viewer/2022062221/56649d3b5503460f94a15df4/html5/thumbnails/28.jpg)
The Model
It also reflects the open-mindedness of the senior executives at Intel for their infinite use of the model and the use of the genius and visions of Kirkpatrick.
![Page 29: Kirkpatrick. The Four Levels n Reaction n Learning n Behavior n Results.](https://reader035.fdocuments.us/reader035/viewer/2022062221/56649d3b5503460f94a15df4/html5/thumbnails/29.jpg)
How Intel applies the analysis to their training program
Level Four …”Determine the organizations’ structure and future needs.”
Level Three. Change the environmental conditions and employee conditions to improve business indicators.
![Page 30: Kirkpatrick. The Four Levels n Reaction n Learning n Behavior n Results.](https://reader035.fdocuments.us/reader035/viewer/2022062221/56649d3b5503460f94a15df4/html5/thumbnails/30.jpg)
How Intel applies the analysis to their training program
Level Two. “Design a training program that would ensure a transfer of deficient skills and knowledge.”
Level One. Use a questionnaire, according to their skill level, that would instruct and inspire training participants.
![Page 31: Kirkpatrick. The Four Levels n Reaction n Learning n Behavior n Results.](https://reader035.fdocuments.us/reader035/viewer/2022062221/56649d3b5503460f94a15df4/html5/thumbnails/31.jpg)
How Intel applies evaluationto their training program Level One - Questionnaire.
Level Two - Demonstrate competency, create action plans through group simulations.
Level Three - Follow-up to determine if action plans were met (specific steps to implement concepts of what was learned).
Level Four - Ongoing process of tracking business indicators.
![Page 32: Kirkpatrick. The Four Levels n Reaction n Learning n Behavior n Results.](https://reader035.fdocuments.us/reader035/viewer/2022062221/56649d3b5503460f94a15df4/html5/thumbnails/32.jpg)
Case Study #2
ST. LUKE’S HOSPITAL
![Page 33: Kirkpatrick. The Four Levels n Reaction n Learning n Behavior n Results.](https://reader035.fdocuments.us/reader035/viewer/2022062221/56649d3b5503460f94a15df4/html5/thumbnails/33.jpg)
St. Luke’s is unique -
Evaluation of outdoor-based training program, not classroom.
Results analyzed statistically to determine the significance of any change.
Evaluation led to recommendations for future programs.
![Page 34: Kirkpatrick. The Four Levels n Reaction n Learning n Behavior n Results.](https://reader035.fdocuments.us/reader035/viewer/2022062221/56649d3b5503460f94a15df4/html5/thumbnails/34.jpg)
The New Questionnaire
Used before attendance in the program. Used 3 months after completion of the
program. Used again 6 months after completion of
the program. (Communication showed statistically significant
improvement, and Group Effectiveness showed
statistically significant change.)
![Page 35: Kirkpatrick. The Four Levels n Reaction n Learning n Behavior n Results.](https://reader035.fdocuments.us/reader035/viewer/2022062221/56649d3b5503460f94a15df4/html5/thumbnails/35.jpg)
Kirkpatrick’s 4 Levels of Evaluation are:
Level 1 - Reaction: how participants reacted to the program.
Level 2 - Learning: what participants learned from the program.
Level 3 - Behavior: whether what was learned is being applied on the job.
Level 4 - Results: whether that application is achieving results.
![Page 36: Kirkpatrick. The Four Levels n Reaction n Learning n Behavior n Results.](https://reader035.fdocuments.us/reader035/viewer/2022062221/56649d3b5503460f94a15df4/html5/thumbnails/36.jpg)
Post-test Questions
(1) Name three ways evaluation results can be measured.
(2) Do all 4 Levels have to be used?
(3) Do they have to be used in 1,2,3,4 order?
(4) Is Kirkpatrick’s method of evaluation summative or formative?
(5) Which developmental “view” does
Kirkpatrick use? (discrepancy, democratic, analytical, diagnostic)
![Page 37: Kirkpatrick. The Four Levels n Reaction n Learning n Behavior n Results.](https://reader035.fdocuments.us/reader035/viewer/2022062221/56649d3b5503460f94a15df4/html5/thumbnails/37.jpg)
“IF YOU THINK TRAINING IS EXPENSIVE, TRY IGNORANCE.”
and, remember, the definition of ignorance is
repeating the same behavior, over and over, and expecting different results!