Workshop Evaluation Worth the Effort! NLTAPA Conference Boise, ID NLTAPA Conference Boise, ID.
-
Upload
annis-james -
Category
Documents
-
view
222 -
download
1
Transcript of Workshop Evaluation Worth the Effort! NLTAPA Conference Boise, ID NLTAPA Conference Boise, ID.
![Page 1: Workshop Evaluation Worth the Effort! NLTAPA Conference Boise, ID NLTAPA Conference Boise, ID.](https://reader036.fdocuments.us/reader036/viewer/2022081520/5697bff11a28abf838cbb365/html5/thumbnails/1.jpg)
Workshop EvaluationWorth the Effort!
NLTAPA ConferenceBoise, ID
![Page 2: Workshop Evaluation Worth the Effort! NLTAPA Conference Boise, ID NLTAPA Conference Boise, ID.](https://reader036.fdocuments.us/reader036/viewer/2022081520/5697bff11a28abf838cbb365/html5/thumbnails/2.jpg)
Evaluation Overview
• Purpose: To determine the effectiveness of a training program.
![Page 3: Workshop Evaluation Worth the Effort! NLTAPA Conference Boise, ID NLTAPA Conference Boise, ID.](https://reader036.fdocuments.us/reader036/viewer/2022081520/5697bff11a28abf838cbb365/html5/thumbnails/3.jpg)
Evaluation Overview
• Four-level model developed by Donald Kirkpatrick (1998).
• Reaction• Learning• Behavior• Results
![Page 4: Workshop Evaluation Worth the Effort! NLTAPA Conference Boise, ID NLTAPA Conference Boise, ID.](https://reader036.fdocuments.us/reader036/viewer/2022081520/5697bff11a28abf838cbb365/html5/thumbnails/4.jpg)
Evaluation Overview (continued)
• Each successive evaluation level is built on information provided by the lower level.
![Page 5: Workshop Evaluation Worth the Effort! NLTAPA Conference Boise, ID NLTAPA Conference Boise, ID.](https://reader036.fdocuments.us/reader036/viewer/2022081520/5697bff11a28abf838cbb365/html5/thumbnails/5.jpg)
Level 1
Level 2
Level 3
Level 4
Reaction –
Learning –
Beha
vior – Re
sults –
![Page 6: Workshop Evaluation Worth the Effort! NLTAPA Conference Boise, ID NLTAPA Conference Boise, ID.](https://reader036.fdocuments.us/reader036/viewer/2022081520/5697bff11a28abf838cbb365/html5/thumbnails/6.jpg)
Reaction (Level 1)
What they thought and felt about the training.
![Page 7: Workshop Evaluation Worth the Effort! NLTAPA Conference Boise, ID NLTAPA Conference Boise, ID.](https://reader036.fdocuments.us/reader036/viewer/2022081520/5697bff11a28abf838cbb365/html5/thumbnails/7.jpg)
Level 1
![Page 8: Workshop Evaluation Worth the Effort! NLTAPA Conference Boise, ID NLTAPA Conference Boise, ID.](https://reader036.fdocuments.us/reader036/viewer/2022081520/5697bff11a28abf838cbb365/html5/thumbnails/8.jpg)
Level 1
Courses expanded, or condensed
Instructors adjusted Courses removed from the program pending
further review
![Page 9: Workshop Evaluation Worth the Effort! NLTAPA Conference Boise, ID NLTAPA Conference Boise, ID.](https://reader036.fdocuments.us/reader036/viewer/2022081520/5697bff11a28abf838cbb365/html5/thumbnails/9.jpg)
Courses expanded, or condensed
Stormwater Management
Participant Comments (Fall 2010)
Too long and too deep of
explanations.
Too much info that doesn’t concern our
needs.
Maintenance section is too
repetitive.
![Page 10: Workshop Evaluation Worth the Effort! NLTAPA Conference Boise, ID NLTAPA Conference Boise, ID.](https://reader036.fdocuments.us/reader036/viewer/2022081520/5697bff11a28abf838cbb365/html5/thumbnails/10.jpg)
Instructors Adjusted
Winter Maintenance
Participant Comments (Fall
2012)
• Instructor should be someone that worked in this field at public works level.
• Instructor seems to lack practical experience in this field.
• Less talk about cost. More on winter maintenance. (That's what our bosses are for– keeping cost down.)
![Page 11: Workshop Evaluation Worth the Effort! NLTAPA Conference Boise, ID NLTAPA Conference Boise, ID.](https://reader036.fdocuments.us/reader036/viewer/2022081520/5697bff11a28abf838cbb365/html5/thumbnails/11.jpg)
Courses Removed
Traffic Signals Participa
nt Commen
ts (Fall
2012)
• Make half days.
• Break into different sections.
• Break into different levels – decision planning vs. on-going maintenance.
![Page 12: Workshop Evaluation Worth the Effort! NLTAPA Conference Boise, ID NLTAPA Conference Boise, ID.](https://reader036.fdocuments.us/reader036/viewer/2022081520/5697bff11a28abf838cbb365/html5/thumbnails/12.jpg)
Learning – Level 2
Pre and Post Quiz
• Developed to evaluate the instruction and content of our training programs
(NOT the student)
• Consists of 6 questions
• Note your answers on the back of the evaluation sheet
![Page 13: Workshop Evaluation Worth the Effort! NLTAPA Conference Boise, ID NLTAPA Conference Boise, ID.](https://reader036.fdocuments.us/reader036/viewer/2022081520/5697bff11a28abf838cbb365/html5/thumbnails/13.jpg)
Quiz Example Question
1. Denying physical access to someone because of their impairment is:
a. Sometimes necessary
b. Discrimination
c. Permitted by law in certain circumstances
d. Unimportant compared to making roads safe for cars
![Page 14: Workshop Evaluation Worth the Effort! NLTAPA Conference Boise, ID NLTAPA Conference Boise, ID.](https://reader036.fdocuments.us/reader036/viewer/2022081520/5697bff11a28abf838cbb365/html5/thumbnails/14.jpg)
Learning
Course content modified
Quiz questions refined
![Page 15: Workshop Evaluation Worth the Effort! NLTAPA Conference Boise, ID NLTAPA Conference Boise, ID.](https://reader036.fdocuments.us/reader036/viewer/2022081520/5697bff11a28abf838cbb365/html5/thumbnails/15.jpg)
“Un-Learning” in Winter Maintenance
![Page 16: Workshop Evaluation Worth the Effort! NLTAPA Conference Boise, ID NLTAPA Conference Boise, ID.](https://reader036.fdocuments.us/reader036/viewer/2022081520/5697bff11a28abf838cbb365/html5/thumbnails/16.jpg)
Behavior - Level 3
Enhanced skills and knowledge identified
on the job
o Newer process
o 6 month evaluation
![Page 17: Workshop Evaluation Worth the Effort! NLTAPA Conference Boise, ID NLTAPA Conference Boise, ID.](https://reader036.fdocuments.us/reader036/viewer/2022081520/5697bff11a28abf838cbb365/html5/thumbnails/17.jpg)
Level 3
![Page 18: Workshop Evaluation Worth the Effort! NLTAPA Conference Boise, ID NLTAPA Conference Boise, ID.](https://reader036.fdocuments.us/reader036/viewer/2022081520/5697bff11a28abf838cbb365/html5/thumbnails/18.jpg)
Results – Level 4
Cost savings of approximately $5,000 related to remediation of current signage
$1,500 of savings in equipment expenditures
$30,000 of expenses avoided that might have been incurred if gas line had to be relocated after completion
Lawsuits avoided
![Page 19: Workshop Evaluation Worth the Effort! NLTAPA Conference Boise, ID NLTAPA Conference Boise, ID.](https://reader036.fdocuments.us/reader036/viewer/2022081520/5697bff11a28abf838cbb365/html5/thumbnails/19.jpg)
Questions ...
LTAP – Local Technical Assistance ProgramPennsylvania Department of TransportationBureau of Planning and Research400 North Street, 6th FloorHarrisburg, PA 17120
• E-mail: [email protected]
• Web Site: www.ltap.state.pa.us