Measuring Change Evaluation Phase EME 6636 Change Management Instructor: Dr. Darabi Yang Xu.
-
date post
21-Dec-2015 -
Category
Documents
-
view
218 -
download
0
Transcript of Measuring Change Evaluation Phase EME 6636 Change Management Instructor: Dr. Darabi Yang Xu.
![Page 1: Measuring Change Evaluation Phase EME 6636 Change Management Instructor: Dr. Darabi Yang Xu.](https://reader030.fdocuments.us/reader030/viewer/2022032521/56649d575503460f94a352f9/html5/thumbnails/1.jpg)
Measuring ChangeEvaluation Phase
EME 6636 Change ManagementInstructor: Dr. DarabiYang Xu
![Page 2: Measuring Change Evaluation Phase EME 6636 Change Management Instructor: Dr. Darabi Yang Xu.](https://reader030.fdocuments.us/reader030/viewer/2022032521/56649d575503460f94a352f9/html5/thumbnails/2.jpg)
Fig.1: Integrated SAAPS with the HPT model
![Page 3: Measuring Change Evaluation Phase EME 6636 Change Management Instructor: Dr. Darabi Yang Xu.](https://reader030.fdocuments.us/reader030/viewer/2022032521/56649d575503460f94a352f9/html5/thumbnails/3.jpg)
Align Structure Staffing, development,
measurement, rewards, communication, organization structure
Optimize results: Change integration Workforce measure Workforce measures
questionnaire Lessons learned
Fig.2: Kate Nelson & Stacy Aaron, Change Guide LLC
![Page 4: Measuring Change Evaluation Phase EME 6636 Change Management Instructor: Dr. Darabi Yang Xu.](https://reader030.fdocuments.us/reader030/viewer/2022032521/56649d575503460f94a352f9/html5/thumbnails/4.jpg)
Keep track the process of change,
and identify the effectiveness of
process
Identify the validity
(outcome) of change
Identify the long-term impact of change, and
gain supports for future
The purpose of measuring change
![Page 5: Measuring Change Evaluation Phase EME 6636 Change Management Instructor: Dr. Darabi Yang Xu.](https://reader030.fdocuments.us/reader030/viewer/2022032521/56649d575503460f94a352f9/html5/thumbnails/5.jpg)
Kirkpatrick’s 4-level evaluation
Level Measures
1. Reaction and
Planned Action
Participant’s reaction to the program and
outlines specific plans for implementation
2. Learning Skills, knowledge, or attitude changes
3. Application Changes in behavior on the job and specific
application of the training material
4. Business Impact Business impact of the program
![Page 6: Measuring Change Evaluation Phase EME 6636 Change Management Instructor: Dr. Darabi Yang Xu.](https://reader030.fdocuments.us/reader030/viewer/2022032521/56649d575503460f94a352f9/html5/thumbnails/6.jpg)
![Page 7: Measuring Change Evaluation Phase EME 6636 Change Management Instructor: Dr. Darabi Yang Xu.](https://reader030.fdocuments.us/reader030/viewer/2022032521/56649d575503460f94a352f9/html5/thumbnails/7.jpg)
5-level framework for evaluation
Level Measures
1. Reaction and
Planned Action
Participant’s reaction to the program and
outlines specific plans for implementation
2. Learning Skills, knowledge, or attitude changes
3. Application Changes in behavior on the job and specific
application of the training material
4. Business Impact Business impact of the program
5. ROI Monetary value of the results and costs
for the program, usually expressed as a
percentage
![Page 8: Measuring Change Evaluation Phase EME 6636 Change Management Instructor: Dr. Darabi Yang Xu.](https://reader030.fdocuments.us/reader030/viewer/2022032521/56649d575503460f94a352f9/html5/thumbnails/8.jpg)
The
2003 2004 2005 2006
30
50
70
120
The comparision between cost and benefits
![Page 9: Measuring Change Evaluation Phase EME 6636 Change Management Instructor: Dr. Darabi Yang Xu.](https://reader030.fdocuments.us/reader030/viewer/2022032521/56649d575503460f94a352f9/html5/thumbnails/9.jpg)
• Control groups• Trend line analysis• Forecasting• Customer input• Participants’ and supervisors’
estimates of intervention’s effects• Expert estimation
• Evaluation purpose• Evaluation instruments• Evaluation timing• Evaluation levels
![Page 10: Measuring Change Evaluation Phase EME 6636 Change Management Instructor: Dr. Darabi Yang Xu.](https://reader030.fdocuments.us/reader030/viewer/2022032521/56649d575503460f94a352f9/html5/thumbnails/10.jpg)
10 Steps to establish a results-based monitoring and evaluation system
Jody Zall Kusek, Ray C. Rist, The world bank
Plan Implement Maintain
![Page 11: Measuring Change Evaluation Phase EME 6636 Change Management Instructor: Dr. Darabi Yang Xu.](https://reader030.fdocuments.us/reader030/viewer/2022032521/56649d575503460f94a352f9/html5/thumbnails/11.jpg)
• Objectives
• Links activities and their
resources to objectives
• Performance indicagtors
and targets
• Collect data
• Reports to managers and
alert them problems
• Analyze results
• Assess specific causal
contributions
• Examine implementing
process
• Explores unintended
results
• Recommendation
Monitoring Evaluation
![Page 12: Measuring Change Evaluation Phase EME 6636 Change Management Instructor: Dr. Darabi Yang Xu.](https://reader030.fdocuments.us/reader030/viewer/2022032521/56649d575503460f94a352f9/html5/thumbnails/12.jpg)
Readiness Assessment
• Need for assessment
• Capability for assessment
![Page 13: Measuring Change Evaluation Phase EME 6636 Change Management Instructor: Dr. Darabi Yang Xu.](https://reader030.fdocuments.us/reader030/viewer/2022032521/56649d575503460f94a352f9/html5/thumbnails/13.jpg)
Agree on outcomes to monitor and evaluate
1. Identify the key stakeholders
2. Identify the stakeholders’
concerns
3. Transfer problems into
measurable expected
outcomes
![Page 14: Measuring Change Evaluation Phase EME 6636 Change Management Instructor: Dr. Darabi Yang Xu.](https://reader030.fdocuments.us/reader030/viewer/2022032521/56649d575503460f94a352f9/html5/thumbnails/14.jpg)
Selecting key indicators to monitor outcomes
Clear
Monitorable
Adequate
Economic
Relevant
![Page 15: Measuring Change Evaluation Phase EME 6636 Change Management Instructor: Dr. Darabi Yang Xu.](https://reader030.fdocuments.us/reader030/viewer/2022032521/56649d575503460f94a352f9/html5/thumbnails/15.jpg)
Setting baselines and gathering data in indicators
![Page 16: Measuring Change Evaluation Phase EME 6636 Change Management Instructor: Dr. Darabi Yang Xu.](https://reader030.fdocuments.us/reader030/viewer/2022032521/56649d575503460f94a352f9/html5/thumbnails/16.jpg)
Planning for improvement—selecting results targets
By Jan. By Feb.
Results targets
The salary level will increase 5%.
The salary level will increase 15%.
![Page 17: Measuring Change Evaluation Phase EME 6636 Change Management Instructor: Dr. Darabi Yang Xu.](https://reader030.fdocuments.us/reader030/viewer/2022032521/56649d575503460f94a352f9/html5/thumbnails/17.jpg)
The systematic model
Plan
![Page 18: Measuring Change Evaluation Phase EME 6636 Change Management Instructor: Dr. Darabi Yang Xu.](https://reader030.fdocuments.us/reader030/viewer/2022032521/56649d575503460f94a352f9/html5/thumbnails/18.jpg)
Monitoring for results
1. Data sources2. Data collection
methods3. Data collection
frequency4. Personnel’s
Responsibility
![Page 19: Measuring Change Evaluation Phase EME 6636 Change Management Instructor: Dr. Darabi Yang Xu.](https://reader030.fdocuments.us/reader030/viewer/2022032521/56649d575503460f94a352f9/html5/thumbnails/19.jpg)
Key criteria for collecting date
Reliability
Validity Timeliness
![Page 20: Measuring Change Evaluation Phase EME 6636 Change Management Instructor: Dr. Darabi Yang Xu.](https://reader030.fdocuments.us/reader030/viewer/2022032521/56649d575503460f94a352f9/html5/thumbnails/20.jpg)
Reporting findings
Title in hereTo whom
Title in here
Which format
Title in hereFor what 1.Demonstrate accountability
2.Convince and gain support
3.Document
4. Promote understanding
Purpose of reporting
![Page 21: Measuring Change Evaluation Phase EME 6636 Change Management Instructor: Dr. Darabi Yang Xu.](https://reader030.fdocuments.us/reader030/viewer/2022032521/56649d575503460f94a352f9/html5/thumbnails/21.jpg)
The systematic model
Plan Implement Maintain
![Page 22: Measuring Change Evaluation Phase EME 6636 Change Management Instructor: Dr. Darabi Yang Xu.](https://reader030.fdocuments.us/reader030/viewer/2022032521/56649d575503460f94a352f9/html5/thumbnails/22.jpg)
Barriers in measuring change
1. Time consuming
2. Expensive
3. Complicated process
4. Negative evaluation results
![Page 23: Measuring Change Evaluation Phase EME 6636 Change Management Instructor: Dr. Darabi Yang Xu.](https://reader030.fdocuments.us/reader030/viewer/2022032521/56649d575503460f94a352f9/html5/thumbnails/23.jpg)