CREATING A CULTURE OF EVALUATION

31
1 CREATING A CULTURE OF EVALUATION IMPACT 2011 - September 28, 2011 Margo Bailey, PhD Brighter Strategies, LLC 1

description

CREATING A CULTURE OF EVALUATION. IMPACT 2011 - September 28, 2011 Margo Bailey, PhD Brighter Strategies, LLC. 1. PURPOSE. Learn how to improve staff and board member buy-in by integrating evaluation planning into your organization’s key management and programmatic activities. 2. - PowerPoint PPT Presentation

Transcript of CREATING A CULTURE OF EVALUATION

Page 1: CREATING A CULTURE OF EVALUATION

1

CREATING A CULTURE OF EVALUATIONIMPACT 2011 - September 28, 2011

Margo Bailey, PhD

Brighter Strategies, LLC

1

Page 2: CREATING A CULTURE OF EVALUATION

2

PURPOSE

Learn how to improve staff and board member buy-in by integrating evaluation planning into your organization’s key management and programmatic activities.

2

Page 3: CREATING A CULTURE OF EVALUATION

3

KEY TOPICS

Measuring Results Outcome Measurement & Evaluation

Culture

Change Management Process

Building Evaluation Culture Staff Board

Q&A

3

Page 4: CREATING A CULTURE OF EVALUATION

4

MEASURE RESULTS & IMPACT

Outcome Measurement systematic tracking of

the extent to which program participants [or communities] experience the benefits or changes intended.

Evaluation Helps explain why

4

Page 5: CREATING A CULTURE OF EVALUATION

5

WHY TRACK OUTCOMES

Success is measured by the achievement of the intended outcomes.

Ensure programs achieve maximum effectiveness, efficiency and quality of service delivery.

Accountable to stakeholder and funding sources.

Disseminate knowledge so others can benefit from our experiences.

5

Page 6: CREATING A CULTURE OF EVALUATION

6

Fully Detailed Logic Model

6

Page 7: CREATING A CULTURE OF EVALUATION

7

MEASURING IMPACT WILL NOT:

Show whether these are the right outcomes to measure

Prove statistically that the program caused the outcomes

Explain why the level of outcomes were achieved

By themselves, tell what to change to improve the outcome 7

Page 8: CREATING A CULTURE OF EVALUATION

8

WHY EVALUATE

Justify existence

Increase/Maintain Budget

Show results (impact)

Justify more resources (hire help)

Make your program more organized

Develop sound Outcome Measures8

Page 9: CREATING A CULTURE OF EVALUATION

9

EVALUATION HELPS

Understand or increase the organization/program impact

Identify strengths and weaknesses to improve (more effective; less costly)

Verify program is running as intended

Develop/Review goals and create accountability for your management

Produce tangible programmatic data

9

Page 10: CREATING A CULTURE OF EVALUATION

10

SO WHY IS THERE RESISTANCE?

10

Page 11: CREATING A CULTURE OF EVALUATION

1111

Page 12: CREATING A CULTURE OF EVALUATION

1212

Page 13: CREATING A CULTURE OF EVALUATION

13

Edgar Schein - Culture is

A pattern of shared basic assumptions that the group learned as it solved its problems of external adaptation and internal integration, that has worked well enough to be considered valid and, therefore, to be taught to new members as the correct way you perceive, think, and feel in relation to those problems.

13

Page 14: CREATING A CULTURE OF EVALUATION

14

CULTURE BARRIERS

14

Page 15: CREATING A CULTURE OF EVALUATION

1515

Page 16: CREATING A CULTURE OF EVALUATION

1616

Page 17: CREATING A CULTURE OF EVALUATION

17

CHANGE IS INEVITABLE; SUCCESS IS NOT!

Decline in traditional funding/revenue

Emerging needs

Increased competition for funding

Increased accountability for results

17

Page 18: CREATING A CULTURE OF EVALUATION

18

CHANGE IS HARD!

oPeople will resist changeoResistance is naturaloA sense of loss is normaloIt won’t happen

overnight

18

Page 19: CREATING A CULTURE OF EVALUATION

19

CHANGE MANAGEMENT CAN HELP…

A structured approach to transitioning individuals, teams and organizations from the present state to the desired future state

A process aimed at empowering employees to accept and embrace changes

19

Page 20: CREATING A CULTURE OF EVALUATION

20

LEADERSHIP KEYS FOR SUCCESS

1.Urgency and clear image of the

future

2.Guiding coalition

3.Vision and Strategy

4.Communications

20Adapted from John Kotter “8 Steps for Leading Change”

Page 21: CREATING A CULTURE OF EVALUATION

21

LEADERSHIP KEYS FOR SUCCESS

5.Infrastructure, systems and training

6. Short term wins 7.Participate in the change!

21Adapted from John Kotter

“8 Steps for Leading Change”

Page 22: CREATING A CULTURE OF EVALUATION

22

CREATE EVALUATION CULTURE: STAFF

1.Expand vocabulary2.Focus on data driven

decision making3.Acknowledge evaluation as

an element of strategic management

4.Use existing structures5.Use Logic Models as

Management Tools6. Ask the right evaluation

questions 22

Page 23: CREATING A CULTURE OF EVALUATION

23

DATA DRIVEN DECISION MAKING

23

Page 24: CREATING A CULTURE OF EVALUATION

24

STRATEGIC MANAGEMENT

24

Page 25: CREATING A CULTURE OF EVALUATION

25

USE EXISTING STRUCTURES

25

Reporting•Create reporting matrix

Planning Processes & Updates•Strategic planning, Annual planning, Budgeting

Program Implementation•Natural collection points

Communications•Annual reports, newsletters, websites, appeals

Peer Networks•Share data collection tools & systems

Page 26: CREATING A CULTURE OF EVALUATION

26

LOGIC MODEL = MANAGEMENT TOOL

26

Needs Inputs Activities Outputs(Efficiency)

Outcomes(Effectiveness)

Why is your program in existence?

What needs does this program meet that no other does?

What resources do you allocate to meet the needs?

What do you do day-to-day?

What’s working?

What’s not working?

What happens as a result of your activities?

What are the goals?What impact does the program have on the participants? What change in behavior, attitude or skill are you expecting to see?

Page 27: CREATING A CULTURE OF EVALUATION

27

ASK THE RIGHT QUESTIONS

27

Page 28: CREATING A CULTURE OF EVALUATION

28

ASK THE RIGHT QUESTIONS

28

Page 29: CREATING A CULTURE OF EVALUATION

29

CREATE EVALUATION CULTURE: BOARD

Focus on improved governance Integrate into strategic

planning process & reviews

Align to organization dashboards

Create evaluation committee/request summary of grant reports

Model data driven decision making

29

Page 30: CREATING A CULTURE OF EVALUATION

30

Q&A

30

Page 31: CREATING A CULTURE OF EVALUATION

31

Thank you!

Margo Bailey, [email protected]

Visit our Website: www.brighterstrategies.com

Visit our Blog: http://brighterstrategies.com/blog/

31