Demonstrating Value Back at Work (OEB11)

50
Demonstrating Value Back at Work BUS25 – Online Educa Berlin 2011 Learning doesn’t HAVE value. Learning GETS value.

description

Used for the learning cafe 'Demonstrating Value Back At Work' at Online Educa Berlin 2011.

Transcript of Demonstrating Value Back at Work (OEB11)

Page 1: Demonstrating Value Back at Work (OEB11)

Demonstrating Value Back at Work

BUS25 – Online Educa Berlin 2011

Learning doesn’t HAVE value. Learning GETS value.

Page 2: Demonstrating Value Back at Work (OEB11)

Welcome. I’m Bert De Coutere.Nice to meet you.

Page 3: Demonstrating Value Back at Work (OEB11)

“How can we better demonstrate the value of learning initiatives?”

1 state of the art

2 divergence

3 convergence

Page 4: Demonstrating Value Back at Work (OEB11)

0

13

2

Page 5: Demonstrating Value Back at Work (OEB11)

Short term

Long term

homocompetens.com

This session is also in itself an experiment to drive the impact of a learning activity.

Page 6: Demonstrating Value Back at Work (OEB11)

Short term

Long term

homocompetens.com

Individual Exercise• What’s your learning mojo?• Write down a few learning initiatives

you want to demonstrate value for.

Page 7: Demonstrating Value Back at Work (OEB11)

In my experience way more energy goes into discussing evaluation than doing it. (Tom Gram)

1 state of the art

Page 8: Demonstrating Value Back at Work (OEB11)

But surely people are our greatest asset...

Page 9: Demonstrating Value Back at Work (OEB11)
Page 10: Demonstrating Value Back at Work (OEB11)
Page 11: Demonstrating Value Back at Work (OEB11)

Kirkpatrick and friends and

enemies

Page 12: Demonstrating Value Back at Work (OEB11)

Kirkpatrick critiques

“... then why don’t we just do it?”

• Ownership• Cost• Complexity

“... it dates from another age.”

What if it is not a formal classroom event?

Page 13: Demonstrating Value Back at Work (OEB11)
Page 14: Demonstrating Value Back at Work (OEB11)

The Valhalla of ROI

Page 15: Demonstrating Value Back at Work (OEB11)

ROI critiques

“... how valid is that number really for learning?”

• Intangible• Indirect• Time span• Multiple goals

“... who will pay for the calculation?”

Are our CEOs only looking for ROI numbers anyway?

Page 16: Demonstrating Value Back at Work (OEB11)

The dominant model in corporate learning measurement is the 4 level Kirkpatrick evaluation model, or a variation on it. Half of the model usually gets done because we can, the upper two levels mostly remain on the to do list. That is actually the half model that really counts. Besides the pragmatic issues of time, money and ownership to apply the whole model, the model itself is a child of a time when we thought training was learning and learning was a formal event. Since then learning professionals have recognized the other 80% or learning (informal, social). What if learning is also in the flow and process and connections rather than in a piece of content or event? What with learning by reflecting on experience and by doing? What if our aim is to build and model the learning ecosystem (high impact culture, workscape, ...) rather than training programs?

Page 17: Demonstrating Value Back at Work (OEB11)

Table talks

• Hello, my name is...• Hello, my learning initiative is...• Hello, this is how we demonstrate its

value at present (and the good and bad of that)

Page 18: Demonstrating Value Back at Work (OEB11)

Why do we measure impact?

For whom?

Who are our stakeholders?What do they

expect?

How do you know the most

and least impactful training?

What are the consequences of not proving

impact?

Page 19: Demonstrating Value Back at Work (OEB11)

“Learning doesn't HAVE value. Learning GETS value. It gets value through performance and behavior, and always within context.” (Source: You should say this.)

2 divergence

Page 20: Demonstrating Value Back at Work (OEB11)

So much to potentially measure

Page 21: Demonstrating Value Back at Work (OEB11)

Table talks

• What does this bring to my learning initiatives?

• Any lightbulbs?

Page 22: Demonstrating Value Back at Work (OEB11)
Page 23: Demonstrating Value Back at Work (OEB11)

1. Learning Landscape (W.Thalheimer)

Page 24: Demonstrating Value Back at Work (OEB11)

2. Learning Effectiveness Method (IBM)

Page 25: Demonstrating Value Back at Work (OEB11)

3. Statistics – control groups

Page 26: Demonstrating Value Back at Work (OEB11)

4. High Impact Learning (Bersin)

Page 27: Demonstrating Value Back at Work (OEB11)

5. Surveys, Dashboards (Metrics That Matter)

Page 28: Demonstrating Value Back at Work (OEB11)

6. From cause and effect to complex adaptive systems (Brandon Hall)

Page 29: Demonstrating Value Back at Work (OEB11)

7. The six disciplines of breakthrough learning (Fort Hill)

Page 30: Demonstrating Value Back at Work (OEB11)

8. Talent Management Systems (Cognos)

Page 31: Demonstrating Value Back at Work (OEB11)

9. Success Case Method (Brinkerhoff)

Page 32: Demonstrating Value Back at Work (OEB11)

10. The Big Question

How do you assess whether your informal learning, social learning, continuous learning, performance support initiatives have the desired impact or achieve the desired results?

Page 33: Demonstrating Value Back at Work (OEB11)

11. Keep, Tweak or Kill (Clark Quinn)

Page 34: Demonstrating Value Back at Work (OEB11)

12. Value Networks

Page 35: Demonstrating Value Back at Work (OEB11)

13. Balanced Scorecard

Page 36: Demonstrating Value Back at Work (OEB11)

14. Learning Portfolio

Page 37: Demonstrating Value Back at Work (OEB11)

15. Net Promoter Score

Page 38: Demonstrating Value Back at Work (OEB11)

16. Self Efficacy

Page 39: Demonstrating Value Back at Work (OEB11)

17. EPSS and 5 moments of need

Page 40: Demonstrating Value Back at Work (OEB11)

18. SkillRank (Mixtent)

Page 41: Demonstrating Value Back at Work (OEB11)

19. The breadcrumbs we leave behind

Page 42: Demonstrating Value Back at Work (OEB11)

20. The creative class / entrepreneurs

Page 43: Demonstrating Value Back at Work (OEB11)

What is the end game?

What measurements exist that you can leverage?

Can we better steer the

‘inflow’ of our trainings?

How do other business services

demonstrate value?

Page 45: Demonstrating Value Back at Work (OEB11)

In all their complexitiy, corporations are easy organisations...

Page 46: Demonstrating Value Back at Work (OEB11)

There seem to be really only 2 kinds of metrics...

Page 47: Demonstrating Value Back at Work (OEB11)

Value is...

Page 48: Demonstrating Value Back at Work (OEB11)

Table talks

• A brave new world...• Take 1 example per table to work

around• Report out to the group• That will be our ‘cook book’

Page 49: Demonstrating Value Back at Work (OEB11)

What is your ‘world view’ on

learning?

How would you visualise the evidence?

Is the new model

actionable?

Working backwards, holistic and adaptive.

Page 50: Demonstrating Value Back at Work (OEB11)

50

You haven’t learned anything from this session yet

Bad news !