Beyond the Numbers: The Use of Qualitative Methods to ...€¦ · Beyond the Numbers: The Use of...

27
Beyond the Numbers: The Use of Qualitative Methods to Support Decision-Making ANDE Metrics from the Ground Up 28 February 2018

Transcript of Beyond the Numbers: The Use of Qualitative Methods to ...€¦ · Beyond the Numbers: The Use of...

Page 1: Beyond the Numbers: The Use of Qualitative Methods to ...€¦ · Beyond the Numbers: The Use of Qualitative Methods to Support Decision-Making ANDE Metrics from the Ground Up 28

Beyond the Numbers: The Use of Qualitative Methods to Support Decision-Making

ANDE Metrics from the Ground Up

28 February 2018

Page 2: Beyond the Numbers: The Use of Qualitative Methods to ...€¦ · Beyond the Numbers: The Use of Qualitative Methods to Support Decision-Making ANDE Metrics from the Ground Up 28

Objectives

Page 3: Beyond the Numbers: The Use of Qualitative Methods to ...€¦ · Beyond the Numbers: The Use of Qualitative Methods to Support Decision-Making ANDE Metrics from the Ground Up 28

ObjectivesUncover the process of qualitative data

transformation.

Beyond definitions…

…to experience and use.

The ‘so what’:

Complementary to quantitative data

Intensive process but worth the effort

Page 4: Beyond the Numbers: The Use of Qualitative Methods to ...€¦ · Beyond the Numbers: The Use of Qualitative Methods to Support Decision-Making ANDE Metrics from the Ground Up 28

Interactive

Evaluation

methods

Page 5: Beyond the Numbers: The Use of Qualitative Methods to ...€¦ · Beyond the Numbers: The Use of Qualitative Methods to Support Decision-Making ANDE Metrics from the Ground Up 28

Human voting.

Strongly agree Strongly disagree

Tea is better than coffee.

Page 6: Beyond the Numbers: The Use of Qualitative Methods to ...€¦ · Beyond the Numbers: The Use of Qualitative Methods to Support Decision-Making ANDE Metrics from the Ground Up 28

Human voting.

Strongly agree Strongly disagree

Evidence is meaningless without qualitative

data

Page 7: Beyond the Numbers: The Use of Qualitative Methods to ...€¦ · Beyond the Numbers: The Use of Qualitative Methods to Support Decision-Making ANDE Metrics from the Ground Up 28

Choosing

corners

Option 1

Option 3

Option 2

Option 4

Page 8: Beyond the Numbers: The Use of Qualitative Methods to ...€¦ · Beyond the Numbers: The Use of Qualitative Methods to Support Decision-Making ANDE Metrics from the Ground Up 28

Choosing

corners

Strongly

Agree

Strongly

Disagree

Agree

Disagree

Qualitative data provides an opportunity to better inform

investment decisions

Page 9: Beyond the Numbers: The Use of Qualitative Methods to ...€¦ · Beyond the Numbers: The Use of Qualitative Methods to Support Decision-Making ANDE Metrics from the Ground Up 28

Cooperative

Interviews

Responder

RecorderInterviewer

Interviewer: seek input

Responder: tell your story

Recorder: document

Page 10: Beyond the Numbers: The Use of Qualitative Methods to ...€¦ · Beyond the Numbers: The Use of Qualitative Methods to Support Decision-Making ANDE Metrics from the Ground Up 28

Group exercise: in groups of

three Where do you see an opportunity to use

qualitative methods in your organization

going forward?

Page 11: Beyond the Numbers: The Use of Qualitative Methods to ...€¦ · Beyond the Numbers: The Use of Qualitative Methods to Support Decision-Making ANDE Metrics from the Ground Up 28

Analysing

qualitative

data

Page 12: Beyond the Numbers: The Use of Qualitative Methods to ...€¦ · Beyond the Numbers: The Use of Qualitative Methods to Support Decision-Making ANDE Metrics from the Ground Up 28

How do you

analyse?

• Jean A. King and Laurie Stevahn. Interactive Evaluation Practice: Mastering the Interpersonal Dynamics of

Program Evaluation.

Page 13: Beyond the Numbers: The Use of Qualitative Methods to ...€¦ · Beyond the Numbers: The Use of Qualitative Methods to Support Decision-Making ANDE Metrics from the Ground Up 28

Graffiti• Method used for qualitative data

interpretation.

• Identify themes relating to

the central concept.

• Once complete, transfer

sheet to next group.

Page 14: Beyond the Numbers: The Use of Qualitative Methods to ...€¦ · Beyond the Numbers: The Use of Qualitative Methods to Support Decision-Making ANDE Metrics from the Ground Up 28

1. Common opportunities to use

qualitative research are…

2. Exciting opportunities to use

qualitative research are…

In your groups:

Page 15: Beyond the Numbers: The Use of Qualitative Methods to ...€¦ · Beyond the Numbers: The Use of Qualitative Methods to Support Decision-Making ANDE Metrics from the Ground Up 28

Qualitative

data

visualisation

Page 16: Beyond the Numbers: The Use of Qualitative Methods to ...€¦ · Beyond the Numbers: The Use of Qualitative Methods to Support Decision-Making ANDE Metrics from the Ground Up 28

Because we are visual creatures

Page 17: Beyond the Numbers: The Use of Qualitative Methods to ...€¦ · Beyond the Numbers: The Use of Qualitative Methods to Support Decision-Making ANDE Metrics from the Ground Up 28

To communicate a point

Page 18: Beyond the Numbers: The Use of Qualitative Methods to ...€¦ · Beyond the Numbers: The Use of Qualitative Methods to Support Decision-Making ANDE Metrics from the Ground Up 28

To add legitimacy

Page 19: Beyond the Numbers: The Use of Qualitative Methods to ...€¦ · Beyond the Numbers: The Use of Qualitative Methods to Support Decision-Making ANDE Metrics from the Ground Up 28

Would you

rather…

Page 20: Beyond the Numbers: The Use of Qualitative Methods to ...€¦ · Beyond the Numbers: The Use of Qualitative Methods to Support Decision-Making ANDE Metrics from the Ground Up 28

This?

Proponents of qualitative data explained that

quantitative data can show trends but they don’t

explain the “why” behind the numbers, unlike

qualitative data provides a deeper

understanding of the “how and so what”. On the

other hand, proponents of quantitative data

explained that performance of an investment

cannot be measured qualitatively, and in

addition to this, projections cannot be made

using qualitative data.

Page 21: Beyond the Numbers: The Use of Qualitative Methods to ...€¦ · Beyond the Numbers: The Use of Qualitative Methods to Support Decision-Making ANDE Metrics from the Ground Up 28

or this?

Page 22: Beyond the Numbers: The Use of Qualitative Methods to ...€¦ · Beyond the Numbers: The Use of Qualitative Methods to Support Decision-Making ANDE Metrics from the Ground Up 28

Qualitative Chart

Chooser.

Page 23: Beyond the Numbers: The Use of Qualitative Methods to ...€¦ · Beyond the Numbers: The Use of Qualitative Methods to Support Decision-Making ANDE Metrics from the Ground Up 28

• Stephanie Evergreen: http://stephanieevergreen.com/

Page 24: Beyond the Numbers: The Use of Qualitative Methods to ...€¦ · Beyond the Numbers: The Use of Qualitative Methods to Support Decision-Making ANDE Metrics from the Ground Up 28

• Stephanie Evergreen: http://stephanieevergreen.com/

Page 25: Beyond the Numbers: The Use of Qualitative Methods to ...€¦ · Beyond the Numbers: The Use of Qualitative Methods to Support Decision-Making ANDE Metrics from the Ground Up 28

• Stephanie Evergreen: http://stephanieevergreen.com/

Page 26: Beyond the Numbers: The Use of Qualitative Methods to ...€¦ · Beyond the Numbers: The Use of Qualitative Methods to Support Decision-Making ANDE Metrics from the Ground Up 28

Wrap up

Questions?

Comments?