Top Ten Developments in Qualitative Evaluation Over the Last Decade

Post on 11-Jul-2015

685 views 1 download

Tags:

Transcript of Top Ten Developments in Qualitative Evaluation Over the Last Decade

Los Angeles | London | New Delhi

Singapore | Washington DC

Michael Quinn Patton

December 2014 #SAGEtalks

Please be sure to check your settings

Make sure your volume is set appropriately

Make sure you have followed the instructions on your keypad properly

Make sure everything is plugged in properly to assure your devices are working correctly

If you continue to have audio or

visual difficulties, please let us know

via the Q&A box and one of our

SAGE employees will be happy to

assist you.You can also run a short test webinar to ensure your system settings are up-to-date: http://www.webex.com/test-meeting.html

Los Angeles | London | New Delhi

Singapore | Washington DC

Michael Quinn Patton

December 2014 #SAGEtalks

Please take a moment to answer a quick question from

our presenter.

Before we get started…

Los Angeles | London | New Delhi

Singapore | Washington DC

Top Ten Developments in Qualitative Evaluation Over the Last Decade

Content and Presentation byMichael Quinn Patton

Los Angeles | London | New Delhi

Singapore | Washington DC

Michael Quinn Patton

December 2014 #SAGEtalks

Michael Quinn Patton

University of MinnesotaUniversity of Wisconsin - Madison

American Evaluation Association

Nicole Elliott

Executive Marketing Manager, SAGE

Los Angeles | London | New Delhi

Singapore | Washington DC

Michael Quinn Patton

December 2014 #SAGEtalks

While we do our best to answer as many questions as we can, time constraints

may not allows us to answer every question. Thank you for understanding.

Send us your questions!

Using Twitter? Use the hashtag #SAGEtalks.

Send in your questions via the Q&A Box

on your screen. →

6Michael Quinn Patton

Top Ten Developments in Qualitative Evaluation over the Last Decade…

and Emergent Challenges

1980

1987

1990

2002

7

8

November 2014

10. PowerfulQualitativeSoftware

9

9. Social media as data --for data collection –and sharing findings

10

11

Complexity concepts are catching on. Under

“relationship status” Facebook just added

“dynamical” as an option.

8. Ethical challenges,IRB constraints

• Anticipating impact on participants

• Confidentiality with small sample sizes

• Appropriate compensation – principle of reciprocity

• IRB constraints

12

“I know your study is important. I’m just not ready to commit to being your case.”

7. Mixed Methods

13

14

Nov. 7, 1926 -

Jan. 8, 2013

Mixed Methods

571 1138 1459

Qualitative Methods

960 1434 1447 1547

Quantitative Methods

807 1403 1436 1580

2003 2011 2012 2013

AEA TIG Memberships

http://www.eval.org/p/cm/ld/fid=101

15

6.

16

Viet Nam Helmet Law

• Road traffic injuries have long been a leading cause of death and disability in Viet Nam.

• 60% of fatalities occur in motorcycle riders and passengers.

• Viet Nam has had a partial motorcycle helmet legislation since 1995. However, implementation and enforcement had been limited.

• On 15 December 2007, Viet Nam's first comprehensive mandatory helmet law came into effect, covering all riders and passengers on all roads nationwide. Penalties increased ten-fold and cohorts of police were mobilized for enforcement.

17

18

19

20

21

22

23

15 December, 2007

24

25

26

27

28

29

30

31

ResultsThe Asia Injury Prevention Foundation reported: “Nearly 100% of Vietnam’s motorbike users left home wearing a helmet. It was an unbelievable sight with a near instantaneous effect. Major hospitals report the number of patients admitted for traumatic brain injuries in the two days after the law’s enactment was much lower than on previous weekends. In Ho Chi Minh City alone, serious traffic accident injuries fell by almost 50 percent compared with pre-helmet weekends.”

32

5. Driven by evaluation practiceand users’ demands

• Doing QE (methods-driven) vs. grounded in theoretical traditions

• Short, tight timelines

• Large, multi-site studies

• Speed

33

34

ObservationUnderutilized

Interviewing dominates

35

4. Qualitative Evaluationas an Intervention

Process Use

36

Qualitative Evaluationas an Intervention

• Participatory evaluation

• Feminist evaluation

• Empowerment evaluation

• Collaborative evaluation

• Transformative evaluation

• Developmental evaluation

37

• Contextual Intelligence:

A Critical Competency

Matthew R. Kutz & Anita Bamford-Wade

38

3. Valuing Deep Contextual Understanding

• Realist Evaluation

Fundamental Issue:How the World Is Changed

Top-down dissemination of

“proven (RCT) best practice models”

versus

Bottoms-up contextual (qualitative)

adaptation

39

Evidence-based Models vs. Evidence-based Effective Principles

40

PRINCIPLESCONTEXT MATTERS

41

Five Paris Declaration Principles

1. Country ownership

2. Alignment

3. Harmonization

4. Mutual accountability

5. Managing for results

42

CONTEXT MATTERS

Contextual Understanding

43

Evaluating Principles:Qualitative Cases

44

2. Qualitative Evaluator as the Instrument:

Experience, Expertise,Cultural Competence….

45

Former AEA President Rodney Hopson, “Language Matters”

Personal Factor

Old age and treacheryAlways overcomes youth and skill

Waylon Jennings

46

1. Increased Purposeful Sampling

Options

47Snowball Sampling

Purposeful vs. PurposiveSampling

Sampling vs. case selection

48

49

50

Looking Ahead:Challenges and Opportunities

51

1. Building qualitative inquiry capacity

2. Interest in and resources to do serious, triangulated, in-depth

qualitative evaluations

52

3. Commitment to inquire seriously into

unintended consequences

53

andTaking Emergence

Seriously

4. Cumulative-LongitudinalIntegration

at the Case and Context Levels

Center for Individualized Medicine Medicine

54

Creating a healthier world, one patient at a time.

Michael Quinn Patton Claremont 2009

Los Angeles | London | New Delhi

Singapore | Washington DC

Michael Quinn Patton

December 2014 #SAGEtalks

While we do our best to answer as many questions as we can, time constraints

may not allows us to answer every question. Thank you for understanding.

Send us your questions!

Using Twitter? Use the hashtag #SAGEtalks.

Send in your questions via the Q&A Box

on your screen. →

Los Angeles | London | New Delhi

Singapore | Washington DC

Michael Quinn Patton

December 2014 #SAGEtalks

Webinar recording available on www.sagepub.com/sagetalks.

Top Ten Developments in Qualitative Evaluation Over the Last Decade

Michael Quinn Patton

• Twitter

• Facebook

• LinkedIn

To purchase the book for 20% off, please use discount code PATTON20 when purchasing on the website.Be sure to check our website for updates on our 2015 Spring webinar series!