2018 MN SOPHE Summit Agenda

Inspiring Change:

Unleashing the Power of Public Health Education by

Enhancing Rigor to Increase Impact

Michael Quinn Patton

October 17, 2018

1

2

3

Public

Health EdEvaluation

4

5

RANTS andRUMINATIONS

#1. Avoiding research rigor mortis

Rigor Attribute Model

1. Hypothesis Exploration -- extent to which alternative explanations are considered in explaining data.

2. Explanation Critique -- captures how different perspectives can lead to divergent conclusions; Devil’s Advocate process.

6

Rigor Attribute Model

3. Information Validation -- the level at which information sources are corroborated and cross-validated. Triangulation.

4. Stance Analysis -- placing findings in a broad context that includes diverse cultural and political perspectives, and makes explicit the value positions that undergird all aspects of the process.

7

Rigor Attribute Model

5. Sensitivity Analysis – explicit reporting of assumptions and limitations of methods, data, and analysis.

6. Information Synthesis – Making sense of and interpreting data beyond simply collecting and listing data, and being explicit about the inevitability of interpretation and judgment – and the interpretation and judgment processes.

(Zelik, Patterson & Woods, 2007).

8

Rumination 2:

Beware Fool’s Gold

9

RIGOROUS SCIENTIFIC THINKING

GOLD STANDARD

METHODOLOGICALAPPROPRIATENESS

not

Methodologicalorthodoxy or rigidity

10

Strong evaluations

“Strong evaluations employ methods of

analysis that are appropriate to the

question; support the answer with evidence;

document the assumptions, procedures, and modes of analysis; and rule out the competing evidence.”

“There is no scientific method as such, but the vital feature of the scientist’s procedures has been merely to do his utmost with his mind, no holds barred”

12

PERCY BRIDGMAN1946 Nobel

Carl Sagan, cosmologist

“Science is a way of thinking much more than it is a body of knowledge.”

1934 - 1996

“You've never seen me debate anybody. On anything. Ever. My investment of time, as an educator, in my judgment, is best served teaching people how to think about the world around them. “Teach them how to pose a question. How to judge whether one thing is true versus another.”

STEM: Science, Technology, Engineering and Math"Science is more than a school subject, or the periodic table, or the properties of waves. It is an approach to the world, a critical way to understand and explore and engage with the world, and then have the capacity to change that world..."

President Barack Obama, March 23, 2015

Science, Technology, Engineering and Math: Education for Global Leadership | U.S. Department of Education

MARCH FOR SCIENCE

16

On April 22, 2017, millions marched for science in 600 cities worldwide (NY Times, 2017).

The American Evaluation Association was one of 270 partner organizations that supported the March for Science

17

I CANT BELIEVE I HAVE TO MARCH

FOR THISSHIT!!!!

21

The banality of evil

The banality of good

23

POST-TRUTH

ERA

In November, 2016, the Oxford Dictionaries announced post-truth as its international Word of the Year.

post-truth adjective: Relating to or denoting circumstances in which objective facts are less influential in shaping public opinion than appeals to emotion and personal belief.

Economics Nobel Prize recipient Daniel Kahneman (2002) won for his work on the psychology of judgment and decision-making.

Our rationality is bounded and distorted.

A major barrier to appropriately interpreting scientific and evaluation findings is our biased and illogical interpretation and decision-making processes.

“A reliable way to make people believe in falsehoods is frequent repetition, because familiarity is not easily distinguished from truth. Authoritarian institutions and marketers have always known this fact.”

Daniel Kahneman

The science of fake news, March 9, 2018

The spread of true and false news onlineSoroush Vosoughi, Deb Roy, Sinan Aral March 9, 2018

Spread of False Information

30

MIT StudyMarch, 2018

How fake news spreads online

• 12 year study

• 126,000 Twitter cascades

MIT Study Results

False stories are 70 percent more likely to be retweeted than true stories are.

Takes true stories about six times as long to reach 1,500 people as it does for false stories to reach the same number of people.

Falsehoods reach a cascade depth of 10 about 20 times faster than facts.

32

“If the bee disappeared off the face of the Earth, man would only have four years left to live.”

33

“If the bee disappeared off the face of the Earth, man would only have four years left to live.”

FACT CHECK

34

Public Health Educators as Fact Checkers

and Truth Tellers

35

TRUTH IS IN DANGER

IMPACT

Rigorous Evaluative Thinking

as a

Public Health Education Outcome

37

Public Health Ed Thinking Outcomes

How to…• Assess evidence• Make comparisons• Monitor & document well-being• Judge claims• Understand explanations• Make connections• Interpret advice

38

American Academy Of Pediatrics Lifts 'No Screens Under 2' Rule

39

40

Center for Individualized MedicineMedicine

41

Creating a healthier world, one patient at a time.

We are each our own interrupted time series design.

42

Educating to think

evaluatively

PracticingThinking

evaluatively

Public Health Educators

Clients,Consumers

Students,Patients

IMPACT IMPACT

Complex Systems Thinking

43

Understanding the

Elephant

from

a Systems Perspective

44

45

46

Logic Model for Pregnant Teens Program1. Program reaches out to pregnant teens

2. Pregnant teens enter and attend the program (participation)

3. Teens learn prenatal nutrition and self-care (increased knowledge)

4. Teens develop commitment to take care of themselvesand their babies (attitude change)

5. Teens adopt healthy behaviors: no smoking, no drinking,attend prenatal clinic, eat properly (behavior change)

6. Teens have healthy babies (desired outcome)

47

Systems web showing possible influence linkages to a pregnant teenager

Teachers/ other adults

Youngpregnantwoman's

attitudes &behaviors

Herparents &

other familymembers

Child'sfather & peers

Prenatal program

staff

Her peer group

48

Program systems web showing possible institutional influences affecting pregnant teenagers:

SCHOOLSYSTEM

Youngpregnantwomen's

attitudes &behaviors

PrenatalClinic andHospitalOutreach

Church

Prenatal program

Other community-based youth

programs

Other Systems-- welfare-- legal -- nutrition

programs-- transportation-- child

protection-- media messagesContext factors-- politics-- economic

incentives-- social norms-- culture-- music

YouthCulture

49

IMPACT

Systems Thinking

as a

Public Health Education Outcome

50

IMPACT

Complexity Thinking

as a

Public Health Education Outcome

51

52

Educating to think

evaluatively

PracticingThinking

evaluatively

Public Health Educators

Clients,Consumers

Students,Patients

IMPACT IMPACT

Thinking Globally

53

CLIMATE CHANGE

55

The Impacts of Climate Changeon Human Health in the United States: A Scientific AssessmentClimate change is a significant threat to the health of the American people.

This scientific assessment examines how climate change is already affecting human health and the changes that may occur in the future.

2016

1

56

57

•HOME•TOPICS•ABOUT US

search input field

MINNESOTA CLIMATE AND HEALTH PROFILE REPORT 2015

58

59

March 24, 2018March for Our Lives

61

MLK's granddaughter at March for Our Lives:

“I have a dream that enough is enough”

Yolanda Renee King

62

63

Educating to think

evaluatively

PracticingThinking

evaluatively

Public Health Educators

Clients,Consumers

Students,Patients

IMPACT IMPACT

Rigorous Evaluation Thinking

• Systems thinking

• Strategic thinking

• Design thinking

• Complexity thinking

• Scientific thinking

• Mixed methods thinking

• Principles-driven thinking

• Innovation-focused thinking

• Visualization thinking

• Thinking globally

• IMPACT THINKING

64

EVALUATIVETHINKING as aPUBLIC HEALTH EDUCATIONOUTCOME

Inspiring Change by

Unleashing the Power of

Public Health Education

Through Rigorous Thinking Together for Systems Transformation

65

66

Closing Tribute toInspiring Change &Unleasing Power

2018 MN SOPHE Summit Agenda

Inspiring Change:

Unleashing the Power of Public Health Education by

Enhancing Rigor to Increase Impact

Michael Quinn Patton

October 17, 2018

67

Hallelujah

Sung to Hallelujah

Unleashing public health pow-er,

Evaluating impacts,

Rig-or-ous think-ing,

Changing systems.

And in this quest, we teach the facts,

Protecting people from Internet hacks,

Teaching thinking,

Wheat from chaff on health matters.68

Rigorous thinking,

Innovation,

Changing systems,

Evalu-aaaaa-tion…

69

Together we can navigateSystems-change com-plex-i-ties,Useful and inspiring Lessons share.

Where do we find them? From each other.Why do they matter?Because we care, what learningguides the health vision we share.

70

Rigorous thinking,

Inspiration,

Changing systems,

Public Health…

71

So let a thousand flowers bloom,Innovations to counter doom,Find tipping points of complex interactions.

With data guiding, we can say,Inspire changes on this dayThrough public health

edddd-u-cation,Hallelujah! x

72

Rigorous thinking,

Unleashing power,

Inspiring changes,

Public Health-hhhh…

73

Hallelujah,

Hallelujah,

Hallelujah,

Halle—luuuu--jah.

74

Leonard Cohen, 1934-2016

Inspiring Change, Unleashing Power, ~2018 -

75

Inspiring Change by

Unleashing the Power of

Public Health Education

Through Rigorous Thinking Together for Systems Transformation

76