Patton keynote SOPHE MN Oct 17 2018 pdf keynot… · MIT Study Results False stories are 70 percent...
Transcript of Patton keynote SOPHE MN Oct 17 2018 pdf keynot… · MIT Study Results False stories are 70 percent...
2018 MN SOPHE Summit Agenda
Inspiring Change:
Unleashing the Power of Public Health Education by
Enhancing Rigor to Increase Impact
Michael Quinn Patton
October 17, 2018
1
2
3
Public
Health EdEvaluation
4
5
RANTS andRUMINATIONS
#1. Avoiding research rigor mortis
Rigor Attribute Model
1. Hypothesis Exploration -- extent to which alternative explanations are considered in explaining data.
2. Explanation Critique -- captures how different perspectives can lead to divergent conclusions; Devil’s Advocate process.
6
Rigor Attribute Model
3. Information Validation -- the level at which information sources are corroborated and cross-validated. Triangulation.
4. Stance Analysis -- placing findings in a broad context that includes diverse cultural and political perspectives, and makes explicit the value positions that undergird all aspects of the process.
7
Rigor Attribute Model
5. Sensitivity Analysis – explicit reporting of assumptions and limitations of methods, data, and analysis.
6. Information Synthesis – Making sense of and interpreting data beyond simply collecting and listing data, and being explicit about the inevitability of interpretation and judgment – and the interpretation and judgment processes.
(Zelik, Patterson & Woods, 2007).
8
Rumination 2:
Beware Fool’s Gold
9
RIGOROUS SCIENTIFIC THINKING
GOLD STANDARD
METHODOLOGICALAPPROPRIATENESS
not
Methodologicalorthodoxy or rigidity
10
Strong evaluations
“Strong evaluations employ methods of
analysis that are appropriate to the
question; support the answer with evidence;
document the assumptions, procedures, and modes of analysis; and rule out the competing evidence.”
“There is no scientific method as such, but the vital feature of the scientist’s procedures has been merely to do his utmost with his mind, no holds barred”
12
PERCY BRIDGMAN1946 Nobel
Carl Sagan, cosmologist
“Science is a way of thinking much more than it is a body of knowledge.”
1934 - 1996
“You've never seen me debate anybody. On anything. Ever. My investment of time, as an educator, in my judgment, is best served teaching people how to think about the world around them. “Teach them how to pose a question. How to judge whether one thing is true versus another.”
STEM: Science, Technology, Engineering and Math"Science is more than a school subject, or the periodic table, or the properties of waves. It is an approach to the world, a critical way to understand and explore and engage with the world, and then have the capacity to change that world..."
President Barack Obama, March 23, 2015
Science, Technology, Engineering and Math: Education for Global Leadership | U.S. Department of Education
MARCH FOR SCIENCE
16
On April 22, 2017, millions marched for science in 600 cities worldwide (NY Times, 2017).
The American Evaluation Association was one of 270 partner organizations that supported the March for Science
17
I CANT BELIEVE I HAVE TO MARCH
FOR THISSHIT!!!!
21
The banality of evil
The banality of good
23
POST-TRUTH
ERA
In November, 2016, the Oxford Dictionaries announced post-truth as its international Word of the Year.
post-truth adjective: Relating to or denoting circumstances in which objective facts are less influential in shaping public opinion than appeals to emotion and personal belief.
Economics Nobel Prize recipient Daniel Kahneman (2002) won for his work on the psychology of judgment and decision-making.
Our rationality is bounded and distorted.
A major barrier to appropriately interpreting scientific and evaluation findings is our biased and illogical interpretation and decision-making processes.
“A reliable way to make people believe in falsehoods is frequent repetition, because familiarity is not easily distinguished from truth. Authoritarian institutions and marketers have always known this fact.”
Daniel Kahneman
The science of fake news, March 9, 2018
The spread of true and false news onlineSoroush Vosoughi, Deb Roy, Sinan Aral March 9, 2018
Spread of False Information
30
MIT StudyMarch, 2018
How fake news spreads online
• 12 year study
• 126,000 Twitter cascades
MIT Study Results
False stories are 70 percent more likely to be retweeted than true stories are.
Takes true stories about six times as long to reach 1,500 people as it does for false stories to reach the same number of people.
Falsehoods reach a cascade depth of 10 about 20 times faster than facts.
32
“If the bee disappeared off the face of the Earth, man would only have four years left to live.”
33
“If the bee disappeared off the face of the Earth, man would only have four years left to live.”
FACT CHECK
34
Public Health Educators as Fact Checkers
and Truth Tellers
35
TRUTH IS IN DANGER
IMPACT
Rigorous Evaluative Thinking
as a
Public Health Education Outcome
37
Public Health Ed Thinking Outcomes
How to…• Assess evidence• Make comparisons• Monitor & document well-being• Judge claims• Understand explanations• Make connections• Interpret advice
38
American Academy Of Pediatrics Lifts 'No Screens Under 2' Rule
39
40
Center for Individualized MedicineMedicine
41
Creating a healthier world, one patient at a time.
We are each our own interrupted time series design.
42
Educating to think
evaluatively
PracticingThinking
evaluatively
Public Health Educators
Clients,Consumers
Students,Patients
IMPACT IMPACT
Complex Systems Thinking
43
Understanding the
Elephant
from
a Systems Perspective
44
45
46
Logic Model for Pregnant Teens Program1. Program reaches out to pregnant teens
2. Pregnant teens enter and attend the program (participation)
3. Teens learn prenatal nutrition and self-care (increased knowledge)
4. Teens develop commitment to take care of themselvesand their babies (attitude change)
5. Teens adopt healthy behaviors: no smoking, no drinking,attend prenatal clinic, eat properly (behavior change)
6. Teens have healthy babies (desired outcome)
47
Systems web showing possible influence linkages to a pregnant teenager
Teachers/ other adults
Youngpregnantwoman's
attitudes &behaviors
Herparents &
other familymembers
Child'sfather & peers
Prenatal program
staff
Her peer group
48
Program systems web showing possible institutional influences affecting pregnant teenagers:
SCHOOLSYSTEM
Youngpregnantwomen's
attitudes &behaviors
PrenatalClinic andHospitalOutreach
Church
Prenatal program
Other community-based youth
programs
Other Systems-- welfare-- legal -- nutrition
programs-- transportation-- child
protection-- media messagesContext factors-- politics-- economic
incentives-- social norms-- culture-- music
YouthCulture
49
IMPACT
Systems Thinking
as a
Public Health Education Outcome
50
IMPACT
Complexity Thinking
as a
Public Health Education Outcome
51
52
Educating to think
evaluatively
PracticingThinking
evaluatively
Public Health Educators
Clients,Consumers
Students,Patients
IMPACT IMPACT
Thinking Globally
53
CLIMATE CHANGE
55
The Impacts of Climate Changeon Human Health in the United States: A Scientific AssessmentClimate change is a significant threat to the health of the American people.
This scientific assessment examines how climate change is already affecting human health and the changes that may occur in the future.
2016
1
56
57
•HOME•TOPICS•ABOUT US
search input field
MINNESOTA CLIMATE AND HEALTH PROFILE REPORT 2015
58
59
March 24, 2018March for Our Lives
61
MLK's granddaughter at March for Our Lives:
“I have a dream that enough is enough”
Yolanda Renee King
62
63
Educating to think
evaluatively
PracticingThinking
evaluatively
Public Health Educators
Clients,Consumers
Students,Patients
IMPACT IMPACT
Rigorous Evaluation Thinking
• Systems thinking
• Strategic thinking
• Design thinking
• Complexity thinking
• Scientific thinking
• Mixed methods thinking
• Principles-driven thinking
• Innovation-focused thinking
• Visualization thinking
• Thinking globally
• IMPACT THINKING
64
EVALUATIVETHINKING as aPUBLIC HEALTH EDUCATIONOUTCOME
Inspiring Change by
Unleashing the Power of
Public Health Education
Through Rigorous Thinking Together for Systems Transformation
65
66
Closing Tribute toInspiring Change &Unleasing Power
2018 MN SOPHE Summit Agenda
Inspiring Change:
Unleashing the Power of Public Health Education by
Enhancing Rigor to Increase Impact
Michael Quinn Patton
October 17, 2018
67
Hallelujah
Sung to Hallelujah
Unleashing public health pow-er,
Evaluating impacts,
Rig-or-ous think-ing,
Changing systems.
And in this quest, we teach the facts,
Protecting people from Internet hacks,
Teaching thinking,
Wheat from chaff on health matters.68
Rigorous thinking,
Innovation,
Changing systems,
Evalu-aaaaa-tion…
69
Together we can navigateSystems-change com-plex-i-ties,Useful and inspiring Lessons share.
Where do we find them? From each other.Why do they matter?Because we care, what learningguides the health vision we share.
70
Rigorous thinking,
Inspiration,
Changing systems,
Public Health…
71
So let a thousand flowers bloom,Innovations to counter doom,Find tipping points of complex interactions.
With data guiding, we can say,Inspire changes on this dayThrough public health
edddd-u-cation,Hallelujah! x
72
Rigorous thinking,
Unleashing power,
Inspiring changes,
Public Health-hhhh…
73
Hallelujah,
Hallelujah,
Hallelujah,
Halle—luuuu--jah.
74
Leonard Cohen, 1934-2016
Inspiring Change, Unleashing Power, ~2018 -
75
Inspiring Change by
Unleashing the Power of
Public Health Education
Through Rigorous Thinking Together for Systems Transformation
76