Research into Action: Using Evidence to Inform I + PSE...
Transcript of Research into Action: Using Evidence to Inform I + PSE...
![Page 1: Research into Action: Using Evidence to Inform I + PSE Effortsmchnutritionpartners.ucla.edu/sites/default/files... · 4/5/2018 · •Holly Nicastro •Russ Pate •Robyn Sagatov](https://reader034.fdocuments.us/reader034/viewer/2022050509/5f99fb08e3a2e079887223f5/html5/thumbnails/1.jpg)
Western MCH Nutrition Leadership Network ♦ April 5, 2018 ♦ Redondo Beach
Lorrene Ritchie, PhD, RD
Director and CE Specialist
Research into Action:
Using Evidence to
Inform I + PSE Efforts
![Page 3: Research into Action: Using Evidence to Inform I + PSE Effortsmchnutritionpartners.ucla.edu/sites/default/files... · 4/5/2018 · •Holly Nicastro •Russ Pate •Robyn Sagatov](https://reader034.fdocuments.us/reader034/viewer/2022050509/5f99fb08e3a2e079887223f5/html5/thumbnails/3.jpg)
![Page 4: Research into Action: Using Evidence to Inform I + PSE Effortsmchnutritionpartners.ucla.edu/sites/default/files... · 4/5/2018 · •Holly Nicastro •Russ Pate •Robyn Sagatov](https://reader034.fdocuments.us/reader034/viewer/2022050509/5f99fb08e3a2e079887223f5/html5/thumbnails/4.jpg)
![Page 6: Research into Action: Using Evidence to Inform I + PSE Effortsmchnutritionpartners.ucla.edu/sites/default/files... · 4/5/2018 · •Holly Nicastro •Russ Pate •Robyn Sagatov](https://reader034.fdocuments.us/reader034/viewer/2022050509/5f99fb08e3a2e079887223f5/html5/thumbnails/6.jpg)
![Page 9: Research into Action: Using Evidence to Inform I + PSE Effortsmchnutritionpartners.ucla.edu/sites/default/files... · 4/5/2018 · •Holly Nicastro •Russ Pate •Robyn Sagatov](https://reader034.fdocuments.us/reader034/viewer/2022050509/5f99fb08e3a2e079887223f5/html5/thumbnails/9.jpg)
How much food
marketing
is for healthy
foods?
![Page 11: Research into Action: Using Evidence to Inform I + PSE Effortsmchnutritionpartners.ucla.edu/sites/default/files... · 4/5/2018 · •Holly Nicastro •Russ Pate •Robyn Sagatov](https://reader034.fdocuments.us/reader034/viewer/2022050509/5f99fb08e3a2e079887223f5/html5/thumbnails/11.jpg)
How many ads does a
child need to see before
wanting a product?
![Page 13: Research into Action: Using Evidence to Inform I + PSE Effortsmchnutritionpartners.ucla.edu/sites/default/files... · 4/5/2018 · •Holly Nicastro •Russ Pate •Robyn Sagatov](https://reader034.fdocuments.us/reader034/viewer/2022050509/5f99fb08e3a2e079887223f5/html5/thumbnails/13.jpg)
What Messages do Children Hear
Most Loud & Clear?
Amount of
Nutrition Education
kids get in school?
Amount of
Food Advertisements
kids see on TV?
(Sources: CDC & Story, 2004)
![Page 14: Research into Action: Using Evidence to Inform I + PSE Effortsmchnutritionpartners.ucla.edu/sites/default/files... · 4/5/2018 · •Holly Nicastro •Russ Pate •Robyn Sagatov](https://reader034.fdocuments.us/reader034/viewer/2022050509/5f99fb08e3a2e079887223f5/html5/thumbnails/14.jpg)
$-
$0.50
$1.00
$1.50
$2.00
$2.50
$3.00
$3.50
$4.00
$4.50
Fast food industry US Government
Bil
lio
ns
Playing field is not level!
0
![Page 15: Research into Action: Using Evidence to Inform I + PSE Effortsmchnutritionpartners.ucla.edu/sites/default/files... · 4/5/2018 · •Holly Nicastro •Russ Pate •Robyn Sagatov](https://reader034.fdocuments.us/reader034/viewer/2022050509/5f99fb08e3a2e079887223f5/html5/thumbnails/15.jpg)
FOOD
is
EVERYWHERE
![Page 17: Research into Action: Using Evidence to Inform I + PSE Effortsmchnutritionpartners.ucla.edu/sites/default/files... · 4/5/2018 · •Holly Nicastro •Russ Pate •Robyn Sagatov](https://reader034.fdocuments.us/reader034/viewer/2022050509/5f99fb08e3a2e079887223f5/html5/thumbnails/17.jpg)
Maximum
Calories FOR
Minimal cost
AND
Maximal appeal
![Page 18: Research into Action: Using Evidence to Inform I + PSE Effortsmchnutritionpartners.ucla.edu/sites/default/files... · 4/5/2018 · •Holly Nicastro •Russ Pate •Robyn Sagatov](https://reader034.fdocuments.us/reader034/viewer/2022050509/5f99fb08e3a2e079887223f5/html5/thumbnails/18.jpg)
More Served = More Eaten
![Page 19: Research into Action: Using Evidence to Inform I + PSE Effortsmchnutritionpartners.ucla.edu/sites/default/files... · 4/5/2018 · •Holly Nicastro •Russ Pate •Robyn Sagatov](https://reader034.fdocuments.us/reader034/viewer/2022050509/5f99fb08e3a2e079887223f5/html5/thumbnails/19.jpg)
What are Healthy Portion Sizes?
1-2 years old 3-5 years old adult
(Source: Santa Clara Public Health Dept)
![Page 20: Research into Action: Using Evidence to Inform I + PSE Effortsmchnutritionpartners.ucla.edu/sites/default/files... · 4/5/2018 · •Holly Nicastro •Russ Pate •Robyn Sagatov](https://reader034.fdocuments.us/reader034/viewer/2022050509/5f99fb08e3a2e079887223f5/html5/thumbnails/20.jpg)
How can we help children and
their families be more healthy?
![Page 21: Research into Action: Using Evidence to Inform I + PSE Effortsmchnutritionpartners.ucla.edu/sites/default/files... · 4/5/2018 · •Holly Nicastro •Russ Pate •Robyn Sagatov](https://reader034.fdocuments.us/reader034/viewer/2022050509/5f99fb08e3a2e079887223f5/html5/thumbnails/21.jpg)
Roadmap
Community Health Initiative
(CHI)
• 58 communities in 6 states
• Prospective
• 2006-2016
Healthy Communities Study (HCS)
• 130 U.S. communities
• Retrospective
• 2010-2016
CA Healthy Kids Study
(CHKS)
• 60 communities in California
• Retrospective
• 2014-2017
1 2 3
![Page 22: Research into Action: Using Evidence to Inform I + PSE Effortsmchnutritionpartners.ucla.edu/sites/default/files... · 4/5/2018 · •Holly Nicastro •Russ Pate •Robyn Sagatov](https://reader034.fdocuments.us/reader034/viewer/2022050509/5f99fb08e3a2e079887223f5/html5/thumbnails/22.jpg)
What are we learning to inform future efforts?
How are community programs, policies & practices
changing?
How are community efforts impacting child nutrition,
physical activity and BMI?
1
2
3
Research Questions Research Questions
![Page 23: Research into Action: Using Evidence to Inform I + PSE Effortsmchnutritionpartners.ucla.edu/sites/default/files... · 4/5/2018 · •Holly Nicastro •Russ Pate •Robyn Sagatov](https://reader034.fdocuments.us/reader034/viewer/2022050509/5f99fb08e3a2e079887223f5/html5/thumbnails/23.jpg)
Kaiser Permanente’s Community Health Initiative (CHI)
6 sites
NCAL
SCAL
3
58 sites Median duration: 4 years
Community Health Initiative 1
![Page 24: Research into Action: Using Evidence to Inform I + PSE Effortsmchnutritionpartners.ucla.edu/sites/default/files... · 4/5/2018 · •Holly Nicastro •Russ Pate •Robyn Sagatov](https://reader034.fdocuments.us/reader034/viewer/2022050509/5f99fb08e3a2e079887223f5/html5/thumbnails/24.jpg)
Proposed Focus areas
School
breakfast
Cal
Fresh
Safe Routes
to School
Rethink your
Drink
Garden
education
SSB
policy
Food
Banks Youth
Engagement
Healthy
meetings
Schools Sugary
Drinks
Parks/
Walking Park
changes Church
healthy
guidelines
CHI: Narrowing Focus
![Page 25: Research into Action: Using Evidence to Inform I + PSE Effortsmchnutritionpartners.ucla.edu/sites/default/files... · 4/5/2018 · •Holly Nicastro •Russ Pate •Robyn Sagatov](https://reader034.fdocuments.us/reader034/viewer/2022050509/5f99fb08e3a2e079887223f5/html5/thumbnails/25.jpg)
25
Document strategies
Dose
•Youth Survey
•Fitnessgram
Interviews
Online surveys
Photovoice
Strategy
evaluations
CHI: Evaluation Methods CHI: Evaluation Methods
![Page 26: Research into Action: Using Evidence to Inform I + PSE Effortsmchnutritionpartners.ucla.edu/sites/default/files... · 4/5/2018 · •Holly Nicastro •Russ Pate •Robyn Sagatov](https://reader034.fdocuments.us/reader034/viewer/2022050509/5f99fb08e3a2e079887223f5/html5/thumbnails/26.jpg)
DOSE
Percent
of people
touched
REACH
Expected
impact for
each person
touched
STRENGTH
CHI: Population Dose CHI: Population Dose
![Page 27: Research into Action: Using Evidence to Inform I + PSE Effortsmchnutritionpartners.ucla.edu/sites/default/files... · 4/5/2018 · •Holly Nicastro •Russ Pate •Robyn Sagatov](https://reader034.fdocuments.us/reader034/viewer/2022050509/5f99fb08e3a2e079887223f5/html5/thumbnails/27.jpg)
Reach Strength Dose
Teachers promote walking/biking to school 74% 1.3% 1.0% Recess coaches trained and hired 21% 4.2% 0.9% 4th grade teachers do 30 minutes of “instant
recess” in the classroom
38% 11.2% 4.3%
New playground equipment 100% 2.0% 2.0%
Total Dose 8.2%
CHI: Dose Cluster Example
![Page 28: Research into Action: Using Evidence to Inform I + PSE Effortsmchnutritionpartners.ucla.edu/sites/default/files... · 4/5/2018 · •Holly Nicastro •Russ Pate •Robyn Sagatov](https://reader034.fdocuments.us/reader034/viewer/2022050509/5f99fb08e3a2e079887223f5/html5/thumbnails/28.jpg)
Estimate the dose of efforts targeting same outcome
Measure change in outcome
Look for alignment between estimated and measured impact
1
2
3
CHI: Finding dose-aligned population changes
![Page 29: Research into Action: Using Evidence to Inform I + PSE Effortsmchnutritionpartners.ucla.edu/sites/default/files... · 4/5/2018 · •Holly Nicastro •Russ Pate •Robyn Sagatov](https://reader034.fdocuments.us/reader034/viewer/2022050509/5f99fb08e3a2e079887223f5/html5/thumbnails/29.jpg)
Positive
None
Population-level change in outcomes
Population dose of intervention
Lower Higher
Youth - SSBs
Adult - SSBs Youth - Healthy Food
Youth - Physical Activity
Adult - Physical Activity
Adult - Fruits & Vegetables
Adult - Healthy Food Youth - Fruits & Vegetables
CHI: Alignment Between Dose Estimates & Outcomes
![Page 30: Research into Action: Using Evidence to Inform I + PSE Effortsmchnutritionpartners.ucla.edu/sites/default/files... · 4/5/2018 · •Holly Nicastro •Russ Pate •Robyn Sagatov](https://reader034.fdocuments.us/reader034/viewer/2022050509/5f99fb08e3a2e079887223f5/html5/thumbnails/30.jpg)
Stratified random +
purposeful sampling
Household survey
Windshield observation
Interviews*
Surveys
Observations
Document review
Medical record
abstraction*
CHI: Evaluation Methods Healthy Communities Study: Evaluation Methods
BMI &
waist circ
msmt *10 yr retrospective
130 communities
5138 children
2
![Page 31: Research into Action: Using Evidence to Inform I + PSE Effortsmchnutritionpartners.ucla.edu/sites/default/files... · 4/5/2018 · •Holly Nicastro •Russ Pate •Robyn Sagatov](https://reader034.fdocuments.us/reader034/viewer/2022050509/5f99fb08e3a2e079887223f5/html5/thumbnails/31.jpg)
31
CHI: Evaluation Methods HCS: Intensity Scores
Behavioral Strategy (how)
• Providing information
• Modifying access or policy change
Duration (how long)
• One time
• Ongoing
Reach (how many)
• 1-5% of children
• 21% or more
Summed across each of 10 years for each community
![Page 32: Research into Action: Using Evidence to Inform I + PSE Effortsmchnutritionpartners.ucla.edu/sites/default/files... · 4/5/2018 · •Holly Nicastro •Russ Pate •Robyn Sagatov](https://reader034.fdocuments.us/reader034/viewer/2022050509/5f99fb08e3a2e079887223f5/html5/thumbnails/32.jpg)
HCS: Intensity scores for 130 communities over 10-years (N=9,681 community programs/policies)
![Page 33: Research into Action: Using Evidence to Inform I + PSE Effortsmchnutritionpartners.ucla.edu/sites/default/files... · 4/5/2018 · •Holly Nicastro •Russ Pate •Robyn Sagatov](https://reader034.fdocuments.us/reader034/viewer/2022050509/5f99fb08e3a2e079887223f5/html5/thumbnails/33.jpg)
HCS: Relationship Between Intensity Scores & BMI
-1.4 BMI units
Temporal relationship: 2 years prior, 2 years duration
![Page 34: Research into Action: Using Evidence to Inform I + PSE Effortsmchnutritionpartners.ucla.edu/sites/default/files... · 4/5/2018 · •Holly Nicastro •Russ Pate •Robyn Sagatov](https://reader034.fdocuments.us/reader034/viewer/2022050509/5f99fb08e3a2e079887223f5/html5/thumbnails/34.jpg)
HCS: But….Equity is an Issue
![Page 35: Research into Action: Using Evidence to Inform I + PSE Effortsmchnutritionpartners.ucla.edu/sites/default/files... · 4/5/2018 · •Holly Nicastro •Russ Pate •Robyn Sagatov](https://reader034.fdocuments.us/reader034/viewer/2022050509/5f99fb08e3a2e079887223f5/html5/thumbnails/35.jpg)
HCS: Characteristics of Community Efforts
DOSE More Intense
•Duration longer
•Reach more children
•Strategy more policy, systems, or environmental
HOW More or Which
Strategies
• Information
•Services
•Access
•Consequences
•Policy/systems
WHAT More or Which
Behaviors
• Fruit & vegetables
• Whole grains
• Sugary drinks
• Water
• Energy-dense
snacks/sweets
• Fat
• Calories
• Breakfast
• Fast food
![Page 36: Research into Action: Using Evidence to Inform I + PSE Effortsmchnutritionpartners.ucla.edu/sites/default/files... · 4/5/2018 · •Holly Nicastro •Russ Pate •Robyn Sagatov](https://reader034.fdocuments.us/reader034/viewer/2022050509/5f99fb08e3a2e079887223f5/html5/thumbnails/36.jpg)
HCS: Associations of Community Efforts over Past 6 years
with Dietary Outcomes
More Intense
•↑ lower-fat milk
More Strategies & Restricting Availability
of Less Healthy
•↓ added sugar
•↓ sugary drinks
More Behaviors & Targeting Less
Healthy
•↑ fruit & vegetables
![Page 37: Research into Action: Using Evidence to Inform I + PSE Effortsmchnutritionpartners.ucla.edu/sites/default/files... · 4/5/2018 · •Holly Nicastro •Russ Pate •Robyn Sagatov](https://reader034.fdocuments.us/reader034/viewer/2022050509/5f99fb08e3a2e079887223f5/html5/thumbnails/37.jpg)
Included in Model Outputs of Model
School
meal
quality
PE
quality Food
Assistance
programs
School PA
facilities
Built
environment
SSB
policy
School
garden Neighborhood
walkabiity
Nutrition
education
Z X Y School
wellness
policy Fast Food
near school
CA Healthy Kids Survey: Let Data Do the Talking
>70 community factors Select impactful factors
3
![Page 38: Research into Action: Using Evidence to Inform I + PSE Effortsmchnutritionpartners.ucla.edu/sites/default/files... · 4/5/2018 · •Holly Nicastro •Russ Pate •Robyn Sagatov](https://reader034.fdocuments.us/reader034/viewer/2022050509/5f99fb08e3a2e079887223f5/html5/thumbnails/38.jpg)
Purposeful + weighted
random sampling
Observations
Interviews
Environmental
(GIS) data
CHI: Evaluation Methods CHKS: Evaluation Methods
BMI
(Fitness-
gram)
60
Middle
schools
3
![Page 39: Research into Action: Using Evidence to Inform I + PSE Effortsmchnutritionpartners.ucla.edu/sites/default/files... · 4/5/2018 · •Holly Nicastro •Russ Pate •Robyn Sagatov](https://reader034.fdocuments.us/reader034/viewer/2022050509/5f99fb08e3a2e079887223f5/html5/thumbnails/39.jpg)
CA Healthy Kids Study: Data Adaptive Approach
>70 variables on
nutrition & physical
activity CPPs
Perform PCA on each
dataset* to define
independent
variables and regress
with BMI
Combine regression
estimates with
weights to generate
combination of
variables with
strongest impact
Perform targeted
analysis on
combination of
variables to estimate
size of this impact
Average impact
estimates from each
dataset to generate
final estimate of
combined impact
*Divided into 10 datasets, each with 9/10 of total communities
![Page 40: Research into Action: Using Evidence to Inform I + PSE Effortsmchnutritionpartners.ucla.edu/sites/default/files... · 4/5/2018 · •Holly Nicastro •Russ Pate •Robyn Sagatov](https://reader034.fdocuments.us/reader034/viewer/2022050509/5f99fb08e3a2e079887223f5/html5/thumbnails/40.jpg)
Lessons Learned
• Dose concept useful for planning higher intensity efforts
that maximize reach
• Cluster specific behaviors across the spectrum of
prevention (I + PSE): change social norms & systems!
• But simultaneously target multiple behaviors and not
focus only on the positive (e.g., increasing healthy foods
and beverages)
• Implementation longer (≥2 years) for weight change
![Page 41: Research into Action: Using Evidence to Inform I + PSE Effortsmchnutritionpartners.ucla.edu/sites/default/files... · 4/5/2018 · •Holly Nicastro •Russ Pate •Robyn Sagatov](https://reader034.fdocuments.us/reader034/viewer/2022050509/5f99fb08e3a2e079887223f5/html5/thumbnails/41.jpg)
Policy Process
Agenda Settiong
Formulation
Decision Making
Implementation
Monitoring & Evaluation
![Page 42: Research into Action: Using Evidence to Inform I + PSE Effortsmchnutritionpartners.ucla.edu/sites/default/files... · 4/5/2018 · •Holly Nicastro •Russ Pate •Robyn Sagatov](https://reader034.fdocuments.us/reader034/viewer/2022050509/5f99fb08e3a2e079887223f5/html5/thumbnails/42.jpg)
Agenda Setting
Formulation
Decision Making
Implementation
Monitoring & Evaluation
Advocates
Public
Sector
Private
Sector
Civil
Society
Executive
Branch
Legislative
Branch
Judicial
Branch
Donors
![Page 43: Research into Action: Using Evidence to Inform I + PSE Effortsmchnutritionpartners.ucla.edu/sites/default/files... · 4/5/2018 · •Holly Nicastro •Russ Pate •Robyn Sagatov](https://reader034.fdocuments.us/reader034/viewer/2022050509/5f99fb08e3a2e079887223f5/html5/thumbnails/43.jpg)
Complicated Interplay of Factors Contributing
(Source: Monasta, 2010)
![Page 44: Research into Action: Using Evidence to Inform I + PSE Effortsmchnutritionpartners.ucla.edu/sites/default/files... · 4/5/2018 · •Holly Nicastro •Russ Pate •Robyn Sagatov](https://reader034.fdocuments.us/reader034/viewer/2022050509/5f99fb08e3a2e079887223f5/html5/thumbnails/44.jpg)
Moving Forward
• Create stronger networks of researchers, practitioners,
residents, and decision-makers, locally and nationally
• Tell more complete stories of what works…and what
doesn’t
• Focus on bringing effective interventions to scale and
sustaining
• Support stronger investments in community-based efforts
to improve environments to support health
![Page 45: Research into Action: Using Evidence to Inform I + PSE Effortsmchnutritionpartners.ucla.edu/sites/default/files... · 4/5/2018 · •Holly Nicastro •Russ Pate •Robyn Sagatov](https://reader034.fdocuments.us/reader034/viewer/2022050509/5f99fb08e3a2e079887223f5/html5/thumbnails/45.jpg)
Acknowledgements
Community Health Initiative
• Kathryn Boyle
• Allen Cheadle
• Launa Craig
• Elena Kuo
• Hallie Randel-Schreiber
• Suzanne Rauzon
• Pam Schwartz
• Loel Solomon
• Dana Williamson
Healthy Communities Study
• Sonia Arteaga
• Lauren Au
• Vicki Collie-Akers
• Pat Crawford
• Jaime Dohack
• Steve Fawcett
• Edward Frongillo
• Wendi Gosliner
• Sri Hewawatharana
• Janice Kao
• Andrew Landgraf
California Healthy Kids Study
• Jen Ahern
• Dan Brown
• Sadie Costello
• Pat Crawford
• Rebecca Fisher
• Dana Gerstein
• Kris Madsen
• Ron Strochlic
• Mark van der Laan
• Laura Vollmer
• Gail Woodward-Lopez
• Catherine Loria
• Jyothi Nagaraja
• Linda Nebeling
• Holly Nicastro
• Russ Pate
• Robyn Sagatov
• Jerry Schultz
• Warren Strauss
• Karen Webb
• Dawn Wilson
• Gail Woodward-
Lopez
![Page 46: Research into Action: Using Evidence to Inform I + PSE Effortsmchnutritionpartners.ucla.edu/sites/default/files... · 4/5/2018 · •Holly Nicastro •Russ Pate •Robyn Sagatov](https://reader034.fdocuments.us/reader034/viewer/2022050509/5f99fb08e3a2e079887223f5/html5/thumbnails/46.jpg)
References
Cheadle A, et al. Approaches to measuring the extent and impact of environmental change in three California community-level obesity prevention
initiatives. Am J Public Health. 2010;100:2129-36.
Cheadle A, et al. Kaiser Permanente’s Community Health Initiative in Northern California: evaluation findings and lessons learned. Am J Health Promot.
2012;27:e59-68.
Cheadle A, et al. Using the Concept of “Population Dose” in Planning and Evaluating Community-Level Obesity Prevention Initiatives. Am J Eval
2012;34:71-84.
Arteaga SS, et al. The Healthy Communities Study: Its rationale, aims and approach. Am J Prev Med. 2015;49:615-23.
Fawcett SB, et al. Measuring community programs and policies in the Healthy Communities Study. Am J Prev Med. 2015;49:636-41.
Frongillo EA, et al. Community policies and programs to prevent obesity and child adiposity. Am J Prev Med. 2017;53:576-583.
Ritchie LD, et al. on behalf of the Healthy Communities Study Team. Community programs and policies are related to child nutrition - the Healthy
Communities Study. Pediatr Obes. 2018;(in press).
Ritchie LD, et al. Relationship of school and community nutrition and physical activity programs, policies and practices with healthy weight: the California
Healthy Kids Study. Amer J Prev Med. 2018;(in preparation).
Strauss WJ, et al. on behalf of the Healthy Communities Study Team. The longitudinal relationship between community programs and policies to prevent
childhood obesity and BMI in children: The Healthy Communities Study. Pediatr Obes. 2018 Feb 28.
Webb KL, et al. on behalf of the Healthy Communities Study Team. Features of nutrition-related community policies and programs associated with more
healthful dietary intakes among children; findings from the Healthy Communities Study. Pediatr Obes. 2018;(in press).
![Page 47: Research into Action: Using Evidence to Inform I + PSE Effortsmchnutritionpartners.ucla.edu/sites/default/files... · 4/5/2018 · •Holly Nicastro •Russ Pate •Robyn Sagatov](https://reader034.fdocuments.us/reader034/viewer/2022050509/5f99fb08e3a2e079887223f5/html5/thumbnails/47.jpg)
Lorrene Ritchie, PhD, RD
Director and CE Specialist
2115 Milvia Street, Suite 301, Berkeley, CA 94704
[email protected] ♦ 510-642-3589 ♦ npi.ucanr.edu
Research for healthy food, people and places