ASNNA Justin Fast, Social Initiatives Specialist, Michigan Fitness Foundation Helen Idzorek, SNAP-Ed...
-
Upload
austen-blankenship -
Category
Documents
-
view
217 -
download
1
Transcript of ASNNA Justin Fast, Social Initiatives Specialist, Michigan Fitness Foundation Helen Idzorek, SNAP-Ed...
ASNNA
Justin Fast, Social Initiatives Specialist, Michigan Fitness Foundation
Helen Idzorek, SNAP-Ed & EFNEP Coordinator, Cooperative Extension Service, University of Alaska Fairbanks
Shailja Mathur, Senior Project Administrator, NJ SNAP-ED/EFNEP, NJ SNAP-Ed Support Networks, New Jersey Agriculture Experiment Station-RCE, Rutgers, The State University of New Jersey
Ana Claudia Zubieta, Ohio SNAP-Ed Director, Departments of Human Sciences and Extension, The Ohio State University
One Time Interventions
ASNNA
What is a “One Time Intervention” (OTI)?
• Formal or informal messages targeting participants who are not accessible beyond the initial intervention
• Administered to meet very specific needs of a community or in association with another event
• Face to face or using technology
ASNNA
• Great way to increase reach of people
• Reach people in non-traditional setting
• Reach people who lack motivation or face other barriers to attend a formal class
• Motivate participants to participate in more formal nutrition education
Why “One Time Interventions”?
ASNNA
• USDA FNS stresses the need to:– Increase reach– Increase use of practice-tested and evidence-
based interventions– Improve outcome evaluation of all interventions
• SNAP-Ed implements direct or indirect OTI out of necessity
• No evidence base of community of best practices exists
• The introduction of PSE in the FY13 SNAP-Ed guidance has set the stage for expanded use of OTI
What Do We Know?
ASNNA
• OTI are suitable with large and diverse groups (higher reach)
• OTI are problematic to implement with fidelity and evaluate with rigor
• There is a lack of “best practices” on OTI
Why a Survey?
ASNNA
• A workgroup to address these questions was formed after the annual ASNNA conference in February 2014
Justin Fast (Chair)Helen Idzorek Shailja Mathur Ana Claudia Zubieta
• We met via conference call several times• Developed a survey to distribute among SNAP-Ed
and EFNEP list serves • Analyzed and discussed results
How We Did It?
ASNNA
Survey Results
ASNNALead / Administrative Staff Program Staff
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
90.9%
10.9%
What is your role as it relates to nutrition education?
ASNNA
Yes85%
No15%
Do you implement any interventions which are one-time only?
ASNNA
40.5%
33.3%
14.3%
7.1%
4.8%
Component of a broader practice-tested intervention series
Practice-Tested
Research-Tested
None of the above
Component of a broader research-tested interven-tion series
Which situation best describesyour intervention?
ASNNA
2 4 5 10 15 20 30 45 60 80 90 105 120 150 180 2400
2
4
6
8
10
12
14
Minutes
Response F
requency
How long are these interventions?
ASNNA
44%
56%
recruit in advanceengage onsite
How are participants recruited?
ASNNA
2 5 10 15 20 25 30 35 40 45 80 100 200 2500
0.5
1
1.5
2
2.5
3
3.5
4
4.5
Reach (Number of Individuals)
Response F
requency
OTI Reach
ASNNA
Formative Process Outcome Impact (with comparison
group)
None of the above
0%
10%
20%
30%
40%
50%
60%
70%
80%
36.1%
69.4%
50.0%
8.3%
16.7%
Type of Evaluation
ASNNA
Attitudes Knowledge Self-efficacy Intent Consumption None of the above
0%
10%
20%
30%
40%
50%
60%
70%
38.5%
59.0%
25.6%
59.0%
33.3%
7.7%
Perc
ent
of
Resondents
Which outcome indicators are evaluated?
ASNNA
43.6%
5.1%
48.7%
2.6%
Quantitative (numbers)
Qualitative (narrative, sounds, images, etc.)
Mixed method (both numbers and narrative/visuals)
None of the above
What types of data are collected?
ASNNA
15.8%2.6%
36.8%
36.8%
7.9%
pre-post (self-reported)
pre-post (observed)
retrospective only (self-reported)
intent only (self-reported)
None of the above
What is the evaluation design?
ASNNA
73.0%
27.0%
Yes
No
Is demographic information collected?
ASNNA
We collect self-re-ported demographic data directly from
participants
We obtain demo-graphic data via a third party which
has collected it for other purposes (school, pantry, worksite, etc.)
We report observed demographic data
from our interaction with participants
None of the above0%
10%
20%
30%
40%
50%
60%
70%60.0%
28.6%25.7%
8.6%
How is demographic information collected?
ASNNA
Direct Indirect0%
10%
20%
30%
40%
50%
60%
70%
60.7%
46.4%
Are OTI reported to EARS as “Direct” or “Indirect”?
ASNNA
1. Provide information for future planning
2. Assessing needs of the population
3. Parents are more engaged and eager to participate when food tasting with their kids
4. Engaging participants in experiential and relevant learning
Successes of OTI
ASNNA
5. Recommendations for more classes
6. Often the last booth to close 7. Participants indicate intention to use resources
Successes of OTI
ASNNA
1. Lack of top-down support to enable evaluation plan for multi-faceted interventions
2. Difficulties administering evaluation tools
1. Time2. Setting3. Lack of motivation
3. Inability to measure behavior change4. Incapacity to comply with FNS
Challenges
ASNNA
• OTI are widely used and are an important part of SNAP-Ed programming.
• A proportion of OTI programs implement one or more “best practices” in program implementation or evaluation.
• Establish the evidence base for OTIs required of SNAP-Ed programmers nationwide.
• Some common practices do need to be addressed.
• To ensure comparability between programs, it would be helpful to identify or establish a consistent “inventory” of potential SNAP-Ed outcome indicators from which practitioners could choose.
Implications for Practitioners
ASNNA
• Validated tools to evaluate very concrete, individual, learning objectives often taught in OTI settings are needed.
• More process evaluations specifically aimed at identifying best practices for performing onsite evaluations in difficult settings are needed.
• Broad program outcome evaluations with internal comparison groups, i.e. “with” and “without” the addition of a OTI component.
Implications for Practitioners
ASNNA
THANK YOU!