Results from the 2005 Evaluation of MAPP Communities Julia Joh Elligers, MPH Senior Analyst National...
-
Upload
andrew-ramsey -
Category
Documents
-
view
214 -
download
0
Transcript of Results from the 2005 Evaluation of MAPP Communities Julia Joh Elligers, MPH Senior Analyst National...
![Page 1: Results from the 2005 Evaluation of MAPP Communities Julia Joh Elligers, MPH Senior Analyst National Association of County and City Health Officials December.](https://reader035.fdocuments.us/reader035/viewer/2022062511/551508b55503465e608b4836/html5/thumbnails/1.jpg)
Results from the 2005 Evaluation of MAPP Communities
Julia Joh Elligers, MPHSenior AnalystNational Association of County and City Health Officials
December 14, 2006MAPP Technical Assistance Webcast Series
![Page 2: Results from the 2005 Evaluation of MAPP Communities Julia Joh Elligers, MPH Senior Analyst National Association of County and City Health Officials December.](https://reader035.fdocuments.us/reader035/viewer/2022062511/551508b55503465e608b4836/html5/thumbnails/2.jpg)
History of MAPP• Created in 2001 by a workgroup of local
public health practitioners & national partners
• 9 demonstration sites• Since then, about 650 organizations
have referenced MAPP• Over 250 communities have fully
implemented the process• State-wide promotion of MAPP• Several communities are in their 2nd
iteration of MAPP
![Page 3: Results from the 2005 Evaluation of MAPP Communities Julia Joh Elligers, MPH Senior Analyst National Association of County and City Health Officials December.](https://reader035.fdocuments.us/reader035/viewer/2022062511/551508b55503465e608b4836/html5/thumbnails/3.jpg)
Data Source & Methods• 2005 National Profile of Local Health
Departments Study • Census of all LHDs in U.S. • Survey developed & administered by
NACCHO
• 2005 MAPP Evaluation • Survey developed & administered by
the Illinois Public Health Institute
http://www.naccho.org/topics/infrastructure/2005Profile.cfm
![Page 4: Results from the 2005 Evaluation of MAPP Communities Julia Joh Elligers, MPH Senior Analyst National Association of County and City Health Officials December.](https://reader035.fdocuments.us/reader035/viewer/2022062511/551508b55503465e608b4836/html5/thumbnails/4.jpg)
How would you classify yourself?
A. I work at a local health department (LHD).
B. I work at a local board of health.
C. I work at a state agency.
D. I work at a university.
E. I work at a public health non-profit or foundation.
F. I work at another type of organization.
![Page 5: Results from the 2005 Evaluation of MAPP Communities Julia Joh Elligers, MPH Senior Analyst National Association of County and City Health Officials December.](https://reader035.fdocuments.us/reader035/viewer/2022062511/551508b55503465e608b4836/html5/thumbnails/5.jpg)
• Who uses MAPP?
• How are communities implementing MAPP?
• What are benefits of completing the process?
• What factors are related to positive outcomes?
Presentation Roadmapp
![Page 6: Results from the 2005 Evaluation of MAPP Communities Julia Joh Elligers, MPH Senior Analyst National Association of County and City Health Officials December.](https://reader035.fdocuments.us/reader035/viewer/2022062511/551508b55503465e608b4836/html5/thumbnails/6.jpg)
Yes or No:
Do you think communities with larger health departments with lots of resources are more likely to implement MAPP?
![Page 7: Results from the 2005 Evaluation of MAPP Communities Julia Joh Elligers, MPH Senior Analyst National Association of County and City Health Officials December.](https://reader035.fdocuments.us/reader035/viewer/2022062511/551508b55503465e608b4836/html5/thumbnails/7.jpg)
How do MAPP communities compare to other local jurisdictions?
![Page 8: Results from the 2005 Evaluation of MAPP Communities Julia Joh Elligers, MPH Senior Analyst National Association of County and City Health Officials December.](https://reader035.fdocuments.us/reader035/viewer/2022062511/551508b55503465e608b4836/html5/thumbnails/8.jpg)
MAPP Users All LHDs
Median 64,642 34,436
Mean 240,240 130,999
Min 1,048 313
Max 6,036,744 9,998,371
Population Size of MAPP Users Compared to All LHDs
![Page 9: Results from the 2005 Evaluation of MAPP Communities Julia Joh Elligers, MPH Senior Analyst National Association of County and City Health Officials December.](https://reader035.fdocuments.us/reader035/viewer/2022062511/551508b55503465e608b4836/html5/thumbnails/9.jpg)
MAPP Users All LHDs
Median $32.47 $29.47
Mean $49.56 $40.60
Min $0.73 $0.40
Max $659.63 $659.63
Per Capita Expenditures of MAPP Users Compared to All LHDs
![Page 10: Results from the 2005 Evaluation of MAPP Communities Julia Joh Elligers, MPH Senior Analyst National Association of County and City Health Officials December.](https://reader035.fdocuments.us/reader035/viewer/2022062511/551508b55503465e608b4836/html5/thumbnails/10.jpg)
MAPP Users All LHDs
Median 42.5 19
Mean 117.5 66.5
Min 1 0
Max 1,351 5,807
MAPP Users Compared to All LHDs by Number of Employees
![Page 11: Results from the 2005 Evaluation of MAPP Communities Julia Joh Elligers, MPH Senior Analyst National Association of County and City Health Officials December.](https://reader035.fdocuments.us/reader035/viewer/2022062511/551508b55503465e608b4836/html5/thumbnails/11.jpg)
What factors increase the likelihood of implementing MAPP?
![Page 12: Results from the 2005 Evaluation of MAPP Communities Julia Joh Elligers, MPH Senior Analyst National Association of County and City Health Officials December.](https://reader035.fdocuments.us/reader035/viewer/2022062511/551508b55503465e608b4836/html5/thumbnails/12.jpg)
Infrastructure Capacity• Per Capita Expenditures• Per Capita FTE
Assessment & Planning Experience• CHA in the last 3 years• CHIP the last 3 years• APEX PH• PACE EH• NPHPS• PATCH
Controlled for FL, NJ, and CO
Factors Suspected to Increase Likelihood of MAPP Implementation
![Page 13: Results from the 2005 Evaluation of MAPP Communities Julia Joh Elligers, MPH Senior Analyst National Association of County and City Health Officials December.](https://reader035.fdocuments.us/reader035/viewer/2022062511/551508b55503465e608b4836/html5/thumbnails/13.jpg)
Increases the Likelihood of MAPP Use
Decreases the Likelihood of MAPP Use
• Use of APEX, NPHPS, PATCH
• State health department endorsement
• Increases in per capita FTE
• CHA in the last 3 years• CHIP in the last 3 years
Source: Julia Joh Elligers, 2006. “Factors that Predict the Implementation of MAPP in Local Communities.” Please do NOT cite without permission.
Statistically Significant Variables
![Page 14: Results from the 2005 Evaluation of MAPP Communities Julia Joh Elligers, MPH Senior Analyst National Association of County and City Health Officials December.](https://reader035.fdocuments.us/reader035/viewer/2022062511/551508b55503465e608b4836/html5/thumbnails/14.jpg)
• LHD per capita expenditures
• Use of PACE EH
Source: Julia Joh Elligers, 2006. “Factors that Predict the Implementation of MAPP in Local Communities.” Please do NOT cite without permission.
No Statistically Significant Effects
![Page 15: Results from the 2005 Evaluation of MAPP Communities Julia Joh Elligers, MPH Senior Analyst National Association of County and City Health Officials December.](https://reader035.fdocuments.us/reader035/viewer/2022062511/551508b55503465e608b4836/html5/thumbnails/15.jpg)
Experience with past planning and assessment tools matter more than infrastructure capacity in predicting MAPP use. However, communities who have completed a CHA or CHIP in the last 3 years are less likely to implement MAPP.
Source: Julia Joh Elligers, 2006. “Factors that Predict the Implementation of MAPP in Local Communities.” Please do NOT cite without permission.
Main conclusions
![Page 16: Results from the 2005 Evaluation of MAPP Communities Julia Joh Elligers, MPH Senior Analyst National Association of County and City Health Officials December.](https://reader035.fdocuments.us/reader035/viewer/2022062511/551508b55503465e608b4836/html5/thumbnails/16.jpg)
![Page 17: Results from the 2005 Evaluation of MAPP Communities Julia Joh Elligers, MPH Senior Analyst National Association of County and City Health Officials December.](https://reader035.fdocuments.us/reader035/viewer/2022062511/551508b55503465e608b4836/html5/thumbnails/17.jpg)
How would you classify yourself?
A. My community has implemented MAPP.
B. My community is interested in implementing MAPP.
C. I’m interested in learning more about MAPP.
D. None of the above.
![Page 18: Results from the 2005 Evaluation of MAPP Communities Julia Joh Elligers, MPH Senior Analyst National Association of County and City Health Officials December.](https://reader035.fdocuments.us/reader035/viewer/2022062511/551508b55503465e608b4836/html5/thumbnails/18.jpg)
How do MAPP communities implement the process?
![Page 19: Results from the 2005 Evaluation of MAPP Communities Julia Joh Elligers, MPH Senior Analyst National Association of County and City Health Officials December.](https://reader035.fdocuments.us/reader035/viewer/2022062511/551508b55503465e608b4836/html5/thumbnails/19.jpg)
LHDs and partnerships typically convene and organize the process.
77% LHD
17% Partnership
2% Hospital or Provider Group
2% University
1% Other
Percentages don’t equal 100 because of rounding.
Who had the primary responsibility for organizing and convening your MAPP process?
![Page 20: Results from the 2005 Evaluation of MAPP Communities Julia Joh Elligers, MPH Senior Analyst National Association of County and City Health Officials December.](https://reader035.fdocuments.us/reader035/viewer/2022062511/551508b55503465e608b4836/html5/thumbnails/20.jpg)
Most MAPP communities do not have dedicated budgets.
63% No, do not have a dedicated budget
37% Yes, have a dedicated budget
Do you have a dedicated budget for conducting MAPP?
![Page 21: Results from the 2005 Evaluation of MAPP Communities Julia Joh Elligers, MPH Senior Analyst National Association of County and City Health Officials December.](https://reader035.fdocuments.us/reader035/viewer/2022062511/551508b55503465e608b4836/html5/thumbnails/21.jpg)
Most MAPP communities do have dedicated staff.
77% Yes, we do have dedicated staff
23% No, we do not have dedicated staff
Do you have a dedicated staff assigned to support your MAPP process?
![Page 22: Results from the 2005 Evaluation of MAPP Communities Julia Joh Elligers, MPH Senior Analyst National Association of County and City Health Officials December.](https://reader035.fdocuments.us/reader035/viewer/2022062511/551508b55503465e608b4836/html5/thumbnails/22.jpg)
Most MAPP communities do use external facilitators.
Percentages don’t equal 100 because of rounding.
Do you use outside facilitators or paid consultants for your MAPP process?
56% Yes, we used external facilitators
44% No, we did not use external facilitators
![Page 23: Results from the 2005 Evaluation of MAPP Communities Julia Joh Elligers, MPH Senior Analyst National Association of County and City Health Officials December.](https://reader035.fdocuments.us/reader035/viewer/2022062511/551508b55503465e608b4836/html5/thumbnails/23.jpg)
![Page 24: Results from the 2005 Evaluation of MAPP Communities Julia Joh Elligers, MPH Senior Analyst National Association of County and City Health Officials December.](https://reader035.fdocuments.us/reader035/viewer/2022062511/551508b55503465e608b4836/html5/thumbnails/24.jpg)
Proportion of Survey Respondents who Modified MAPP Phases
51 52
4237 34 36
27
3224
20 30
15 11
11
0
10
20
30
40
50
60
70
80
90
Org. for Success CHSA FoCA LPSHA Id Strat. Issues Form. Goals &Strat.
Action Cycle
MAPP Phase
Nu
mb
er o
f S
urv
ey R
esp
on
den
ts
Did not modify MAPP Modified MAPP
![Page 25: Results from the 2005 Evaluation of MAPP Communities Julia Joh Elligers, MPH Senior Analyst National Association of County and City Health Officials December.](https://reader035.fdocuments.us/reader035/viewer/2022062511/551508b55503465e608b4836/html5/thumbnails/25.jpg)
Organizing for Success
• 40% of MAPP users said that this phase took longer than expected.
• But most (88%) were satisfied with their results.
![Page 26: Results from the 2005 Evaluation of MAPP Communities Julia Joh Elligers, MPH Senior Analyst National Association of County and City Health Officials December.](https://reader035.fdocuments.us/reader035/viewer/2022062511/551508b55503465e608b4836/html5/thumbnails/26.jpg)
Visioning
• Most communities choose interactive methods for creating a vision (community meetings, focus groups, brainstorming sessions) as opposed to surveys.
![Page 27: Results from the 2005 Evaluation of MAPP Communities Julia Joh Elligers, MPH Senior Analyst National Association of County and City Health Officials December.](https://reader035.fdocuments.us/reader035/viewer/2022062511/551508b55503465e608b4836/html5/thumbnails/27.jpg)
Community Themes & Strengths
• About 1/3 of users felt this assessment took more time and was more complex than they had anticipated.
• Most communities convened community forums, focus groups, and community surveys.
![Page 28: Results from the 2005 Evaluation of MAPP Communities Julia Joh Elligers, MPH Senior Analyst National Association of County and City Health Officials December.](https://reader035.fdocuments.us/reader035/viewer/2022062511/551508b55503465e608b4836/html5/thumbnails/28.jpg)
Community Health Status
• About ½ of users found that this assessment took more time and required more data collection than they had anticipated.
![Page 29: Results from the 2005 Evaluation of MAPP Communities Julia Joh Elligers, MPH Senior Analyst National Association of County and City Health Officials December.](https://reader035.fdocuments.us/reader035/viewer/2022062511/551508b55503465e608b4836/html5/thumbnails/29.jpg)
![Page 30: Results from the 2005 Evaluation of MAPP Communities Julia Joh Elligers, MPH Senior Analyst National Association of County and City Health Officials December.](https://reader035.fdocuments.us/reader035/viewer/2022062511/551508b55503465e608b4836/html5/thumbnails/30.jpg)
Local Public Health System MAPP Evaluations Results
• Communities who use facilitators to complete this assessment report more positive outcomes.
• Most communities complete the LPHS in a series of meetings or a retreat format.
![Page 31: Results from the 2005 Evaluation of MAPP Communities Julia Joh Elligers, MPH Senior Analyst National Association of County and City Health Officials December.](https://reader035.fdocuments.us/reader035/viewer/2022062511/551508b55503465e608b4836/html5/thumbnails/31.jpg)
Local Public Health System MAPP Evaluations Results
• Over 1/3 of users found the LPHSA was more complex, required more information, and more time to complete than originally expected.
• In addition to resources provided by national organizations, informal peer networks are valuable in completing the LPHSA.
![Page 32: Results from the 2005 Evaluation of MAPP Communities Julia Joh Elligers, MPH Senior Analyst National Association of County and City Health Officials December.](https://reader035.fdocuments.us/reader035/viewer/2022062511/551508b55503465e608b4836/html5/thumbnails/32.jpg)
![Page 33: Results from the 2005 Evaluation of MAPP Communities Julia Joh Elligers, MPH Senior Analyst National Association of County and City Health Officials December.](https://reader035.fdocuments.us/reader035/viewer/2022062511/551508b55503465e608b4836/html5/thumbnails/33.jpg)
Yes or No:
Do you know the three keys to the MAPP process?
![Page 34: Results from the 2005 Evaluation of MAPP Communities Julia Joh Elligers, MPH Senior Analyst National Association of County and City Health Officials December.](https://reader035.fdocuments.us/reader035/viewer/2022062511/551508b55503465e608b4836/html5/thumbnails/34.jpg)
Three Keys to MAPP
• Focus on the Local Public Health System
• Community Driven Process
• Strategic Thinking
![Page 35: Results from the 2005 Evaluation of MAPP Communities Julia Joh Elligers, MPH Senior Analyst National Association of County and City Health Officials December.](https://reader035.fdocuments.us/reader035/viewer/2022062511/551508b55503465e608b4836/html5/thumbnails/35.jpg)
How well does MAPP improve local public health system partnerships?
![Page 36: Results from the 2005 Evaluation of MAPP Communities Julia Joh Elligers, MPH Senior Analyst National Association of County and City Health Officials December.](https://reader035.fdocuments.us/reader035/viewer/2022062511/551508b55503465e608b4836/html5/thumbnails/36.jpg)
02
04
06
0
Per
cent
of S
urve
y R
espo
nden
ts
Not at All Low Medium High
Degree of Achievement
The degree to which MAPP users strengthened existing partnershipsThe degree to which MAPP strengthens existing partnerships
![Page 37: Results from the 2005 Evaluation of MAPP Communities Julia Joh Elligers, MPH Senior Analyst National Association of County and City Health Officials December.](https://reader035.fdocuments.us/reader035/viewer/2022062511/551508b55503465e608b4836/html5/thumbnails/37.jpg)
01
02
03
04
05
0
Per
cent
of S
urve
y R
espo
nden
ts
Not at All Low Medium High
Degree of Achievement
The degree to which MAPP users built new partnershipsThe degree to which MAPP builds new partnerships
![Page 38: Results from the 2005 Evaluation of MAPP Communities Julia Joh Elligers, MPH Senior Analyst National Association of County and City Health Officials December.](https://reader035.fdocuments.us/reader035/viewer/2022062511/551508b55503465e608b4836/html5/thumbnails/38.jpg)
01
02
03
04
0
Per
cent
of S
urve
y R
espo
nden
ts
Not at All Low Medium High
Degree of Achievement
The degree to which MAPP users built a local public health systemThe degree to which MAPP builds a local public health system
![Page 39: Results from the 2005 Evaluation of MAPP Communities Julia Joh Elligers, MPH Senior Analyst National Association of County and City Health Officials December.](https://reader035.fdocuments.us/reader035/viewer/2022062511/551508b55503465e608b4836/html5/thumbnails/39.jpg)
Is the community driving the MAPP process?
![Page 40: Results from the 2005 Evaluation of MAPP Communities Julia Joh Elligers, MPH Senior Analyst National Association of County and City Health Officials December.](https://reader035.fdocuments.us/reader035/viewer/2022062511/551508b55503465e608b4836/html5/thumbnails/40.jpg)
02
04
06
0
Per
cent
of S
urve
y R
espo
nden
ts
Not at All Low Medium High
Degree of Achievement
The degree to which MAPP improved collaboration in the communityThe degree to which MAPP improves
collaboration in the community
![Page 41: Results from the 2005 Evaluation of MAPP Communities Julia Joh Elligers, MPH Senior Analyst National Association of County and City Health Officials December.](https://reader035.fdocuments.us/reader035/viewer/2022062511/551508b55503465e608b4836/html5/thumbnails/41.jpg)
01
02
03
04
05
0
Per
cent
of S
urve
y R
espo
nden
ts
Not at All Low Medium High
Degree of Achievement
The degree to which MAPP increased community understanding of PHThe degree to which MAPP increases community
understanding of public health
![Page 42: Results from the 2005 Evaluation of MAPP Communities Julia Joh Elligers, MPH Senior Analyst National Association of County and City Health Officials December.](https://reader035.fdocuments.us/reader035/viewer/2022062511/551508b55503465e608b4836/html5/thumbnails/42.jpg)
How well does MAPP perform as a strategic planning tool?
![Page 43: Results from the 2005 Evaluation of MAPP Communities Julia Joh Elligers, MPH Senior Analyst National Association of County and City Health Officials December.](https://reader035.fdocuments.us/reader035/viewer/2022062511/551508b55503465e608b4836/html5/thumbnails/43.jpg)
02
04
06
0
Per
cent
of S
urve
y R
espo
nden
ts
Not at All Low Medium High
Degree of Achievement
Improved their Understanding of Community Health ProblemsThe degree to which MAPP improves understanding
of community health problems
![Page 44: Results from the 2005 Evaluation of MAPP Communities Julia Joh Elligers, MPH Senior Analyst National Association of County and City Health Officials December.](https://reader035.fdocuments.us/reader035/viewer/2022062511/551508b55503465e608b4836/html5/thumbnails/44.jpg)
01
02
03
04
05
0
Per
cent
of S
urve
y R
espo
nden
ts
Not at All Low Medium High
Degree of Achievement
The degree to which MAPP identified existing non-LHD PH resourcesThe degree to which MAPP identifies existing
non-LHD public health resources
![Page 45: Results from the 2005 Evaluation of MAPP Communities Julia Joh Elligers, MPH Senior Analyst National Association of County and City Health Officials December.](https://reader035.fdocuments.us/reader035/viewer/2022062511/551508b55503465e608b4836/html5/thumbnails/45.jpg)
01
02
03
04
0
Per
cent
of S
urve
y R
espo
nden
ts
Not at All Low Medium High
Degree of Achievement
Improve their response to external events & demandsThe degree to which MAPP improves
response to external events and demands
![Page 46: Results from the 2005 Evaluation of MAPP Communities Julia Joh Elligers, MPH Senior Analyst National Association of County and City Health Officials December.](https://reader035.fdocuments.us/reader035/viewer/2022062511/551508b55503465e608b4836/html5/thumbnails/46.jpg)
01
02
03
04
0
Per
cent
of S
urve
y R
espo
nden
ts
Not at All Low Medium High
Degree of Achievement
The degree to which MAPP improved public health outcomesThe degree to which MAPP improves public health outcomes
![Page 47: Results from the 2005 Evaluation of MAPP Communities Julia Joh Elligers, MPH Senior Analyst National Association of County and City Health Officials December.](https://reader035.fdocuments.us/reader035/viewer/2022062511/551508b55503465e608b4836/html5/thumbnails/47.jpg)
What factors are related to positive MAPP outcomes?
![Page 48: Results from the 2005 Evaluation of MAPP Communities Julia Joh Elligers, MPH Senior Analyst National Association of County and City Health Officials December.](https://reader035.fdocuments.us/reader035/viewer/2022062511/551508b55503465e608b4836/html5/thumbnails/48.jpg)
MAPP Outcomes
• Improved public health outcomes• Increased visibility for public health• Constituency/external support for public
health• Prepared LHD to manage change• Build new partnerships• Build a local public health system• Improved leadership role for LHD
![Page 49: Results from the 2005 Evaluation of MAPP Communities Julia Joh Elligers, MPH Senior Analyst National Association of County and City Health Officials December.](https://reader035.fdocuments.us/reader035/viewer/2022062511/551508b55503465e608b4836/html5/thumbnails/49.jpg)
Factors that may be related to differences in MAPP outcomes
1. Number of participants in the process
2. Dedicated budget for conducting MAPP
3. Number of FTEs working on the process
4. Dedicated staff to the process
5. LHD staff competencies (e.g. facilitation, cultural, data)
6. LHO’s decision to use MAPP
7. Hired facilitator or consultant
![Page 50: Results from the 2005 Evaluation of MAPP Communities Julia Joh Elligers, MPH Senior Analyst National Association of County and City Health Officials December.](https://reader035.fdocuments.us/reader035/viewer/2022062511/551508b55503465e608b4836/html5/thumbnails/50.jpg)
Factors that may be related to differences in MAPP outcomes
1. Number of participants in the process
2. Dedicated budget for conducting MAPP
3. Number of FTEs working on the process
4. Dedicated staff to the process
5. LHD staff competencies (e.g. facilitation, cultural, data)
6. LHO’s decision to use MAPP
7. Hired facilitator or consultant
![Page 51: Results from the 2005 Evaluation of MAPP Communities Julia Joh Elligers, MPH Senior Analyst National Association of County and City Health Officials December.](https://reader035.fdocuments.us/reader035/viewer/2022062511/551508b55503465e608b4836/html5/thumbnails/51.jpg)
• Cultural
• Facilitation
• Leadership
• Project Management
• Data Analysis
• Collaboration & Community Engagement
• Marketing and Communication
Competencies Related to Outcomes
![Page 52: Results from the 2005 Evaluation of MAPP Communities Julia Joh Elligers, MPH Senior Analyst National Association of County and City Health Officials December.](https://reader035.fdocuments.us/reader035/viewer/2022062511/551508b55503465e608b4836/html5/thumbnails/52.jpg)
![Page 53: Results from the 2005 Evaluation of MAPP Communities Julia Joh Elligers, MPH Senior Analyst National Association of County and City Health Officials December.](https://reader035.fdocuments.us/reader035/viewer/2022062511/551508b55503465e608b4836/html5/thumbnails/53.jpg)
Heidi DeutschProgram [email protected](202) 783-5550, Ext. 252
Julia Joh ElligersSenior [email protected](202) 783-5550, Ext. 245
Maria RishoiProgram [email protected](202) 783-5550, Ext. 203
NACCHO Staff Contacts
Visit the MAPP Program Page at www.naccho.org/topics/infrastructure/MAPP.cfm