Logic ModelsRon Hale

Office of Health Promotion & Community Health ImprovementApril 7, 2008

Las Vegas, NM

A logic model is:

• A picture of how a program is expected to work.

• A systematic and visual way to present relationships among resources, activities, outputs or products, and intended outcomes or changes.

• A theory of change, of expected causal relationships

Logic Models:

• Provide a common framework for understanding a program or set of activities

• Show what goes into a program, what the program does, and what the results are

• Are at the core of both planning and evaluation

• Are often required by funders

LOGIC MODELDEVELOPMENT

EVALUATION

PLANNING

Components of a Logic Model:

• Inputs/Resources– Money– People– Facilities– Knowledge/research

• Activities• Outputs

– Products– Services provided– Numbers of people served

• Outcomes– Short-term– Intermediate– Long-term

• Indicators/Measures

Types of outcomes or changes that can be tracked:

1. Process outcomes: Organizational or coalition functioning

2. Service or program outcomes: Changes in knowledge, behavior, or condition of program participants

3. System outcomes: Community-level changes in organizational relationships, policies, funding patterns, networks, neighborhoods, etc.

4. Health status outcomes: Changes in population health measures

Inputs Activities Outputs Outcomes Indicators

Linked Logic Model Components:

United Way/Urban Institute Logic Model

Inputs/

Resources

Activities Outputs Short-term Outcomes

Inter-mediate

Outcomes

Long-Term Outcomes

Indicators/

Measures

Family Members

Budget

Car

Camping Equipment

Drive to state park

Set up camp

Cook, play, talk, laugh, hike

Family members learn about each

other; family bonds; family has

a good time

Example: Every day logic model –

Family Vacation

Staff

Money

Partners

Develop parent ed curriculum

Deliver series of interactivesessions

Parents increase knowledge of child dev

Parents better understanding their own parenting style Parents use

effective parenting practices

Improved child-parent relations

Research

INPUTS OUTPUTS OUTCOMES

Facilitate support groups

Parents gain skills in effective parenting practices

Example: Parenting Education & Support Program

Parents identify appropriate actions to take

Strong families

Situation:

Targetedparentsattend

During a county needs assessment, majority of parents reported that they were having difficulty parenting and felt stressed as a result

Strategies Activities/Outputs Outcomes Indicators/Measures

1. Provide one-on-one counseling and case management services to high- risk families of infants from birth to age five.

2. Provide parent education and support groups for high-risk families with infants.

3. Provide consultation and clinical supervision to program staff working with high-risk families.

4. Provide psychiatric consultation as needed.

1. Family counseling & case management provided to 50 families at three program sites, with approximately 6 sessions per family.

2. Parent/child support & education groups provided to 30 families at three program sites, with minimum of 5 sessions per group.

3. Reflective supervision provided to program staff by appropriately licensed clinical supervisors.

4. 65 hours of psychiatric consultation provided.

a. Reduced levels of parental stress.

b. Improved infant social and emotional development.

c. Enhanced parental awareness of infant cues and needs.

d. Improved family functioning.

e. Parental satisfaction with services.

a. Parental Stress Index (PSI) administered at intake, at 6-month intervals, and at exit.

b. Ages & Stages Questionnaire/Social-Emotional (ASQ/SE) administered at intake, at 6-month intervals, and at exit.

c. Clinician progress notes; parent self-assessment survey administered at intake and at exit.

d. NCFAS administered at intake, at 6-month intervals, & at exit.

e. Parent satisfaction survey administered at exit.

f. Treatment plan review (all outcomes)

Los Mocosos Community Services, Inc.Child/Parent Mental Health ProgramProgram Logic Model

GOAL 1 - Direct Services: Provide mental health interventions and family support services to families with infants and small children who are at risk of social or emotional problems.

Long-term aim: To reduce the likelihood of child abuse and neglect and of future behavioral health problems as children grow into adolescence and adulthood.

27

HEALTH COUNCILS AND THE COMMUNITY HEALTH IMPROVEMENT PROCESS

Community Building/Council

Development

Community Assessment

Council /community

Actions

DEVELOPMENT ACTION CAPACITY SYSTEMS

Resources

County

Health

Councils

Council Functions

Prioritizing and Planning Actions

Organizational Capacity

External Capacity

Align with DOH plan

Community and Systems Changes

Community Health Status

Changes

CONTEXT: Council/DOH relationship; Community history; Political will; Political changes; Resources ($) =; Barriers/Facilitators (interpersonal and structural)

Targets of

Change

8/20/07, Glenn Wieringa8/20/07, Glenn Wieringa

Health Promotion Contributions to Reducing DWI Statewide, 1987- 2007

Systems Outcomes (policies) + Population Based Outcomes (behaviors) = Health Status Outcomes

Health Status Outcomes

Health Promotion ActivitiesHP Strategies (ES #3- 5) Systems Outcomes

Coordinate 6 key state agencies to support Gallup “March for Jovita” to Santa Fe,

1988

Co-founded Alcohol Issues Consortium (AIC) to provide statewide advocacy/policy strategies in 1998. Met 150 times since.

Provide TA, coordinate media advocacy & testify 6 times at Leg. hearings to close-

drive-ups

Coordinate12 key stakeholders in/out of government to undertake legislative

action double State’s Liquor Excise Tax, 1992.

Health Educators provide 50 hours of technical assistance/training to BHSD/SPF-

SIG, 2002 for Environmental Strategy Development.

TA and policy coordination to toughen Liquor Control Act (LCA) Rules/Regs.,

effecting 2300 licensees, 2007

3. Inform/educate/empower about DWI /Alcohol

Problems

4. Mobilize for action to solve problems

5. Develop State/Local Policies & Plans

•Legislation passed for McKinley Co. for Local

Liquor Excise Tax Ref., .08 BAC, nuisance bars closed

bars, 1989

•DOH/PHD Districts hire DWI Health Educators, late

1980s.

•Liquor Excise Tax doubled to 37 million; 33 County DWI Planning Councils

formed, 1993

•Drive-ups closed, 1998.

•NM First Lady joins national Leadership to Keep Children Alcohol

Free, 1999

•DWI Strategic Plan Developed, 2003; DWI

Czar hired, 2004

•NM receives 5-year, multi-million dollar federal CSAP

grant, 2005

•NM increases penalties for providing alcohol to

underage youth, toughest law in USA, 2005

•Tougher LCA Rules/Regs. Enacted, 2007.

•Reduced alcohol-related stats: DWI fatalities, homicides, etc. decrease in McKinley County during the 1990s.

•One year after drive-up closings, statewide DWI fatalities down 22%.

•NM DWI Fatality Rank falls from 1st

(worst) to 6th, 1990-2004. Approx. 2,100 lives saved.

•DWI numbers continue to improve. Alcohol -related fatalities at all time low (43%).

Systems Thinking Tree Diagram (after K. Kinney)

Strategies Indicators Major Activities

Aim

Outcome Measure:

Process Benchmarks

(Things the program will do or provide)

WHAT IS THE BEST WAY TO CHANGE THE SYSTEM FOR BETTER OUTCOMES?

Systems Change Outcomes

(Outcomes you expect by the end of the grant period.)

IF WE ARE SUCCESSFUL, WHAT SYSTEMS CHANGE(S) WILL WE SEE OVER THE COURSE OF THE PROJECT?

Longer-term Outcomes

(Changes for the target population beyond the term of the grant)

WHAT IS THE ULTIMATE GOAL OF OUR WORK?

1.    1.   1.  

2. 2. 2.

3. 3. 3.

Con Alma Health Foundation Evaluation Logic Model