Barb Pryor, M.S. R.D Jolene DeFiore-Hyrmer, B.S. Ohio Heart Disease and Stroke Prevention Program Ohio Department of Health Matt Gladden Applied Research and Evaluation, HDSP - PowerPoint PPT Presentation

1 / 63
About This Presentation
Title:

Barb Pryor, M.S. R.D Jolene DeFiore-Hyrmer, B.S. Ohio Heart Disease and Stroke Prevention Program Ohio Department of Health Matt Gladden Applied Research and Evaluation, HDSP

Description:

Target audience more likely to recognize signs & symptoms of stroke and call 911 ... Distribute stroke signs and symptoms message to partners ... – PowerPoint PPT presentation

Number of Views:157
Avg rating:3.0/5.0
Slides: 64
Provided by: CDC692
Category:

less

Transcript and Presenter's Notes

Title: Barb Pryor, M.S. R.D Jolene DeFiore-Hyrmer, B.S. Ohio Heart Disease and Stroke Prevention Program Ohio Department of Health Matt Gladden Applied Research and Evaluation, HDSP


1
Barb Pryor, M.S. R.DJolene DeFiore-Hyrmer,
B.S.Ohio Heart Disease and Stroke Prevention
ProgramOhio Department of Health Matt
GladdenApplied Research and Evaluation, HDSP
Logic Models for Complex Programs HDSP State
Management and Evaluation Training September,
2007
2
  • The findings and conclusions in this presentation
    are those of the author and do not necessarily
    represent the views of the Centers for Disease
    Control and Prevention

3
ALL MODELS ARE LIMITED, BUT SOME ARE USEFUL
  • How to make logic models useful to you?

4
Objectives for Today
  • Explain the components and principles of a logic
    model
  • Discuss strategies for constructing logic models
    of complex programs
  • Identify limitations of logic models
  • Talk about a state example from Ohio
  • Engage in hands on exercises
  • Provide you useful tools

5
Objective 1Explain the components and principles
of a logic model
6
What is a Logic Model?
  • Graphic depiction (A VISUAL MAP) of the
    relationship between program activities and
    intended effects

7
Why Bother with Logic Models?
  • Improve planning process
  • Clarify goals
  • Identify priorities, assumptions, and challenges
  • Buy-in stakeholders
  • Evidence based thinking
  • Enhance ability to detect difficulties
  • Facilitate evaluation
  • Realistic expectations
  • Clear articulation of program

8
Five Major Components
4
3
1
2
INPUTS
ACTIVITIES
OUTPUTS
OUTCOMES
What we put in
What we do
Direct products of activities
Benefits or changes
5
CONTEXT AND ASSUMPTIONS
9
Input
Key Question What supports our program
activities?
The resources that are needed to support the
programs activities.
INPUT
  • Human, financial, organizational, and
    relationship resources that a program has
    available to do the work.

10
Logic Model Activities
Key Question How are we going to structure our
intervention?
What the program and staff do to bring about the
desired results. Events and actions that are an
intentional part of the program.
ACTIVITIES
  • Create products - promotional materials,
    educational curricula, and media ads
  • Provide services - training, advocacy, and
    resources
  • Support infrastructure build relationships,
    build capacity, and planning

11
Logic Model Output
Key Question What were the tangible, direct
products that are produced by the activities?
OUTPUT
  • Number of train the trainer classes taught,
    coalition meetings held, electronic medical
    records materials produced
  • Participation rates
  • Hours of service

12
Logic model terminology
Key Question Why we did the intervention?
The specific changes that result in someone or
something
Outcomes
  • Individual changes in attitude, knowledge,
    skills, health status, environment etc.
  • Organizational or system changes increased
    capacity, improved population health, changes in
    policy
  • Usually expressed as short term, intermediate,
    and long term

13
Criteria for a Good Logic Model
  • Process
  • Reasonable stakeholder input
  • Audience specific
  • Change over time
  • Technical
  • Logical
  • Tells a story
  • Appropriate level of detail
  • Visually engaging
  • Easy to read

14
Criteria for a Good Logic Model
  • Useful
  • Guiding the creation of evaluation questions
  • Assist monitoring
  • Help describe program to stakeholders

15
Exercise
  • Develop a media campaign to educate people about
    the signs and symptoms of a stroke and to call
    911
  • Please organize the cards describing the program
    into inputs, activities, outputs, and outcomes
  • This is just an example!
  • Time 7 Minutes

16
Major Components of a Logic Model
INPUTS
ACTIVITIES
OUTPUTS
OUTCOMES
What we put in
What we do
Direct products of activities
Benefits or changes
CONTEXT AND ASSUMPTIONS
17
INPUTS
  • Funding from partners
  • Program staffing
  • Affordable media outlets that reach target
    audience
  • CDC funding

18
ACTIVITIES
INPUTS
  • Identify target audience
  • Identify PSA or create stroke signs symptoms
    message
  • Contract media firm to deliver the message
  • Distribute message to partners
  • Evaluate media campaign
  • Funding from partners
  • Program staffing
  • Affordable media outlets that reach target
    audience
  • CDC funding

19
INPUTS
ACTIVITIES
OUTPUTS
  • Signs symptoms media campaign completed
  • Effective signs symptoms message identified or
    developed
  • Identify target audience
  • Identify PSA or create stroke signs symptoms
    message
  • Contract media firm to deliver the message
  • Distribute message to partners
  • Evaluate media campaign
  • Funding from partners
  • Program staffing
  • Affordable media outlets that reach target
    audience
  • CDC funding
  • Report evaluating the media campaign

20
INPUTS
OUTCOMES
PROCESS
ACTIVITIES
OUTPUTS
  • SHORT
  • High percent of target audience viewed signs
    symptoms message multiple times
  • Signs symptoms media campaign completed
  • Effective signs symptoms message identified or
    developed
  • Identify target audience
  • Identify PSA or create stroke signs symptoms
    message
  • Contract media firm to deliver the message
  • Distribute message to partners
  • Evaluate media campaign
  • Funding from partners
  • Program staffing
  • Affordable media outlets that reach target
    audience
  • CDC funding

INTERMEDIATE
  • Target audience more likely to recognize signs
    symptoms of stroke and call 911
  • Report evaluating the media campaign

LONG
  • Stroke treated more quickly
  • Decrease mortality

21
Objective 2Discuss strategies for constructing
logic models of complex programs
22
Moving Beyond a Simple Program
  • Multiple components
  • Large number of inputs, activities, and outputs
  • Objectives are unclear or debated
  • Activities or outputs are interrelated
  • Planning phase has yet to identify target group
    or activities

23
Doing Logic Models in the Real Word
  • Common themes
  • Level of detail (10,000 foot versus 1,000 foot)
  • An important tool to support evaluation
  • Identifying relationships among activities,
    outputs, and outcomes
  • The theory of action
  • Assumptions and contextual factors
  • Modify with time
  • Looking at all 4 elements at once

24
Doing Logic Models in the Real Word
  • I am presenting basic principles
  • Have to be uniquely applied to your situation
  • Do not interpret as requirements
  • Work through these elements by expanding our
    previous example
  • An example not meant to be an ideal program

25
INPUTS
ACTIVITIES
OUTPUTS
OUTCOMES
Interm.
Short
Long
  • Stroke signs and symptoms media campaign
    completed
  • Strong partnership among EMS, fire department and
    hospitals formed
  • Developed an effective signs symptoms message
  • State EMS tracking system compatible with NEMSIS
  • Rehabilitation expert workgroup meets monthly
  • A retreat including EMS, fire department, and
    hospital leadership held
  • A stroke protocol for 911 dispatchers developed
  • Report evaluating media campaign
  • State EMS tracking system developed
  • Majority of 911 dispatchers trained in stroke
    protocol
  • Rehabilitation expert workgroup makes concrete
    recommendations for improvement
  • Build partnership among EMS, fire department, and
    hospitals
  • Identify target audience for stroke signs and
    symptoms media campaign
  • Ensure state EMS tracking system compatible with
    NEMSIS
  • Identify PSA or create stroke signs and symptoms
    message
  • Provide trainings on the utility of NEMSIS
  • Contract media firm to delivery the stroke signs
    symptoms message
  • Develop a stroke protocol for 911 dispatchers
  • Evaluate media campaign
  • Distribute stroke signs and symptoms message to
    partners
  • Develop state system to track EMS service
  • Train 911 dispatchers in use of stroke protocol
  • Convene a workgroup of experts on stroke
    rehabilitation to make recommendations for
    improvement
  • Educate stakeholders on the importance of stroke
    rehabilitation
  • Hold summit that includes leadership in EMS, fire
    department, and major hospitals to identify
    partnership opportunities
  • Funding from partners
  • Governor support
  • Program staffing
  • CDC technical assistance
  • CDC funding
  • Affordable media outlets that reach target
    audience
  • Partners (Academic, Community, Health Care)
  • Technical assistance from a local university
  • 911 dispatchers appropriately respond to 911
    calls responding strokes
  • Implement expert workgroup recommendations on
    stroke rehabilitation
  • High percent of target audience reached multiple
    times by signs and symptoms stroke campaign
  • System changes in the EMS response to stroke
    implemented
  • Accountability for EMS performance increased
  • Target audience knowledge of stroke signs and
    symptoms increased
  • Improved EMS response time to stroke victims
  • Higher quality stroke rehabilitation
  • Higher medication compliance during stroke
    rehabilitation
  • Target group call 911 quicker in response to a
    stroke
  • EMS delivers patients to stroke certified
    hospitals
  • Lifestyle changes made by people recovering from
    stroke
  • Improved EMS delivery time to hospital
  • Lower stroke mortality
  • Lower disability from stroke
  • Decreases in health disparities in the target
    group

26
Element 1 Common Themes
  • Appropriate level of detail
  • 10,000 foot vs 1,000 foot
  • Enough detail to meet audience needs
  • Meaningfully group activities, outputs, and
    outcomes
  • Resist listing all activities
  • Provide more detail about current activities
  • More general description of future activities
    that are ill-defined

27
Where We Hope to End
Where We Start
28
Themes to Group Activities
  • Goal oriented
  • CDC 6 priority areas (e.g., signs and symptoms)
  • Major goals of state program
  • Location
  • Community, health care, and business
  • Larger themes
  • Public education
  • Treatment
  • Infrastructure
  • Other strategies that fit your program

29
Exercise Grouping Activity
  • Group 14 activities into 5 or fewer groups
  • Activities grouped together should be
    meaningfully related
  • Report groupings and why
  • Sorting technique is a tool
  • Time
  • 10 minutes for activity
  • 5 minutes to report out groupings

30
My Groupings
  • Media campaign
  • Accountability
  • NEMSIS tracking system
  • Infrastructure for EMS improvement
  • Partnership
  • Improve 911 response to stroke
  • Design protocol and train
  • Improve stroke rehabilitation
  • Expert workgroup

EMS Quality Improvement
31
ACTIVITIES
  • Build partnership among EMS, fire department, and
    hospitals
  • Hold summit that includes leadership in EMS, fire
    department, and major hospitals to identify
    partnership opportunities
  • Develop state system to track EMS service
  • Ensure state EMS tracking system compatible with
    NEMSIS
  • Provide trainings on the utility of NEMSIS
  • Identify target audience for stroke signs
    symptoms media campaign
  • Identify PSA or create stroke signs symptoms
    message
  • Contract media firm to delivery the stroke signs
    symptoms message
  • Evaluate media campaign
  • Distribute symptoms message to partners
  • Convene workgroup of experts on stroke
    rehabilitation to make recommendations for
    improvement
  • Educate stakeholders on the importance of stroke
    rehabilitation
  • Develop a stroke protocol for 911 dispatchers
  • Train 911 dispatchers in the use of stroke
    protocol

32
ACTIVITIES
OUTPUTS
  • Media campaign to educate people about stroke
    signs and symptoms and to call 911
  • Develop message
  • Contract to company to run media campaign
  • Define target audience
  • Completed stroke awareness media campaign
  • Used effective message
  • Reached target audience

Use bullet points when want to show sub-activities
  • EMS tracking
  • Local system that is NEMSIS compatible
  • EMS tracking
  • Local tracking system compatible with NEMSIS

Arrows within column can show relationship
between activities
Strong partnership built among EMS, fire
department and hospitals
Build partnership among EMS, fire department, and
hospitals
Less detail needed because do not know the
planning results
Implement stroke protocol among 911 dispatchers
Majority of 911 dispatchers are using a stroke
protocol
Does this belong in this model?
Convene stroke rehabilitation expert workgroup
Expert recommendations on how to improve
rehabilitation for stroke victims
33
Lessons on Themes
  • No right answer
  • Philosophy of the program
  • What are your key goals?
  • Be able to describe your program at different
    levels of detail
  • What is the most appropriate level?
  • Seek connections and structure among activities
  • Bullet points under larger topic
  • Easy read

34
Element 2 Theory of Action
  • Outline the theory of action
  • When possible, identify specific relationships
    among the activities, outputs, and outcomes
  • Key monitoring, evaluation, and explanation
  • Map

35
Theory of Action
  • Types of Relationships
  • Many to one (multiple activities are targeting
    same output or outcome)
  • One to many (planning activity leads to many
    initiatives)
  • Many to many (multiple inputs combine to produce
    multiple activities)
  • Relationships within a column
  • One activity dependent on the other
  • Activities strongly related

36
ACTIVITIES
OUTPUTS
  • Media campaign to educate people about stroke
    signs and symptoms and to call 911
  • Develop message
  • Contract to company to run media campaign
  • Define target audience
  • Completed stroke awareness media campaign
  • Used effective message
  • Reached target audience
  • EMS tracking
  • Local system that is NEMSIS compatible
  • EMS tracking
  • Local tracking system compatible with NEMSIS

Strong partnership built among EMS, fire
department and hospitals
Build partnership among EMS, fire department, and
hospitals
Implement stroke protocol among 911 dispatchers
Majority of 911 dispatchers are using a stroke
protocol
Convene stroke rehabilitation expert workgroup
Expert recommendations on how to improve
rehabilitation for stroke victims
37
OUTPUTS
OUTCOMES
Short
Intermediate
High percent of target audience reached multiple
times
Target group call 911 quicker in response to a
stroke
Completed stroke awareness media campaign Used
effective message Reached target audience
Target audience knowledge of stroke signs and
symptoms increased
Improved EMS response time to stroke victims
EMS tracking Local system that is NEMSIS
compatible
Strong accountability for EMS response
Improved EMS delivery time to hospitals
System changes in EMS response to stroke
Strong partnership built among EMS, fire
department and hospitals
EMS delivers patients to stroke certified
hospitals
Dispatchers appropriately respond to 911 calls
involving strokes
Majority of 911 dispatchers are using a stroke
protocol
Lifestyle changes
Higher medication compliance
Expert recommendations on how to improve
rehabilitation for stroke victims
Implement recommendations on stroke rehabilitation
Higher quality stroke rehabilitation
38
OUTPUTS
OUTCOMES
ACTIVITIES
INPUT
Intermediate
Long
Short
  • Media campaign to educate people about stroke
    signs and symptoms and to call 911
  • Develop message
  • Contract to company to run media campaign
  • Define target audience
  • Completed stroke awareness media campaign
  • Used effective message
  • Reached target audience

High percent of target audience reached multiple
times
Target group call 911 quicker in response to a
stroke
  • Funding
  • Private foundation
  • CDC
  • Political
  • Governor support
  • Partners
  • Media outlets
  • Program partners (academic, community, health
    care)
  • Technical
  • CDC technical assistance
  • Local university
  • Program staffing

Target audience knowledge of stroke signs and
symptoms increased
  • Lower stroke mortality
  • EMS tracking
  • Local system that is NEMSIS compatible

Strong accountability for EMS response
  • EMS tracking
  • Local tracking system compatible with NEMSIS

Improved EMS response time to stroke victims
  • Lower disability from stroke

System changes in EMS response to stroke
Improved EMS delivery time to hospitals
Strong partnership built among EMS, fire
department and hospitals
Build partnership among EMS, fire department, and
hospitals
  • Decreases in health disparities in the target
    group

EMS delivers patients to stroke certified
hospitals
Dispatchers appropriately respond to 911 calls
involving strokes
Majority of 911 dispatchers are using a stroke
protocol
Implement stroke protocol among 911 dispatchers
Higher quality stroke rehabilitation
Convene stroke rehabilitation expert workgroup
Expert recommendations on how to improve
rehabilitation for stroke victims
Implement recommendations on stroke rehabilitation
Lifestyle changes
Higher medication compliance
39
OUTPUTS
OUTCOMES
ACTIVITIES
INPUT
Long
Intermediate
Short
  • Media campaign to educate people about stroke
    signs and symptoms and to call 911
  • Develop message
  • Contract to company to run media campaign
  • Define target audience
  • Completed stroke awareness media campaign
  • Used effective message
  • Reached target audience

High percent of target audience reached multiple
times
Target group call 911 quicker in response to a
stroke
  • Funding
  • Private foundation
  • CDC
  • Political
  • Governor support
  • Partners
  • Media outlets
  • Program partners (academic, community, health
    care)
  • Technical
  • CDC technical assistance
  • Local university
  • Program staffing

Target audience knowledge of stroke signs and
symptoms increased
  • Lower stroke mortality

Improved EMS response time to stroke victims
Strong accountability for EMS response
  • Improvements in EMS infrastructure
  • Tracking system that is NEMSIS compatible
  • Strong partnership between EMS, fire department,
    and hospitals
  • 911 dispatchers using stroke protocol
  • Improve EMS System
  • Create EMS tracking system that is compatible
    with NEMSIS system
  • Build partnership among EMS, fire department, and
    hospitals
  • Implement 911 stroke protocol for dispatchers
  • Lower disability from stroke

Improved EMS delivery time to hospitals
  • System changes in EMS response to stroke
  • Improved dispatcher response to 911 calls
    involving strokes
  • Decreases in health disparities in the target
    group

EMS delivers patients to stroke certified
hospitals
Higher quality stroke rehabilitation
Convene stroke rehabilitation expert workgroup
Expert recommendations on how to improve
rehabilitation for stroke victims
Implement recommendations on stroke rehabilitation
Lifestyle changes
Higher medication compliance
40
INPUTS
ACTIVITIES
OUTPUTS
OUTCOMES
Interm.
Short
Long
  • Stroke signs and symptoms media campaign
    completed
  • Strong partnership among EMS, fire department and
    hospitals formed
  • Developed an effective signs symptoms message
  • State EMS tracking system compatible with NEMSIS
  • Rehabilitation expert workgroup meets monthly
  • A retreat including EMS, fire department, and
    hospital leadership held
  • A stroke protocol for 911 dispatchers developed
  • Report evaluating media campaign
  • State EMS tracking system developed
  • Majority of 911 dispatchers trained in stroke
    protocol
  • Rehabilitation expert workgroup makes concrete
    recommendations for improvement
  • Build partnership among EMS, fire department, and
    hospitals
  • Identify target audience for stroke signs and
    symptoms media campaign
  • Ensure state EMS tracking system compatible with
    NEMSIS
  • Identify PSA or create stroke signs and symptoms
    message
  • Provide trainings on the utility of NEMSIS
  • Contract media firm to delivery the stroke signs
    symptoms message
  • Develop a stroke protocol for 911 dispatchers
  • Evaluate media campaign
  • Distribute stroke signs and symptoms message to
    partners
  • Develop state system to track EMS service
  • Train 911 dispatchers in use of stroke protocol
  • Convene a workgroup of experts on stroke
    rehabilitation to make recommendations for
    improvement
  • Educate stakeholders on the importance of stroke
    rehabilitation
  • Hold summit that includes leadership in EMS, fire
    department, and major hospitals to identify
    partnership opportunities
  • Funding from partners
  • Governor support
  • Program Staffing
  • CDC technical assistance
  • CDC funding
  • Affordable media outlets that reach target
    audience
  • Partners (Academic, Community, Health Care)
  • Technical assistance from a local university
  • 911 dispatchers appropriately respond to 911
    calls responding strokes
  • Implement expert workgroup recommendations on
    stroke rehabilitation
  • High percent of target audience reached multiple
    times by signs and symptoms stroke campaign
  • System changes in the EMS response to stroke
    implemented
  • Accountability for EMS performance increased
  • Target audience knowledge of stroke signs and
    symptoms increased
  • Improved EMS response time to stroke victims
  • Higher quality stroke rehabilitation
  • Higher medication compliance during stroke
    rehabilitation
  • Target group call 911 quicker in response to a
    stroke
  • EMS delivers patients to stroke certified
    hospitals
  • Lifestyle changes made by people recovering from
    stroke
  • Improved EMS delivery time to hospital
  • Lower stroke mortality
  • Lower disability from stroke
  • Decreases in health disparities in the target
    group

41
OUTPUTS
OUTCOMES
ACTIVITIES
INPUT
Intermediate
Long
Short
  • Media campaign to educate people about stroke
    signs and symptoms and to call 911
  • Develop message
  • Contract to company to run media campaign
  • Define target audience
  • Completed stroke awareness media campaign
  • Used effective message
  • Reached target audience

High percent of target audience reached multiple
times
Target group call 911 quicker in response to a
stroke
Often intermediate outcomes converge to produce
long-term outcomes
  • Funding
  • Private foundation
  • CDC
  • Political
  • Governor support
  • Partners
  • Media outlets
  • Program partners (academic, community, health
    care)
  • Technical
  • CDC technical assistance
  • Local university
  • Program staffing

Target audience knowledge of stroke signs and
symptoms increased
  • Lower stroke mortality
  • EMS quality improvement
  • Local system that is NEMSIS compatible

Strong accountability for EMS response
  • EMS quality improvement
  • Local tracking system compatible with NEMSIS

Improved EMS response time to stroke victims
Links between inputs and activities are often too
complex to model simply
  • Lower disability from stroke

System changes in EMS response to stroke
Improved EMS delivery time to hospitals
Strong partnership built among EMS, fire
department and hospitals
Build partnership among EMS, fire department, and
hospitals
  • Decreases in health disparities in the target
    group

EMS delivers patients to stroke certified
hospitals
Dispatchers appropriately respond to 911 calls
involving strokes
Majority of 911 dispatchers are using a stroke
protocol
Implement stroke protocol among 911 dispatchers
Higher quality stroke rehabilitation
Convene stroke rehabilitation expert workgroup
Expert recommendations on how to improve
rehabilitation for stroke victims
Implement recommendations on stroke rehabilitation
Lifestyle changes
Higher medication compliance
42
Feedback Loop
  • An output or outcome that affects an input or
    activity
  • Evaluation
  • Needs assessment
  • Fundraising
  • Political support/opposition
  • Indicated by an arrow pointing backwards

43
Example of Feedback Loop
SHORT OUTCOMES
ACTIVITIES
OUTPUTS
  • Contract media campaign on stroke signs and
    symptoms
  • Peoples knowledge of signs and symptoms
    increased
  • Media campaign completed
  • Evaluate campaign

Evaluation of Campaign
  • Recommendations for media campaign improvements

44
Caution!
  • Too many arrows are confusing!
  • Focus major relationships
  • Be very careful about feedback loops
  • Place related activities next to each other in
    the model

45
Element 3 Assumptions and Context Factors
  • Critical to always be thinking about your
    assumptions
  • Arrows should help identify assumptions
  • What assumptions are untested
  • What are the unintended consequences of your
    program?
  • Identify major contextual factors
  • Be aware
  • Respond quickly to problems
  • Help prevent misinterpreting program effects

46
Example of Assumptions and Context Factors
  • Assumptions
  • Media campaign will be effective
  • Untested Partnerships will lead to system
    improvements
  • Unintended consequence Partnership could
    heighten tensions
  • Context factors
  • Political change (e.g., recession, city council,
    etc.)
  • Contentious relationship between fire department
    and EMS

47
Assumptions and Context Factors in Logic Models
  • Usually placed underneath the logic model in two
    boxes
  • Sometimes left out of logic models

48
Element 4 Adjust with Time
  • Program changes
  • Component added
  • Component dropped
  • Integrate what you have learned
  • Over time the results of activities may become
    inputs
  • Model shifts to the left
  • Update logic model with the results of planning
    activities
  • Specific initiative
  • A good logic model today may not be good tomorrow

49
Technical Checklist
  • Identify and classify program inputs, outputs,
    and outcomes
  • Appropriate level of detail is used
  • Groupings are meaningful
  • Logic model persuasive to targeted audience
  • Clearly articulate theory of change by mapping
    important relationships among activities, output,
    and outcomes
  • All activities are associated with an output
  • Feedback loops are indicated

50
Technical Checklist Continued
  • Identify your assumptions
  • Unanticipated consequences
  • Identify major contextual factors that impact
    your program
  • Factors that impact implementation or outcomes
  • Update model over time
  • Verify logic model
  • Is easy to read
  • Understood by new reader
  • Integrates input and feedback from your
    stakeholders

51
Objective 3Identify limitations of logic models
52
Why Worry about Limitations?
  • LOGIC MODELS ARE STILL USEFUL!
  • Ignoring limitations can produce logic models
    that do not make sense
  • Lessen frustration
  • Need to look to other models when modeling strong
    interconnections or very complex relationships
  • Systems thinking

53
Limitations of a Logic Model
  • The logic model progresses in one direction
    through time
  • Changes can often occur across the model
  • Change in the real world often does not occur in
    a predictable stepwise fashion
  • Logic model is unable to represent strong
    interconnections among activities, outputs, and
    outcomes
  • Reinforces assumptions and diminishes context

54
Contact Information
  • Conference
  • Roundtable sessions to work on your logic model
    Wednesday at 1100 PM
  • After the conference
  • mgladden_at_cdc.gov
  • (770) 488-8007
  • CDC HDSP Logic Model Evaluation Guide
  • http//0-www.cdc.gov.mill1.sjlibrary.org/dhdsp/sta
    te_program/evaluation_guides/logic_model.htm

55
Objective 4Talk about a state example from Ohio

56
Logic Models in the Real World
Barb Pryor, M.S. R.D Jolene DeFiore-Hyrmer,
B.S. Ohio Heart Disease and Stroke Prevention
Program Ohio Department of Health
  • CDC HDSP Training
  • September 2007

57
Incorporating the Theory of Logic Models into
Reality.a states perspective
  • Ohios HDSP Program had established structure and
    ongoing activities
  • CDC HDSP Programs RFP for new 5-year cycle
    defined expectations, program priorities and
    outcomes
  • 2007-12 Workplan completed prior to development
    of Ohios logic model
  • Logic model built by working toward the center
    from Inputs on left side and Long-term Outcomes
    on right side

58
Building Ohios Logic Model
  • Identify what must happen in each step to
    accomplish Long-term Outcomes
  • Align activities to Outcomes
  • Activities and Outcomes mirror Ohio HDSP work
    plan
  • Long-term Outcomes align with CDCs HDSP State
    Program Logic Model
  • Intermediate Outcomes reflect measurable Impact
    Objectives in Ohios HDSP 2007-2012 workplan
  • Only major activities and relationships
    illustrated

59
Ohio Heart Disease and Stroke Prevention Program
Logic Model-- 2007-2012
Process
Outcomes
Short term outcomes
Intermediate Outcomes
Long term Outcomes
Inputs
Activities
Outputs
Heart Disease and Stroke Prevention Council formed
HDSP program partners
Integration among chronic disease prevention
programs
Increase in the percentage of Ohioans who can
identify the symptoms of stroke and heart attack
and the immediate response to call 9-1-1
Effective interventions and strategies
implemented within settings and priority
populations
Reduction of disability and death from heart
disease and stroke
CDC funding
CVH State plan updated
Partnership development
System changes in the Health care, Worksite, and
Community settings that promote heart healthy and
stroke free lives
CDC technical assistance and training
Partnership with Ohio Commission on Minority
Health, Ohio Commission on African-American Males

Increase in the percentage of Ohioans whose high
blood pressure is controlled
Technical assistance and training to partners
Ohio Chronic Disease Plan developed
Reduction of racial, gender, geographic, and SES
disparities.
CDC-provided best practices
Assessment of current systems of care
Capacity of health care providers strengthened
Increase in the percentage of Ohioans whose
cholesterol levels are controlled
Epidemiology and scientific capacity
CVD burden surveillance Indicator surveillance
Impact Evaluation
60
Expansion of Ohios Logic Model
  • Expanded to integrate new project into Ohio HDSP
    Program
  • Paul Coverdell Acute Stroke Registry
  • Long-term Outcomes remain constant
  • Process Inputs and Activities similar
  • Outputs, Short-term and Intermediate Outcomes
    expanded to incorporate new Coverdell components

61
(No Transcript)
62
Benefits of Logic Model
  • Clearly describes Ohio HDSP Program to partners
  • Identifies key indicators to measure for program
    evaluation
  • Provides a reality check for Work Plan
  • Keeps staff focused on what needs to be done to
    achieve outcomes
  • Allows for change as Program grows

63
Ideas to Improve Your Logic Model
  • How do you think you can improve your logic
    model?
  • Should activities be categorized at a higher
    level?
  • Are relationships clearly specified?
  • Is the model easy to read?
  • How can the model be used?
  • Thank you for your time.
Write a Comment
User Comments (0)
About PowerShow.com