Developing Intervention Level Logic Models: Moving the Community Level Logic Model Into Strategic Ac

1
Developing Intervention Level Logic Models
Moving the Community Level Logic Model Into
Strategic Action

• Carol E. Hays, Ph.D., CSAPs Southeast CAPT

2
A logic model...
2

• is a simplified picture of a program, initiative,
  or intervention that is a response to a given
  situation.
• shows the logical relationships among the
  resources that are invested, the activities that
  take place, and the benefits or changes that
  result. Some call this program theory (Weiss,
  1998) or the program's theory of action (Patton,
  1997). It is a "plausible, sensible model of how
  a program is supposed to work." (Bickman, 1987,
  p. 5).
• It portrays the underlying rationale of the
  program or initiative. (Chen, Cato Rainford,
  1998-9 Renger Titcomb, 2002)
• is the core of program planning, evaluation,
  program management and communicationsall
  critical for sustainability

3
Outcome Based Logic Model
3
Interventions/Strategies (Programs/ Policies/ Pr
actices)
Substance-Related Consequences and Consumption
Intervening Variables (contributing factors)
Developing the community logic model requires
collaboration to gather the data. The
consequence and consumption work helps the
coalition attract new partners and resources.
The contributing factors helps them focus on
issues that are shared. Developing relevant
strategies brings everyones role into play.
8
4
Types of Logic Models
4

• Community/Local Logic Model
• Depicts a communitys theory of change to address
  a particular problem of focus, the behavior(s)
  contributing to the problem, the local factors
  thought to contribute to the behaviors. These
  local contributing factors present opportunities
  for intervention using evidence based strategies
  (programs, policies, practices)
• Intervention-Specific Logic Model
• Depicts how a set of activities associated with a
  given intervention (program, policy or practice)
  are related to the outcomes that result from
  implementing the intervention

5
Sample Community Logic Model
For Preventing Alcohol-Involved Traffic Crashes
-
Substance
-
Substance
Intervening
Strategies
Related
Use
Variables
(Examples)
Consequences
Easy RETAIL ACCESS to
Underage
Alcohol for youth
BINGE
DRINKING
Low ENFORCEMENT of
retail sales laws
alcohol laws
Social Event
Underage
Alcohol-involved
Easy SOCIAL ACCESS to
Monitoring and
Alcohol
traffic crashes
DRINKING
Enforcement
AND DRIVING
Among 15 to
-
Low PERCEIVED RISK of
24 year olds
alcohol use
Young Adult
BINGE
Media Advocacy to
DRINKING
SOCIAL NORMS accepting
Increase Community
and/or encouraging
Concern about
Underage Drinking
youth drinking
Young Adult
DRINKING
PROMOTION of alcohol
AND DRIVING
use (advertising, movies,
Low P
music, etc)
music, etc)
6
Comprehensive Approach to Accomplish Community
Outcomes
6
SHORT-TERM OUTCOMES
INPUTS
OUTPUTS
Org 1
INTERMEDIATE OUTCOMES
Org 2
LONG-TERM OUTCOMES
Org 3
Org 4
Source Adapted from CDC http//www.phppo.cdc
.gov/phtn/DLSummit2004/1
7
Prevention Intervention (Strategy)
7

• Interventions may combine various strategies
• Participant based programs, typically guided by
  curriculum or manual
• Policies that affect how, where and under what
  conditions substances are sold, purchased,
  possessed, and used
• Practices include rules and standards for
  implementing policies as well as non-participant
  based universal approaches for communicating
  prevention messages to target populations

8
Intervention-Specific Logic Model Answers
8

• What outcome(s) is the program aiming to achieve
  among which population(s)? Why?
• What theories is the program based on?
• What activities are implemented to accomplish
  this outcome?
• What are the immediate effects of these
  activities?
• What underlying factors (e.g. risk and protective
  factors) does this outcome contribute to over
  time?
• What long term changes or impacts does the
  program contribute to?

9
Situation and Priorities
9

• Findings from local needs assessment that
  indicate need for strategy to address a local
  contributing factor to a prioritized problem
• Reflected in local community level logic model
• Gaps in existing resources
• Reflected in resource assessment
• Stakeholder readiness
• Agency mission, values, resources, capacity,
  collaborators

10
Strategy Selection
10

• Relevant to needs of the population
• Address community priorities
• Evidence based
• Demonstrated outcomes align with agency mission
• Are feasible given stakeholder engagement
• Can be adapted to community culture

11
Evidence Based Interventions
11

• Any effort to reduce the incidence or prevalence
  of specific ATOD outcomes, including
• ATOD Consumption and/or high risk use
• ATOD related problems (Social, health and safety
  consequences associated with ATOD use)
• Based on a strong theory or conceptual framework
  that comprise activities grounded in that theory
  or framework and that produce empirically
  verifiable positive outcomes when well
  implemented
• Strategies (programs, policies and practices)
  that result in changes (outcomes) among
  individuals, groups of individuals or entire
  communities

12
Intervention Logic Model Elements
12

• Inputs - what is invested by the implementing
  organization(s)
• Outputs - program activities, who and how many
  reached
• Outcomes immediate results of program
  activities
• Impacts cumulative changes to community
  conditions (e.g. changes in risk/protective
  factors, substance use and consequences)

13
Intervention-Specific Logic Model
13
INPUTS
OUTPUTS
OUTCOMES
Activities
Participation
Short
Medium
Program investments
Long-term
What we invest
What we do
Who we reach under what conditions
What results
14
Theoretical Framework
14

• Explains established theory that intervention is
  based on
• Theory should be empirically tested and
  empirically supported in multiple research
  studies
• Logic model details how the proposed intervention
  applies and incorporates established theory

15
Organizational Inputs
15

• What investments does the strategy require?
• What organizations make/will make these
  investments?

• Staff
• Expertise (including needed training)
• Partners and volunteers
• Time
• Money
• Technology/equipment
• Space
• Materials

16
Outputs
16

• Actions taken to accomplish outcomes
• Training
• Education
• Presentations
• Facilitate
• Work with media

• Characteristics of target population
• Geography
• Age
• Universal, selective, indicated
• Other characteristics

17
Outcomes and Impacts
17

• Awareness
• Knowledge
• Opinions
• Attitudes
• Aspirations
• Skills

• Decision making
• Action, Behavior, Practice
• Policies
• Social Action
• Consequences (health, social, economic, etc.)

18
Example Intervention-Specific Logic Model
OUTPUTS
INPUTS
OUTCOMES/IMPACTS
Parents identify appropriate actions to take
Develop parent ed curriculum
Parents increase knowledge of child dev
Reduced youth alcohol use
Staff
Deliver series of interactive sessions focused
on child development, parenting styles, and
parenting practices
Money
Parents use effective parenting practices
Parents better understand their own parenting
style
Reduced consequences
Training
Partners
Improved child-parent relations
Parents gain skills in effective parenting
practices including family management
Research
Space
Facilitate support groups where parents
problem-solve
Materials
Reduced social access to alcohol
19
Benefits More Strategic Community Planning
19

• Helps to ensure strategies selected are
  conceptually relevant, feasible, and have high
  local utility
• Provides a common language about the strategy
• Identifies the resources needed to maintain or
  expand the reach of existing strategies
• Increases understanding of program elements
• Clarifies when outcomes should be expected

20
Benefits Strengthened Planning for Strategic
Intervention
20

• Ensures strategy is a good fit with agency
  mission, resources, capacity
• Provides focus for and enhances team work
• Clarifies target population
• Provides coherence across complex tasks, diverse
  environments
• Helps differentiate between program activities
  and outcomes
• Facilitates communication about strategy benefits

21
Benefits Establishing Evidence
21

• Helps to maximize evaluation resources by
  identifying key outcomes for evaluation
• Helps to identify evaluation questions of
  interest
• Helps to identify evaluation methods, instruments
  and measures
• Helps to plan for timing of evaluation data
  collection

22
Logic Model and Evaluation Questions
22
Needs assessment What are the characteristics,
needs, priorities of target population? What are
potential barriers/facilitators?
Process evaluation How is program implemented?
Are activities delivered as intended? Are
participants being reached as intended? What are
participant reactions?
Outcome evaluation To what extent are desired
changes occurring? For whom? Is the program
making a difference? What seems to work? Not
work? What are unintended outcomes?
23
EVALUATION What do you (and others) want to know
about this program?
Parents increase knowledge of child dev
Develop parent ed curriculum
Parents identify appropriate actions to take
Staff
Improved child-parent relations
Deliver series of interactive sessions
Money
Parents better understand their own parenting
style
Partners
Parents use effective parenting practices
Research
Parents gain skills in effective parenting
practices
Increased Family Bonding
Facilitate support groups
Potential Evaluation Questions
To what extent are relations improved? Does this
result in stronger families?
To what extent did behaviors change? For whom?
Why? What else happened?
Who/how many attended/did not attend? Did they
attend all sessions? Were they satisfied? Will
they come again?
How many sessions were actually delivered?
Lessons delivered as designed? Support
groups delivered
What amount of and time were invested? What did
partners do?
To what extent did knowledge and skills increase?
For whom? Why? What else happened?
24

• Developing an evaluation plan based on your logic
  model

24
Inputs
Outputs
25
Logic ModelsNot Just a Pretty Picture
25

• Demonstrates accountability with focus on
  outcomes
• Links activities to results Prevents mismatches
• Integrates planning, implementation, evaluation
  and reporting
• Creates understanding
• Promotes learning
• A way of thinking not just a pretty picture

26
Thanks for your participation!
26