Working out what matters and making measurement work for me

1
Working out what mattersand making measurement
work for me

• Steven Marwick
• Evaluation Support Scotland

2
Roger the Regeneration Rooster
3
Easterhenhouse
Unhealthy hens
Fear of crime
4
Fowl Outcome Agreement

• Improve the health of hens
• Increase chickens clucking skills to the farm
  average
• Increase the safety of the coop

5
(No Transcript)
6

• Outcomes matter

7
Outcomes

• The change or difference you make through your
  services or activities

8
Outcomes matter

• We need to know what we are trying to change
  before we can measure it.
• The people who use our services will know what
  they can expect from us.
• Many funders want to know what difference their
  money makes.

9
Logic modelling

• Provide employability training ?
• ? better ability to organise myself
• ? better understanding of employers
  requirements
• ? better presentation skills
• ? Increased ability to apply for a job
• ? Getting a job
• ? Sustainable employment and reduced dependency
  on benefits

10
Logic modelling

• Input ? activity and output ? short term outcome
  ? longer term outcome
• Shows logic underpinning a plan
• Creates a pathway to allow measurement

11
Singalong event

• What difference or changes (outcomes) should I
  hope to make?
• To learn more about music
• To improve your ability to sing
• To meet new people
• To have a good time

12
Singalong!
13
Preventing young people smoking
14
References (c/o Health Scotland)

• www.uwex.edu/ces/lmcourse
• www.uwex.edu/ces/pdande
• www.theoryofchange.org

15
Involve and include
16
Rogers outcomes
Free range
Aware of value of clucking
17
Question assumptions
18

• Outcomes matter
• (avoid your own
• foul outcome agreement!)

19
Indicators matter
20
Evaluation in practice

• Involve service users
• Measurement matching your ethos
• Evaluation process ? outcomes

21
Perspectives matter
22
Unexpected outcomes

• Rogers unexpected outcome

23

• Consistency v flexibility?

24
Learning

• what works
• for whom
• in what circumstances
• and why

25
Rogers tips for measuring what matters

• Use logic modelling to work out what matters and
  when.
• Build measurement into our practice and our
  practice into measurement
• Do it ourselves (as far as possible)
• Focus on learning

26
(No Transcript)
27
Round table discussion

• What particular challenges do you face or have
  faced about measuring outcomes?
• What positive experiences would you like to
  share?
• What tools or approaches have you found most
  helpful?