Results Based Accountability Basics A Half Day Presentation

1
Results Based Accountability BasicsA Half Day
Presentation

• Standard Training Slides Sponsored by the
  Ministry of Social Development

2
Results Based Accountability
The Fiscal Policy Studies Institute Santa Fe, New
Mexico
Websites raguide.orgresultsaccountability.com
Book - DVD Orderssheapita.co.nz amazon.comresult
sleadership.org
3
How could RBA add value to you?
4
SIMPLE STEPS COMMON SENSE PLAIN LANGUAGE MINIMUM
PAPER TALK TO ACTION!
5
Results Based Accountabilityis made up of two
parts
Population Accountabilityabout the wellbeing
ofWHOLE POPULATIONS
For Communities Cities Districts
Countries E.g. All Rangatahi/Youth in Te Tai
Tokerau, All Migrants in Nelson
Performance Accountabilityabout the wellbeing
ofCLIENT GROUPS
For Teams - Providers Programmes - Agencies
Service Systems E.g. Clients of Services,
Collectives, Ministries or the Health System
6
The Language TrapToo many terms. Too few
definitions. Too little discipline
Lewis Carroll Center for Language Disorders
Core qualitative strategic objectives
Your made up jargon here
Measurable urgent systemic indicators
7
Results Based Accountability
COMMON LANGUAGE COMMON SENSE COMMON GROUND
8
Definitions

• RESULT / OUTCOME
• A condition of wellbeing for children, adults,
  families or communities
• All Tamariki in Hamilton are Born Healthy, Safe
  Roads, Nurturing Whanau/Families, A Prosperous
  Economy
• INDICATOR / BENCHMARK
• A measure which helps quantify the achievement of
  a result.
• Rate of low-birth weight babies, Rate of road
  crashes, Rate of child abuse and neglect,
  Unemployment rate
• PERFORMANCE MEASURE
• A measure of whether a programme, agency or
  service system is working. Three types
• How much did we do?
• How well did we do it?
• Is anyone better off? Client Results /
  Outcomes

Population
Performance
9
Translation Guide/Rosetta StoneNot the Language
Police
Ideas
Group 1
Group 2
Group 3 etc.
1. A condition of well-being for children,
adults, families communities 2. 3. etc.
RESULT
OUTCOME
GOAL
10
From Ends to Means
From Talk to Action
RESULT / OUTCOME
ENDS
Population
INDICATOR / BENCHMARK
PERFORMANCEMEASURE
MEANS
Performance
11
Results Indicators Performance Measures in
Amharic, Cambodian, Laotian, Somali, Spanish,
Tigrigna, Vietnamese
12
Result, Indicator, Strategy or Performance
Measure?
Result Indicator Perf Measure Result Strategy Resu
lt Indicator Perf Measure

1. A Safe Community
2. Percentage of Total Recorded Offences
3. Average Police response time
4. An Educated Workforce
5. Installing street lights to make people feel safe
6. People have living wage jobs and income
7. of people with living wage jobs and income
8. of participants in job training programme who
   get living wage jobs

13
Key RBA concepts

• 2 key types of accountability
• Population
• Performance
• 3 types of performance measures
• How Much
• How Well
• Better Off
• 7 questions that take you from talk to action
• From Ends to Means Change our thinking and
  approach - from what we do, to what we achieve

14
Population Accountability

• For whole populations in a geographic area

Mark Friedman (author)www.resultsaccountability.c
omwww.raguide.org
15
The 7 Population Accountability Questions

1. How do we define our Population and what are the
   quality of life conditions we want for them?
   (Population Results)
2. What would these conditions look like? What
   would be different? (Experience)
3. How can we measure these conditions? (Indicator)
4. How are we doing on the most important of these
   measures? (Baseline data and Story)
5. Who else has a role to play in doing better?
   (Partners)
6. What works to do better? (What works)
7. What do we propose to do? Including no-cost and
   low-cost ideas (Action Plan)

16
16
17
Christchurch City Community Outcomes

• A safe city
• A city of inclusive and diverse communities
• A city of people who value and protect the
  natural environment
• A well governed city
• A prosperous city
• A healthy city
• A city of recreation, fun and creativity
• A city of lifelong learning
• A city that is attractive and well designed

18
Kotahitanga Whanau Ora Collective
positive statements - positive focus

• All whaanau in Te Puuaha ki Manuka(Greater South
  Auckland) are ...
• Mana Ora Healthy and safe
• Mana Motuhake Economically secure
• Mana Tangata Culturally confident
• Mana Rangatiratanga Knowledgeable and skilled
• Mana Whanau Connected, engaged and entrepreneurs

Acknowledgement Kotahitanga Collective Members
Turuki Healthcare Trust, Papakura Marae, Huakina
Development Trust and Te Kaha O Te Rangatahi
Trust, South Auckland, New Zealand.
19
Aranui Community Trust
Acknowledgement Aranui Community Trust Inc
Society (www.actis.org.nz)
20
Implementing RBA Aranui Result areas and
indicators
Result Area 1
A community that is spiritually and socially
strong Indicator of police callouts for family
violence
Result Area 2

• A community full of knowledge and learning
• Indicator
• of students with NCEA level 1 _at_year 11
• primary school students performing at national
  average for literacy and numeracy

21
Result Area 3

• A great physical environment
• Indicator
• Expenditure on repairs and maintenance to city
  property in the Aranui Burwood Pegasus area
• of R M that is due to damage

Result Area 4

• People who know and fit in Aranui
• Indicator
• of people who offer to participate in local
  events

22
Result Area 5

• A community that is healthy
• Indicator
• of Aranui residents presenting at Accident and
  Emergency with no trauma needs/ concerns
• of total acute inpatient admissions

23

24
Results for Children, Families and CommunitiesA
Working List of Population Results

• Healthy Births
• Healthy Children and Adults
• Children Ready for School
• Children Succeeding in School
• Young People Staying Out of Trouble
• Stable Families
• Families with Adequate Income
• Safe and Supportive Communities

24
25
Georgia Policy Council for Children and
Families RESULTS

• Healthy children
• Children ready for school
• Children succeeding in school
• Strong families
• Self-sufficient families

25
26
Tip for Drafting Population Accountability Results

• All ______ in ______ are __________

Families
Tauranga
Economically Secure
Insert your Population
Insert your Geographic area
Insert your Condition of Wellbeing
26
27
Examples of Means not Ends
1. COLLABORATION 2. SYSTEMS REFORM 3. SERVICE
INTEGRATION 4. DEVOLUTION 5. FUNDING POOLS
27
28
Leaking Roof(Results thinking in everyday life)
Experience
Not OK
Inches of Water
Measure
Turning the Curve
Story behind the baseline (causes)
Partners
What Works
Action Plan 2
Action Plan
28
29
3 criteria for choosing Indicators
Communication Power
Does the indicator communicate to a broad range
of audiences?
Proxy Power
Does the indicator say something of central
importance about the result?
Does the indicator bring along the data HERD?
Data Power
Quality data available on a timely basis.
29
30
Choosing IndicatorsWorksheet
Safe Community
Outcome or Result_______________________
ProxyPower
DataPower
CommunicationPower
Candidate Indicators
Measure 1 Measure 2 Measure 3 Measure 4 Measure
5 Measure 6 Measure 7 Measure 8
H M L
H M L
H M L
H
H
H
H
L
H
DataDevelopmentAgenda
31
Three Part Indicator List for each Result
Part 1 Primary Indicators

• 3 to 5 Headline Indicators
• What this result means to the community
• Meets the Public Square Test

Part 2 Secondary Indicators

• Everything else thats any good (Nothing is
  wasted.)
• Used later in the Story behind the Curve

Part 3 Data Development Agenda

• New data
• Data in need of repair (quality, timeliness etc.)

31
32
What do we mean by a baseline?
OK?
Point to Point
Turning the Curve
Forecast
History
Baselines have two parts history and forecast
32
33
Indicator Reports
Neighbourhood
Country
City

KruidenbuurtTilburg, Netherlands
New Zealand
Portsmouth, UK
34
34
35
Key RBA concepts

• 2 key types of accountability
• Population
• Performance
• 3 types of performance measures
• How Much
• How Well
• Better Off
• 7 questions that take you from talk to action
• From Ends to Means Change our thinking and
  approach - from what we do, to what we achieve

36
quick exercise

• Population Accountability

37
Tip for Drafting Population Accountability Results

• All ______ in ______ are __________

How would you experience this outcome? What
would be different?
Insert your Geographic area
How would you measure success? What Indicator
would you use?
Insert your Population
Insert your Condition of Wellbeing
38
Performance Accountability

• For clients of programmes, agencies, teams and
  service systems

Mark Friedman (author)www.resultsaccountability.c
omwww.raguide.org
39
Results Based Accountabilityis made up of two
parts
Population Accountabilityabout the wellbeing
ofWHOLE POPULATIONS
For Communities Cities Districts
Countries E.g. All Rangatahi/Youth in Te Tai
Tokerau, All Migrants in Nelson
Performance Accountabilityabout the wellbeing
ofCLIENT GROUPS
For Teams - Providers Programmes - Agencies
Service Systems E.g. Clients of Services,
Collectives, Ministries or the Health System
40
The 7 Performance Accountability Questions

1. Who are our clients? (Client Group)
2. How can we measure if our clients are better off?
   (Client Result / Outcome)
3. How can we measure if we are delivering services
   well? (Quality Measures)
4. How are we doing on the most important of these
   measures? (Baseline Data and Story)
5. Who are the partners that have a role to play in
   doing better? (Partners)
6. What works to do better? (Research Evidence)
7. What do we propose to do? Including no-cost and
   low cost ideas. (Action Plan)

41
Performance AccountabilityGetting from talk to
action
Client Group
42
All performance measures that have ever
existed for any programme in the history of the
universe involve answering two sets
of interlocking questions.
43
Performance Measures
Quantity
Quality
HowMuch did we do? ( )
HowWell did we do it? ()
44
Performance Measures
Effort How hard did we try?
Effect Anyone better off?
45
Performance Measures

HowMuch
HowWell
Effort
Effect
46
Performance Measures
Quantity
Quality
How much service did we deliver?
How welldid we deliver it?
Effect Effort
Output Input
How much change / effect did we produce?
What quality of change / effect did we produce?
47
Social Services Example
Quantity
Quality
How much did we do?
How well did we do it?
Effect Effort
Is anyone better off?
of clients who move off a working age benefit
and into employment (at 6 months and at 12 months)
48
Education example
Quantity
Quality
How much did we do?
How well did we do it?
Student-teacherratio
Number ofstudents
Effect Effort
Is anyone better off?
Number ofgraduates
Percent ofgraduates
49
Drug/Alcohol Treatment Programme
Quantity
Quality
How much did we do?
How well did we do it?
Percent ofstaff withtraining/certification
Number ofpersonstreated
Effect Effort
Is anyone better off?
Number of clientsoff of alcohol drugs - at
exit - 12 months after exit
Percent of clientsoff of alcohol drugs -
at exit - 12 months after exit
50
Education example 2
Quantity
Quality
How much did we do?
How well did we do it?
Student-teacherratio
Number ofstudents
Is anyone better off?
Effect Effort
Percent of secondary school students
whograduate on timeand enter Uni oremployment
after graduation
51
Primary Care Practice
Quantity
Quality
How much did we do?
How well did we do it?
Percent ofchildren who did not attend
Number ofchildren aged 0-2 enrolled
Effect Effort
Is anyone better off?
52
(No Transcript)
53
Not all performance measures are created equal
Quantity
Quality
How much did we do?
How well did we do it?
LeastImportant
Least
AlsoVery Important
Effect Effort
Is anyone better off?
MostImportant
Most
54
The matter of control
Quality
Quantity
How much did we do?
How well did we do it?
MostControl
Effect Effort
Is anyone better off?
LeastControl
PARTNERSHIPS
55
Separating the Wheat from the ChaffTypes of
performance measures found in each quadrant
How much did we do?
How well did we do it?
Clients/customers served
Activities (by type of activity)
Is anyone better off?
56
The matter of use

1. The first purpose of performance measurement is
   to improve performance.

2. Avoid the performance measurement equals
punishment trap. ? Create a healthy
organisational environment ? Start small ?
Build bottom-up and top-down simultaneously
57
Key RBA concepts

• 2 key types of accountability
• Population
• Performance
• 3 types of performance measures
• How Much
• How Well
• Better Off
• 7 questions that take you from talk to action
• From Ends to Means Change our thinking and
  approach - from what we do, to what we achieve

58
quick exercise

• Performance Accountability

59
Performance Measures for my (insert the name of
your Programme or Service here)
How much did we do?
How well did we do it?
Who are your clients?
Clients/customers served
What would you put in here?
client satisfaction with xxx
Is anyone better off?
Choose one
60
How Population Performance Accountabilities
Fit Together
61
THE LINKAGE Between POPULATION and PERFORMANCE
POPULATION RESULT
Contributionrelationship
Mentoring Programme for Young Offenders
Alignmentof measures
meeting weekly with mentor
young people on programme
Appropriateresponsibility
reoffending
reoffending
CLIENT RESULTS/OUTCOMES
62
Population Accountability
Result to which you contribute to most directly.
Indicators
Story
Every timeyou make apresentation, use
atwo-partapproach
Partners
What would it take?
Your Role as part of a larger strategy.
Your Role
Performance Accountability
Programme
Performance measures
Story
Partners
Action plan to get better
63
Population Accountability
Result to which you contribute to most directly.
Indicators
Story
Every timeyou make apresentation, use
atwo-partapproach
Partners
What would it take?
Your Role within the larger strategy.
Your Role
Performance Accountability
Programme
Performance measures
Story
Partners
Action plan to get better
64
Different kinds of progress
1. Data a. Population indicators Reporting
on curves turned increase or decrease of the
graphed data (e.g. the baseline).
b. Performance measures Client
group progress and improved service delivery
How much did we do? How well did we do it? Is
anyone better off? E.g. Skills/Knowledge,
Attitude/Opinion, Behaviour Change,
Circumstance Change
2. Accomplishments Other positive activities
accomplished, not included above.
3. Stories Real stories that sit behind the
statistics that show how individuals are better
off e.g. case studies, vignettes, social media
clips.
65
Whats next?A Basic Action Plan for Results
Based Accountability
TRACK 1 POPULATION ACCOUNTABILITY

• Establish results
• Establish indicators, baselines and charts on the
  wall
• Create a result card
• Set tables (action groups) to turn curves

TRACK 2 PERFORMANCE ACCOUNTABILITY

• Performance measures, and charts on the wall for
  programmes, agencies and service systems
• Use 7 Questions manager by manager, and programme
  by programme, in management, budgeting and
  strategic planning

66
IN CLOSING
67
(No Transcript)
68
Kia ora / thank you!