Title: Measuring Training and Evaluating Performance Is your training delivering
1Measuring Training and Evaluating Performance Is
your training delivering?
2Underlying assumption
- HC initiatives build the optimal level of
competence - Optimal levels of competence drive performance
outcomes - Performance outcomes drive key business measures
- Key business measures drive competitiveness/profit
ability/growth
3Show me the money!
- You cant demonstrate impact and value unless you
have measurement systems in place - You cant make choices about where and how much
to invest without the right data for your
analysis - You cant monitor improvement data unless you
know what indicators you want to effect - If you cant report impact and value, you cant
demonstrate your contribution to the business
4- The ROI Institute methodology
- The standard for measuring business impact value
5What is it?
- Micro programme/project level
- Not intended as macro level measurement technique
- Project/programme level can be aggregated to
report overall results use of
scorecards/dashboards - Can be used as a one off but real value comes
from using it to provide measurement systems and
practice changes leading to greater
accountability across the whole organisation for
the investments in human capital
6What kinds of investments
- Formal learning/training programmes
- Informal (non accredited/awarded) programmes
- Competence development programmes
- Non formal learning (provided there is evidence
of time/cost) - Change management projects
- Performance management systems
- E-learning and IT investments
- Team building projects
- Workplace projects
7Measurement Key Pieces of the Puzzle
8Planning of Objectives Evaluation Plan
9Chain of Impact Tells Complete Story
Learning
Application
Impact
Isolate the Effects
Convert Data to Monetary Value Tabulate
Fully-Loaded Costs
ROI
Intangible Benefits
10Data collection
- Balance efficiency with effectiveness
- Dont set up an industry
- Embed in the programme roll out
- Create accountability for reporting
- Plan in advance
- Collect data at all levels below that of final
reporting
11Defining BCR and ROI
Programme Benefits Benefits/Cost Ratio
Programme Costs
Net Programme Benefits ROI
X 100 Programme
Costs
ROI Calculation Example Programme Benefits from
participants (1st year) 230,000 Costs
per programme (25 participants) 88,000
12Going to ROI when and how?
13 14Capability systems Culture
- Capability
- Need to build different levels of knowledge
skills in LD and in the business - Business/sector knowledge
- Business performance analysis skills
- Learning needs analysis and design skills
- Planning and execution skills
- Data analysis skills
- Verbal and written reporting
- Outcomes/results attitude
- Personal accountability
15And systems
- Map existing systems and processes as is
- Develop to be map
- Agree stakeholders systems connections points
- Execute changes
- Build process tools/templates
- Integrate into practice
16And culture
- Accountability
- Business line and department/function mgt
- LD
- Participants
- Providers
- Agreement on objectives/outcomes upfront
- Costs need to be agreed up front
- Results used for shared decision making
- Reports shared and fully understood
17Lessons
- Need agreed strategy at most snr level of
business - Need targets for reporting to Board set up and
agreed - Need detailed execution plan
- Needs to become part of the way we do things
around here - Needs to be driven by a sense of urgency to get
traction - Need early wins
- Broad change in practices and processes
- Immediate focus on building demonstrator cases to
show that it works and implications for all
stakeholders
18Who else is doing it?
- Kleinwort Benson Private Bank
- LloydsTSB
- London Borough of Camden
- Meridian Hotels
- NHS
- Nokia
- Nokia Siemens
- Open University
- Ordnance Survey Office
- Reuters
- RNLI
- Rolls Royce
- Royal London
- Skills for Health
- Tribal Plc
- Volkswagen Group UK Ltd
- Vosper Thorneycroft (3 divisions)
- Awards UK Ltd
- AXA Insurance
- BBC
- British Army
- British Council
- BT
- BUPA
- CFS
- CCL Investment
- Defra
- Diamond Trading Co (De beers)
- E-skills
- Finance Leasing Association (FLA)
- Financial Services Skills Council
- Friends Provident
- Frost and Sullivan
- HSBC
- IiP
- ITV
19Thanks !