Learning by Doing: World Bank Perspective on Monitoring and Evaluation for HIVAIDS

1
Learning by Doing World Bank Perspective on
Monitoring and Evaluation for HIV/AIDS

• Susan Stout
• Global HIV/AIDS Monitoring and Evaluation Team
• Global HIV/AIDS Program
• August 9, 2004

2
Three Topics

• Why Learn by Doing
• How ?
• Role of GAMET
• Lessons from experience in MAP 1 and 2
• Issues and Challenges

3
Why Learning by Doing ?

• Knowledge and Information is Power
• Motivation and Empowerment
• When accountabilty is strong, results are strong
• Learning is fundamental to scaling up and
  easing absorptive capacity constraints
• Money not useful, or used without ideas
• Donors more concerned with accountability and
  results than ever
• GFATM, Pepfar, IDA 14
• HIV/AIDS field has considerable uncertainty
  need information to guide choices

4
What is GAMET?

• A partnership to help countries learn by doing
• A partnership among UNAIDS, World Bank,
  bilaterals, GFATM and key technical agencies
• Seeks coordinated support, primarily at country
  level, to help countries monitor and evaluate
  the results of HIV/AIDS policies and programs

5
Why is there GAMET ?

• Increased demand from developing and developed
  country stakeholders for evidence of results and
  effectiveness,
• BUT
• Donors can not steer by results if NACs/CCMs and
  their implementing partners can not steer by
  results

6
Why (2)

• AND
• Many Countries do not yet have a guiding M and E
  framework to ensure that they can learn from
  their results
• Mechanism to
• Translate donor commitment to harmonized approach
  to M and E systems to harmonized approach to M
  and E capacity building
• Coordinate multiple types and forms of TA
  resources to fill capacity gaps at country level
• Focus on tapping country capacity

7
What is GAMETs Role

• Coordination of M and E
• Builds on normative role of MERG in defining
  indicators and tools
• Brokers inputs from across partners to strengthen
  and make operational country-owned, harmonized M
  and E framework
• Capacity Building
• Approach focuses on building national M and E
  systems to serve country needs as well as
  reporting functions to donors
• Focus on ensuring use of data in decision making
  at all levels

8
Three Elements to Capacity Building Role

• Support for development of national M and E
  Framework
• Rapid Results Approach Coaching in use of
  monitoring data in program management and policy
  decision making
• Promote Community Learning use of information
  for improving results at decentralized levels
• Districts, Communities, CBOs, NGOs

9
Lessons Learned (1)

• M and E recognized as strategic, but
• better at saying it is important than how to do
  it
• Indicatoritis lists of indicators is only
  part of the problem put in decision making
  context
• This is the key challenge for M and E
  Frameworks
• Need to focus on Who is doing the learning
• Not just the donor agencies, NAC or for UNGASS
• Focus more on clients/implementing partners
• High response from local levels Uganda case
• Distinguish and balance M and E for reporting
  and for managing/learning

10
Lessons (2)

• Donors working to improve both M and E The
  Third One emphasis focuses on common indicators
  
• Who is responsible for using less consensus
• Too much focus on reporting up rather than
  learning across?
• Are making progress on developing tools for
  monitoring for management
• Operational frameworks Malawi, Sierre Leone,
  Nigeria
• Uganda LQAS experience, now extending to all
  districts
• Rapid Results Approach

11
Lessons (3)

• Incentives Matter
• Motivational level
• Structural Link to Resource Allocation
• Programs and project designs (WB and other)
  designs must include specific, costed component
• Need to include specific structure (and staff)
  for encouraging and leading donor coordination in
  this area
• Support to full gamut surveillance, program
  activity monitoring, intervention
  evaluations/operational research

12
Challenges Going Forward

• Saying 5-10 is not enough
• Need to specific plan, including baseline
  assessment at the start
• Are dealing with a major shift in administrative
  culture as well as working on HIV/AIDS
• Grants management/performance contracting
• Use of peer review, focus on program and delivery
• Have hardly touched the evaluation agenda
• Role of independence
• What key questions?

13
Issues for Discussion

• Why does the Bank focus on National HIV/AIDS
  Commissions?
• Link to PRSPs, Expenditure Frameworks
• Multisectorality
• Does the Bank support the 3 ones?
• YES !
• How do I work with the WB at the country level ?
• Contact us !
• NAC, M and E Officers
• Link via USAID