preparation for meeting in Katmandu 0504

1
Monitoning Evaluation (ME) UNFPA
Vietnam (CP6 2001-2005)
Differences Changes
OVI
Results
OVI
OVI
evidences
Supportive Sustainable for Improvement of
Quality
May, 2004
2
Planned Intervention Model
What
UNFPA MPI
Support CPFC and others
Support MOH
Peoples Committee
Support Population Sector DCPFC, MOs
Support Health Sector (DOH)
Service providers
Clients/people
RH care Prevention, Clients rights on
RH (BCC/Advocacy)
Quality of care training, ...
3
Where
Project Provinces CP6 UNFPA Vietnam, 2001-2005
Ha Giang
Yen Bai
Ha Noi
Phu Tho
Ha Tay
Hai Phong
Hoa Binh
Thai Binh
Quang Tri
Hue
Da Nang
Quang Nam
Binh Dinh
Binh Phuoc
Khanh Hoa
Binh Duong
Ho Chi Minh City
Tien Giang
Kien Giang
4
From
Foudation of CP6 Result Based Management (RBM)
RBM aims to improve performance by comparing and
analyzing the actual results against planned
results through regular monitoring, reporting and
adjusting
Regular monitoring and evaluation
Implementation
Actual Results
Planned Results
Regular feedback and adjustment
5
Purpose of ME

• Provide information for timely decision-making
• Learn what works, does not work, why under what
  conditions
• Demonstrate results Improve accountability

6
(No Transcript)
7
Overview of ME
Evaluation
Evaluation
Facilitative Supervision
Pre-intervention (Baseline)
Post intervention (end-line)
(a)
(a)
2002 - 2003 - - - - - - - 2004 -
- - - - - - - - - 2005 - - - - - 2006
comparison
8
Who
Stakeholders Analysis Implementation
MOH
MPI
GSO
RH
ME guideline
Management Coordination
VCPFC
NEX manual
ME of CP6
Pop.
ME tools
RH, PDS, ME
UNFPA FO
DOH PCPFC MCH/FP
Donor
ME guidebook
Project provinces
FORMs/CHECKLISTs, Field trips, baseline, end-line
survey
9
How
Steps for ME
10
Expected for the Monitoring System
GOVT.
DATA
MOH, VCPFC, MPI
Monitor yearly Monitor quarterly Written report
SUPERVISION
Province
Monitor quarterly Written report
District
Monitor monthly Written report for supervision
monthly
Commune
11
Annual Planning ME Process Cycle
YEAR 2
Implementation preparation for quarterly review
and report (Q1)
Implementation preparation for annual review
and report (Q4 APR)
Annual Planning Formulation/Review
YEAR 1
Implementation preparation for quarterly review
and report (Q2)
Implementation preparation for quarterly review
and report (Q3)
12
ORGANIZATION STRUCTURE
COUNTRY REPRESENTATIVE
ASSISTANT REPRESENTATIVE
NPO
NPO
M E UNIT
13
COMPONENT PROJECT MANANGEMENT FUNCTIONS ROLES OF
PO AND ME UNIT
14
M E RESPONSIBILITIES FOR PROVINCIAL PROJECTS
15
RESPONSIBILITIES (TOR for ME Unit)
(1)

• To work with POs in finalizing/revising LFAs for
  planning of component projects and CP6
• Based on identified OVIs and MOVs develop a ME
  plan specifying responsibilities for
  implementation
• To develop field trip forms and checklists for
  use by POs, ME Unit and Project staff of CP6
• To develop quarterly reports and formats and
  field visit formats/checklists for use by PMU
• To provide technical backstopping to PMU in use
  of reporting and field visit formats

16
RESPONSIBILITIES (TOR for ME Unit)
(2)

• To develop TOR and organize surveys assessments
• To assist in conducting mid-term evaluations
• To work closely with POs in maintaining databases
  on project progress being out, six monthly
  update on achievement of activity and SI level
  indicators
• To inform management, through field visits made,
  progress towards achievement of outputs and
  implementation of activities and optimal use of
  UNFPA resources by projects

17
RESPONSIBILITIES (TOR for ME Unit)
(3)

• To assist in establishing M E framework for
  projects, facilities in documentation and
  dissemination of findings
• To work with National on ME for MOH VCPFC
• The team leader will be responsible
• For overall implementation of the ME plan for
  CP6
• For assigning roles to two deputies and
  coordinate work assigned
• To liaise with POs in updating ME data bases
• To liaise with National Government on development
  of HMIS
• To undertake capacity building of PMU for ME

18
Key activities on ME
05-/06/2004
5-12/2002
10/2003 - 04/2004
03 - 07/2003
05-09/2003
Developed technical outline for baseline and end
line survey
Use results, findings for interventions
Conduct baseline survey in 12 project provinces
Conduct MTR/CP6
Develop a guidebook on ME
National ME guideline on RH care service (MOH)
Revised updated OVIs of Logframe by meetings of
provinces
UNFPA GSO developed database for using/sharing
TB Medical College conducted under monitoring of
UNFPA, MOH, VCPFC and GSO
Feedback by 12 workshop in each province with
participation of all levels and donors
UNFPA MPI MOH VCPFC Projects of CP6

Develop consolidated report to share with MOH,
VCPFC MPI
field tested in 3 provinces with MOH VCPFC
2002
2004
2003
19
Example Monitoring Training Activities?
Conduct need assessment
Field test Identify trainers
Pretest Posttest FORM/CHECLIST
Rapid Assessment (mail survey)
End-line survey
20
Challenges

• ME is still new for the participating agencies
• Limitation of experience from the other countries
  
• Vertical systems (MOH vs VCPFC)
• The unified HMIS has not operated at all levels
• Many outputs of sub-programs, of component
  projects

21
Lessons learned

• Defining strategic plan step by step no
  rush
• Jointly develop monitoring plan that focus on
  results with stakeholders (MOH, VCPFC, Project
  Provinces)
• Identify basic indicators for monitoring with
  stakeholders
• Participatory monitoring (field trip, writing
  report, ...) and evaluation (baseline survey,
  MTR, end-line survey...)
• Clear the technical terms in Vietnamese
• English for the same understanding

22
Lessons learned (cont.)

• Provide feed-back for stakeholders (managers,
  leaders, donors, service providers) for timely
  adjustment or decision-making
• Using OVIs of logframe for monitoring
  (revise/update OVIs based on the results of
  baseline survey)
• Demonstrate results to managers, leaders by
  evidence/indicators

23
Evidence Result
Evidence and Result
24
Feedback of baseline survey (after about 3
months, workshop conducted in each province)