Monitoring and Evaluation Framework for the Gender Standby Capacity Project GenCap First Internation - PowerPoint PPT Presentation

Loading...

PPT – Monitoring and Evaluation Framework for the Gender Standby Capacity Project GenCap First Internation PowerPoint presentation | free to view - id: 272d50-MGIzM



Loading


The Adobe Flash plugin is needed to view this content

Get the plugin now

View by Category
About This Presentation
Title:

Monitoring and Evaluation Framework for the Gender Standby Capacity Project GenCap First Internation

Description:

STEP 4: assess degree of causality (correlation and attribution gap) ... Tool designed to track gender performance of HA; set baseline for pro-gress measurement ... – PowerPoint PPT presentation

Number of Views:174
Avg rating:3.0/5.0
Slides: 31
Provided by: srenbut
Category:

less

Write a Comment
User Comments (0)
Transcript and Presenter's Notes

Title: Monitoring and Evaluation Framework for the Gender Standby Capacity Project GenCap First Internation


1
Monitoring and Evaluation Framework for the
Gender Standby Capacity Project (GenCap)First
International Workshop for Gender Advisers in
Humanitarian Action 31 May 2007, GenevaDay 4,
Session 1
2
  • WE NEED YOUR INPUT!
  • PLEASE ASK QUESTIONS!

3
AGENDA
  • Introduction to the GenCap Monitoring and
    Evaluation Project
  • ME Key Concepts and Terminology
  • Building a ME Framework for GenCap Basic
    Approach
  • The GenCap ME Toolbox
  • Plan for the Day

4
OBJECTIVES OF THE ME PROJECT
1
2
3
4
5
The primary objective of the Monitoring and
Evaluation Project is to develop a framework
that allows the IASC and its partners to measure
the effectiveness, relevance and impact of the
GenCap program
Collect data on gender performance of
humanitarian missions
Provide practical planning tool for GAs
Collect good practices/ lessons learned
Important secondary objectives
Source UN OCHA GPPi
5
PROJECT PHASES
1
2
3
4
5
Phase 1 Development of ME framework
Phase 2 Workshop and revisingthe framework,
prep-aring it for field use
Phase 3 Piloting framework Assistance, field
tripand further revisions
Phase 4 Wrap-up summary project report
Alignment and finalization of project approach
(phone conference, kick-off meeting, final
TOR). Establishment of first draft ME framework
(indicators and results chains based on GA ToR,
IASC Gender Handbook) Development of draft ME
process (including draft, verification
procedures) Development of software for ME
tools Feedback round with UN OCHA/ UNDP project
team.
Presentation of ME framework during GenCap
workshop in May 2007 in Geneva Revising
framework and ME process based on comments
received during workshop Finalization of ME
process and manual Finalization of software for
ME tools
Providing on-going support in data gathering and
filling out ME tools for GAs deployed in the
field Two field trips (with GA) by GPPi to test
viability of scorecard usage and verification
procedure Additional phone interviews with GAs
in the field to collect feedback on tools use and
viability of ME process
Collecting filled-out ME tools analysis of
feedback on tool usage by GAs Wrap-up report,
focusing on data gathered from ME tools and
providing recommendations for further adaptation
of the ME approach
16 February 31 March 2008
1 August 15 February 2008
16 April 27 May 2007
27 May 31 July 2007
Source UN OCHA GPPi
6
AGENDA
  • Introduction to the GenCap Monitoring and
    Evaluation Project
  • ME Key Concepts and Terminology
  • Building a ME Framework for GenCap Basic
    Approach
  • The GenCap ME Toolbox
  • Plan for the Day

7
WHAT IS MONITORING AND EVALUATION?
1
2
3
4
5
  • Monitoring Continuous assessment of progress
    achieved during the implementation of the aims of
    GenCap and the activities of the GAs in order to
    track best practices and lessons learned, to
    identify reasons for success and failure, and to
    take necessary actions to improve performance
  • Evaluation Systematic and objective assessment
    of an ongoing or completed policy, program, or
    project, its design, implementation, and results.
    The aim is to determine the relevance and
    achievement of its objectives, and its
    effectiveness, efficiency, and impact
  • 1) Formative Evaluation
  • An evaluation that is intended to improve
    performance, which is most often conducted
    during the implementation phase of programs or
    projects
  • 2) Impact Evaluation
  • A systematic assessment of the effects -
    positive or negative, intended or unintended -
    of one or more GA activities on the final
    outcomes of the affected institutional
    structures, individuals, actors, planning etc.
    and the extent to which these outcomes can be
    attributed to the activity
  • 3) Other

Source UN OCHA GPPi
8
YOUR EARS RINGING MORE LINGO
1
2
3
4
5
Relevance The extent to which the objectives and
design of the GenCap program are consistent
with (a) current challenges and concerns in the
humanitarian sector and (b) the needs and
priorities of beneficiary countries and groups.
Effectiveness (Efficacy) The extent to which a GA
activity in a humanitarian mission has achieved,
or is expected to achieve, its objectives,
taking into account their relative importance.
The term is also used as a broader, aggregate
measure encompassing relevance and efficiency
as well - of the overall outcome of a deployment.
Efficiency The extent to which GenCap or the GA
in a particular deployment have converted or are
expected to convert resources/ inputs (such as
funds, expertise, time, etc.) economically into
results in order to achieve the maximum possible
outputs, outcomes, and impacts with the minimum
possible inputs.
Impact Positive and negative, primary and
secondary long-term effects produced by a GA
activity, directly or indirectly, intended or
unintended.
Source UN OCHA GPPi
9
THE LOGICAL MODEL
1
2
3
4
5
See The Logframe Handbook, World
Bank Source UNOCHA GPPi
10
RESULTS HIERARCHY
1
2
3
4
5
Results hierarchy Input Activity Output Imm
ediate outcome Mid-term outcome Impact
Descriptive question What resources (cash, human
effort etc.) went into relevant
preparation? What does the GA do? What
immediate result is achieved by the GAs
activities? What immediate change is induced by
the output? What are the mid-term consequences
of the immediate outcome? What is the ultimate
result (overarching desired goal) caused by the
mid-term outcome?
Source UN OCHA GPPi
11
RESULTS CHAIN
1
2
3
4
5
Humanitarian space exists for effective delivery
of gender sensitive protection/ assistance to
populations affected by disasters
Expected impact What is the overall program or
project goal? Expected outcome What are
specific programgoals that lead to the overall
goal? Expected output What immediate results
are expected from activities? Planned
activities What are the activities? First
column of logical model





















Source UNOCHA GPPi
12
AGENDA
  • Introduction to the GenCap Monitoring and
    Evaluation Project
  • ME Key Concepts and Terminology
  • Building a ME Framework for GenCap Basic
    Approach
  • The GenCap ME Toolbox
  • Plan for the Day

13
CONCEPTUAL, METHODOLOGICAL AND PRACTICAL
CHALLENGES
1
2
3
4
5
Standard methodological problems that need to be
addressed Attribution gap subjectivity
(verification), etc.
2
Practical challenges that need to be addressed
Problems specific to humanitarian emergencies
Lack of data, improvisation atmosphere, etc.
3
Source UNOCHA GPPi
14
OUR APPROACH TO TACKLING THE SPHERE OF
INFLUENCE CHALLENGE
1
2
3
4
5
  • The effectiveness, relevance and impact of the
    gender adviser should only be judged within her/
    his actual sphere of influence
  • The gender adviser will not have a direct impact
    on gender performance of humanitarian missions.
    For example, the gender adviser herself/himself
    cannot ensure that all beneficiaries equal access
    to water and sanitation.
  • Instead, the gender adviser primarily has an
    indirect impact on these issues, primarily by
    influencing other actors (camp manager, food
    delivery managers, etc.) to consider and act on
    gender-specific issues (e.g. by establishing
    mechanisms to enhance gender equality
    programming, using existing tools such as the
    IASC Handbook).

Source UNOCHA GPPi
15
BUILDING A COMPLETE RESULTS CHAIN BASED ON TOR
OF GA USEFUL AND NECESSARY FIRST STEP
1
2
3
4
5
  • Advantages
  • Contain the most relevant issues/ work areas for
    GA as defined by IASC
  • Remains on the actual level of influence of the
    GA
  • Challenges
  • More general than sector checklists provided in
    IASC Handbook
  • Moving on
  • STEP 1 formulate ToR items as desired results
    and supporting indicators
  • STEP 2 sort items into a logic model (e.g.
    results chain)
  • STEP 3 find missing results and establish causal
    connections
  • STEP 4 assess degree of causality (correlation
    and attribution gap)

Source UNOCHA GPPi
16
STEP 1 OF 3 DEVELOPMENT OF INDICATORS
1
2
3
4
5
EXAMPLE
  • 1) Information and analysis
  • Activities (ToR)
  • 1. Assist sector/cluster actors in conducting
    gender analyses of situations, with particular
    attention to the situation of women and girls
  • 2. Provide technical support to collection and
    analysis of SADA throughout all humanitarian
    programmes
  • (agencies, sectors/ clusters, CAPs, HICs)

Desired objectives/ results (GPPiC) 1. General
availability of gender analysis (with particular
attention to situation of women and girls) in all
agencies and sectors/clusters 2.
Routine SADA collection/analysis in all
humanitarian programmes by agencies, sectors/
clusters and in CAPs, HICs, inter-agency needs
assessments.
Indicators (GPPiC) 1a) Number of agencies
and sectors/clusters that have conducted a gender
analysis 0 none 1 less than 25 2
25-50 3 50-75 4 75-100 1b) Point of
time of gender analysis 1 prior to
programming 2 during programming 3 post
programming 2. Percentage of humanitarian progra
mmes with SADA analysis 0 none 1 less than
25 2 25-50 3 50-75 4 75-100
Source UNOCHA GPPiC
17
STEP 2 OF 3 SORT DESIRED RESULTS INTO LOGICAL
MODEL
1
2
3
4
5
EXAMPLE
Results hierarchy Input Activity Output
Immediate outcome Mid-term outcome Impact
  • Desired results Information and analysis

General availability of gender analysis in all
agencies and sectors/clusters
Routine SADA collection/analysis in all
humanitarian programmes by agencies, sectors/
clusters and in CAPs, HICs, inter-agency needs
assessments.
Routine collection/analysis of SADA throughout
all programmes
Source UNOCHA GPPiC
18
STEP 3 OF 3 FIND MISSING RESULTS ESTABLISH
CAUSAL CONNECTIONS
1
2
3
4
5
Results hierarchy Activity Output Immedi
ate outcome Mid-term outcome Impact
  • Sorted desired results Information and analysis

EXAMPLE
GA promotes to conduct/consolidate gender
analysis and provides technical support
GA promotes inclusion of gender dimensions into
needs assessments frameworks
GA promotes and supports use of SADA
Relevant planners/actors understand importance
and strive for gender analysis
High awareness of importance to include gender
dimensions
Relevant planners adopt support
Gender analysis becomes embedded in policies
SADA collection/gender analysis become embedded
in policies
Implementing actors incorporate gender equality
in CAP etc.
General availability of gender analysis in all
agencies and sectors/clusters
Routine collection/analysis of SADA throughout
all programmes
Routine inclusion of gender dimension into all
needs assessment frameworks
Source UNOCHA GPPiC
19
AGENDA
  • Introduction to the GenCap Monitoring and
    Evaluation Project
  • ME Key Concepts and Terminology
  • Building a ME Framework for GenCap Basic
    Approach
  • The GenCap ME Toolbox
  • Plan for the Day

20
BRIEF RECAP OBJECTIVES OF THE ME PROJECT
1
2
3
4
5
The primary objective of the Monitoring and
Evaluation Project is to develop a framework
that allows the IASC and its partners to measure
the effectiveness, relevance and impact of the
GenCap program
Collect data on gender performance of
humanitarian missions
Provide practical planning tool for GAs
Collect good practices/ lessons learned
Important secondary objectives
Source UNOCHA GPPi
21
OVERVIEW THE ME TOOLBOX
1
2
3
4
5
Description
Objective
Tool
Collect data on gender performance of
humanitarian missions
Baseline Assessment III
Tool designed to track gender performance of HA
set baseline for pro-gress measurement
1
2
Provide a practical planning tool for gender
adviser
Planning Journal
Tool designed to assist GA in prioritization and
planning of work
3
Assess relevance, effectiveness, and efficiency
of GA
Scorecard
Tool designed to track activities, outputs and
outcomes of GA
4
Subsection of Scorecard
Open component of Reporting Scorecard for
qualitative information
Collect good practices and lessons learned
Source UN OCHA GPPi
22
OVERVIEW THE ME TOOLBOX
1
2
3
4
5
Description
Objective
Tool
Collect data on gender performance of
humanitarian missions
Baseline Assessment
Tool designed to track gender performance of HA
Reporting Scorecard, Planning Journal, and
Baseline Assessment tool are all based on the
same set of indicators developed on the basis
of the Terms of Reference for the gender adviser
1
Provide a practical planning tool for gender
adviser
Planning Journal
Tool designed to assist GA in prioritization and
planning of work
2
Tool designed to track activities, outputs and
outcomes of GA
Assess relevance, effectiveness, and efficiency
of GA
Scorecard
3
Collect good practices and lessons learned
Subsection of Scorecard
Open component of Reporting Scorecard for
qualitative information
HA?
4
Source UNOCHA GPPi
23
APPLICATION OF TOOLS IN 4 STEPS
1
2
3
4
5
What? How?
When? How often? How much time?
Why?
Baseline Assessment Fill out Baseline Assessment
form I
Beginning of deployment Once/activity Max. 2 weeks
Establish baseline for reporting, gather specific
data, identify gaps, set priorities
1
Planning and manage-ment of priority activities
Fill out Planning Journal
Beginning of each activity Once/activity Max.
half workday/activity
Structure work, work goal oriented, keep focus,
make activities and decisions traceable
2
Trace activities, make GAs impact visible,
gather best practices
Reporting of activities Fill out Scorecard
Continuously Bimonthly/activity Max. 2h/activity
3
End of deployment Once/activity Max. 1h/activity
Make changes with respect to gender issues visible
Baseline Assessment Fill out the
Baseline Assessment form II
4
Source UN OCHA GPPi
Source UNOCHA GPPi
24
BASELINE ASSESSMENT I
1
2
3
4
5
Source UNOCHA GPPi
25
PLANNING JOURNAL
1
2
3
4
5
Source UNOCHA GPPi
26
SCORECARD
1
2
3
4
5
Source UNOCHA GPPi
27
BASELINE ASSESSMENT II
1
2
3
4
5
Source UNOCHA GPPi
28
AGENDA
  • Introduction to the GenCap Monitoring and
    Evaluation Project
  • ME Key Concepts and Terminology
  • Building a ME Framework for GenCap Basic
    Approach
  • The GenCap ME Toolbox
  • Plan for the Day

29
GOALS FOR THE ME SESSIONS TODAY
1
2
3
4
5
  • Get your input on draft ME concept (indicators,
    results chains) and tools (Baseline Assessment,
    Planning Journal and Scorecard)
  • Explain how to use the tools in the field
  • Parallel Workshop Session 1 Review and discuss
    draft indicators and results chains
  • Parallel Workshop Session 2 Review and discuss
    draft tools

Source UNOCHA GPPi
30
  • THANK YOU FOR YOUR ATTENTION AND YOUR QUESTIONS!!!
About PowerShow.com