Improving Teaching and Learning in Classrooms by Reducing Teacher Absenteeism in Uganda

1
Africa Program for Education Impact Evaluation
Improving Teaching and Learning in Classrooms by
Reducing Teacher Absenteeism in Uganda
Impact Evaluation Team
AFRICA IMPACT EVALUATION INITIATIVE, AFTRL
2
Questions

• What is the impact of strengthening the school
  management committees (SMCs) to monitor and
  report on teacher attendance?
• What is the impact of strengthening reporting
  linkages between the coordination centers (CCs)
  and the district education office?
• What is the impact of combining the two types of
  interventions
• Overall Question Which is the most
  cost-effective intervention for increasing
  teacher attendance?

3
Impact Evaluation Design

• The proposed evaluation with employ multiple
  treatments at different levels.
• Randomized assignment shall be done at two
  levels
• Random assignment of the Coordinating Centers to
  TREATMENT or CONTROL for CC monitoring
• Within each CC, random assignment of the schools
  to TREATMENT or CONTROL for SMC monitoring

4
Indicators

• Teacher absenteeism
• Student Performance (Learning competencies (using
  the National Assessment of Primary Education and
  the Primary Leaving Examination)
• Pupil attendance
• Completion rates
• Wastage
• Repetition rates
• Dropout rates
• Monitoring visits and Reports by the SMCs
• Monitoring reports send to DEO by the CCTs
• Increase follow-up (e.g. sanctions) taken in
  reaction to teacher absenteeism cases
• Increased reports of conflict between the SMCs
  and the head teachers
• Visits and reports by the District Inspectors

5
Sample and Data

• A sample size of 64 CCs and 8 schools per CCs (so
  512 schools) will be enough to detect, with a
  power of 0.8 and a level of 0.05
• A reduction in teacher absenteeism of 10
• An increase in average school performance at
  national exams of 0.1 standard deviation
• Baseline Survey
• Spot checks by SMC
• Quarterly Surveys
• School administrative records
• Monthly reports by CCs
• Reports by District Inspectors
• Annual School Census (EMIS data)
• National exams results by school (PLE)
• National Assessment of Primary Education (NAPE)
  Competency Tests

6
Summary of Program Design
No CC Monitoring CC monitoring
32 CCs 32 CCs
No SMC monitoring 128 schools (CONTROL) 128 schools
SMC monitoring 128 schools 128 schools
7
Staffing Plan

• Impact Evaluation Team
• Intervention Piloting Team
• Education Planning (ME Section)
• Policy SellingChampion
• Policy Analysis Unit

8
Timeline

• Process that you will follow to gain acceptance
• Concept Note
• Present Concept Note
• Permanent SecretaryJuly 4, 2007
• Monitoring and Evaluation Working GroupJuly 18,
  2007
• Education Sector Consultative CommitteeAugust 1,
  2007
• Submit Proposal to EPDFAugust 2007
• Visit for Impact Evaluation Group (1 to 2
  weeks)August 2007
• BaselineNovember, 2007
• Pilot ImplementationFebruary through November,
  2008
• Follow-upNovember, 2008
• Evaluation ResultsFebruary, 2009

9
Budget

• TBD