Impact evaluation of policies, programmes and projects

This tutor-based online certification programme provides a practical approach to design, conduct and interpret impact evaluations. It brings together researchers, evaluation experts, policy makers and development practitioners in a collaborative and instructive online space.

OBJECTIVES

After attending this certification programme, it is expected that participants are able to:

• Describe and explain concepts and methods to design an impact evaluation based on a counterfactual or based on qualitative data;

• Assess the cost-effectiveness of development interventions;

• Identify impact evaluation options that recognize budget, time and data constraints, and that best suit the needs of specific programmes, countries and institutional context;

• Strengthen the technical capability to understand, interpret and identify the pros and cons of quantitative impact evaluations (experimental and quasi-experimental design) and qualitative impact evaluations;

• Design, prepare and plan an impact evaluation;

• Analyse data to perform impact evaluations and cost-benefits analysis.

CONTENT

I. Distance learning modules, the online certification programme was delivered through the ITCILO online platform, the e-Campus. Participants completed the following 8 tutor-guided modules introducing, in detail, the knowledge and skills required to assess the relevance and effectiveness of an impact evaluation:

1. Introduction to impact evaluation;

2. Theory of change, results model, impact evaluation questions and indicators;

3. Generating a counterfactual and introduction to experimental methods;

4. Experimental and quasi-experimental methods;

5. Evaluation methods based on qualitative approaches;

6. Choosing the appropriate evaluation methods, data sources and data collection methods;

7. Sampling, survey and impact evaluation implementation;

8. Data analysis, reporting and dissemination.

II. Knowledge tests and practical assignments for every module, participants were required to study the content, to respond to a knowledge test and to practice by applying the knowledge, tools and techniques on their own policy, programme or project.

III. Case study, participants practiced their new skills acquired in self-guided lessons by completing a case study.

IV. Carry-though assignment

Throughout the 8 modules, participants completed a practicum, with the support and guidance of a coach. By means of a carry-through assignment, participants completed and documented a plan to conduct a real impact evaluation.

RESULTS

This certificate of achievement has been delivered to the participants who have produced the required deliverables by completing individual assignments during each phase of the programme:

I. Distance learning modules

• Completion of 8 tutor-guided online modules.

II. Knowledge tests and case studies

• Acquisition of practical knowledge and skills.

III. Carry-though assignment

• Research, development and finalization of a plan to conduct an impact evaluation;

• Submission of an impact evaluation design to the ITCILO experts for review, assessment and certification

NUMBER OF HOURS: 60