Impact evaluation of policies, programmes and projects

This tutor-based online certification programme provides a practical approach to design, conduct and interpret impact evaluations. It brings together researchers, evaluation experts, policy makers and development practitioners in a collaborative and instructive online space. OBJECTIVES After attending this certification programme, it is expected that participants are able to: · Describe and explain concepts and methods to design an impact evaluation based on a counterfactual or based on qualitative data; · Assess the cost-effectiveness of development interventions; · Identify impact evaluation options that recognize budget, time and data constraints, and that best suit the needs of specific programmes, countries and institutional context; · Strengthen the technical capability to understand, interpret and identify the pros and cons of quantitative impact evaluations (experimental and quasi-experimental design) and qualitative impact evaluations; · Design, prepare and plan an impact evaluation; · Analyse data to perform impact evaluations and cost-benefits analysis. CONTENT I. Distance learning modules The online certification programme was delivered through the ITCILO online platform, the e-Campus. Participants completed the following 8 tutor-guided modules introducing in details the knowledge and skills required to assess the relevance and effectiveness of an through an impact evaluation: 1. Introduction to impact evaluation. 2. Theory of change, results model, impact evaluation questions and indicators. 3. Generating a counterfactual and introduction to experimental methods. 4. Experimental and quasi-experimental methods. 5. Evaluation methods based on qualitative approaches. 6. Choosing the appropriate evaluation methods, data sources and data collection methods. 7. Sampling, survey and impact evaluation implementation. 8. Data analysis, reporting and dissemination. II. Knowledge tests and practical assignments For every module, participants were required to study the content, to respond to a knowledge test and to practice by applying the knowledge, tools and techniques on their own policy, programme or project. III. Case study Participants practiced their new skills acquired in self-guided lessons by responding to a case study foreseen in each module. IV. Carry-though assignment Throughout the 8 modules, participants completed a practicum, with the support and guidance of a coach. By means of a carry-through assignment, participants completed and documented a plan to conduct a real impact evaluation. RESULTS This certificate of achievement has been delivered to the participants who have produced the required deliverables by completing individual and group assignments during each phase of the programme. I. Distance learning modules (24 hours) · Completion of 8 tutor-guided online modules. II. Knowledge tests and practical assignments (case study) (10 hours) · Acquisition of practical knowledge and skills. III. Carry-though assignment (36 hours) · Research, development and finalization of a plan to conduct an impact evaluation; · Submission of an impact evaluation design to the ITCILO experts for review, assessment and certification.