Impact evaluation of policies, programmes and projects

This tutor-based online certification programme provides a practical approach to design, conduct and interpret impact evaluations. It brings together researchers, evaluation experts, policy makers and development practitioners in a collaborative and instructive online space. OBJECTIVES After attending this certification programme, it is expected that participants are able to: • Describe and explain concepts and methods to design an impact evaluation based on a counterfactual or based on qualitative data; • Assess the cost-effectiveness of development interventions; • Identify impact evaluation options that recognize budget, time and data constraints, and that best suit the needs of specific programmes, countries and institutional context; • Strengthen the technical capability to understand, interpret and identify the pros and cons of quantitative impact evaluations (experimental and quasi-experimental design) and qualitative impact evaluations; • Design, prepare and plan an impact evaluation; • Analyse data to perform impact evaluations and cost-benefits analysis. CONTENT I Distance learning modules, the online certification programme was delivered through the ITCILO online platform, the e-Campus. Participants completed the following 8 tutor-guided modules introducing, in detail, the knowledge and skills required to assess the relevance and effectiveness of an impact evaluation: 1. Introduction to impact evaluation; 2. Theory of change, results model, impact evaluation questions and indicators; 3. Generating a counterfactual and introduction to experimental methods; 4. Experimental and quasi-experimental methods; 5. Evaluation methods based on qualitative approaches; 6. Choosing the appropriate evaluation methods, data sources and data collection methods; 7. Sampling, survey and impact evaluation implementation; 8. Data analysis, reporting and dissemination. II. Knowledge tests and practical assignments for every module, participants were required to study the content, to respond to a knowledge test and to practice by applying the knowledge, tools and techniques on their own policy, programme or project. III. Case studies, participants practiced their new skills acquired in self-guided lessons by responding to selected case studies. IV. Carry-though assignment Throughout the 8 modules, participants completed a practicum, with the support and guidance of a coach. By means of a carry-through assignment, participants completed and documented a plan to conduct a real impact evaluation. RESULTS This certificate of achievement has been delivered to the participants who have produced the required deliverables by completing individual assignments during each phase of the programme: I. Distance learning modules · Completion of 8 tutor-guided online modules. II. Knowledge tests and case studies · Acquisition of practical knowledge and skills. III. Carry-though assignment · Research, development and finalization of a plan to conduct an impact evaluation; · Submission of an impact evaluation design to the ITCILO experts for review, assessment and certification NUMBER OF HOURS: 60