Impact Evaluation Toolkit Workshop


Dr. Hamna Ahmed and Hijab Nadeem

CREB organized its second virtual workshop on Impact Evaluation Toolkit. The Impact Evaluation Toolkit is a hands-on guide on how-to design and implement impact evaluations. While many parts of the toolkit can apply to impact evaluation in general, the focus of the toolkit was to help evaluate the impact of Results-Based Financing (RBF) projects in the health sector on maternal and child health.

The Toolkit addresses different stages of the impact evaluation cycle, which includes choosing evaluation questions, building a team, designing the impact evaluation, collecting, storing, and analyzing data. The first stage is to choose evaluation questions, which covers theory of change, first generation questions, and second-generation questions. The second stage is to set up an impact evaluation team, for which the roles and time commitments of each team member are defined in the Toolkit. The third stage is to design the impact evaluation, which includes defining outcome of interest, determining an identification strategy, sampling, choosing which data will be needed, budgeting, and planning. The fourth stage is to collect and store the data, which includes planning data collection, determining a data entry strategy, hiring survey firms, preparing data collection instruments, managing fieldwork, storing, and documenting data. The last stage is to analyze the data, which includes cleaning the data, creating variables, validating the design of the impact evaluation. The Toolkit also provides technical Tools that can be used to implement the recommendations of the Guidelines.

The workshop was conducted in three session of one hour each on the 5th, 12th and 19th April, 2021.