DOWNLOAD PDF VERSION HERE

This Tool provides policymakers and planners with a framework and resources for evaluating the ICT Intervention Program decided upon after using Tool 2.2, and its implementation in accordance with the implementation plans of Toolboxes 3-5. (See Master Implementation Plan (Tool 5.2.) The evaluation results can be used to refine the ICT-Intervention, improve its management and implementation, decide whether to expand or terminate it, and to inform the introduction and planning of other ICT Interventions.

This is a resource Tool. It is intended to help policymakers and planners anticipate the several classes of evaluation that could be helpful over the life of an ICT-Intervention, consider the various evaluation questions that might be addressed, and gain an awareness of the need to plan desired evaluations prior to actual implementation of the ICT-Intervention.

This Tool, therefore, is NOT an evaluation instrument in itself. It is not intended to guide the design and conduct of the evaluations. That should be done by professionals with advanced training and experience in such work.

The Tool focuses on four areas:

1. Classes of Evaluation
The various classes of evaluations that can be conducted to determine the degree of performance and success of the ICT Intervention are:

Class 1- Implementation (As intended)
Class 2 - Proper Use (As intended)
Class 3 - User Satisfaction
Class 4 - Effectiveness (Fulfilling educational objectives)
Class 5 - Subsequent Application (Preparing people to apply the outputs)
Class 6 - National Effect (Contributing to national developmental goals)

These evaluations are to be conducted at different points in the life of an ICT-Intervention. Generally, each ascending class level would be initiated later than the one before it, and is more complicated to conduct. The following diagram indicates the comparative complexity and indicative timing of the different classes.

The schematic diagram below illustrates the role and place of the different classes of evaluation and how the feedback from these evaluations can be utilized.

2. Designs of the different classes of evaluation

3. Modes of measurement of evaluation

4. Management and Oversight of ICT-Intervention evaluation

Staff qualifications for evaluation work
Time needed for the evaluation
Budgeting the evaluation
Ethical considerations
Monitoring of the evaluation

The Tool also provides a selected and annotated list of references relevant to evaluation of ICT interventions.