ICT in Education Toolkit Version 2.0a
September 2006
Manage Users |   How to Use the Toolkit   Concept and Blue Print   Logout
  Welcome , NIUE
Toolkit Map Filing Cabinet Team Bookshelf Search Handbook Toolkit Library My Messages
Tool 6.1: Evaluation of ICT Interventions
1 Classes of Evaluation
Class 1: Degree of Implementation
Class 2: Degree of Proper Use
Class 3: Degree of User Satisfaction
Class 4: Degree of Effectiveness
Class 5: Degree of Subsequent Application
Class 6: Degree of National Effect
2 Designs of Evaluation
3 Modes of Measurement of Evaluation
4 Management and Oversight of Evaluation
Reference Information
  Print This Tool

Toolbox 6:
Assessment and Subsequent Actions
6.1 Evaluation of ICT Interventions
6.2 Adjustment & Scaling Up
View Toolkit Map
View ICT for Education Handbook
  Tool 6.1 Evaluation of ICT Interventions


This Tool provides policymakers and planners with a framework and resources for evaluating the ICT Intervention Program decided upon after using Tool 2.2, and its implementation in accordance with the implementation plans of Toolboxes 3-5. (See Master Implementation Plan (Tool 5.2.) The evaluation results can be used to refine the ICT-Intervention, improve its management and implementation, decide whether to expand or terminate it, and to inform the introduction and planning of other ICT Interventions.

This is a resource Tool. It is intended to help policymakers and planners anticipate the several classes of evaluation that could be helpful over the life of an ICT-Intervention, consider the various evaluation questions that might be addressed, and gain an awareness of the need to plan desired evaluations prior to actual implementation of the ICT-Intervention.

This Tool, therefore, is NOT an evaluation instrument in itself. It is not intended to guide the design and conduct of the evaluations. That should be done by professionals with advanced training and experience in such work.

The Tool focuses on four areas:

1. Classes of Evaluation
The various classes of evaluations that can be conducted to determine the degree of performance and success of the ICT Intervention are:

Class 1- Implementation (As intended)
Class 2 - Proper Use (As intended)
Class 3 - User Satisfaction
Class 4 - Effectiveness (Fulfilling educational objectives)
Class 5 - Subsequent Application (Preparing people to apply the outputs)
Class 6 - National Effect (Contributing to national developmental goals)

These evaluations are to be conducted at different points in the life of an ICT-Intervention. Generally, each ascending class level would be initiated later than the one before it, and is more complicated to conduct. The following diagram indicates the comparative complexity and indicative timing of the different classes.

The schematic diagram below illustrates the role and place of the different classes of evaluation and how the feedback from these evaluations can be utilized.

2. Designs of the different classes of evaluation

3. Modes of measurement of evaluation

4. Management and Oversight of ICT-Intervention evaluation

Staff qualifications for evaluation work
Time needed for the evaluation
Budgeting the evaluation
Ethical considerations
Monitoring of the evaluation

The Tool also provides a selected and annotated list of references relevant to evaluation of ICT interventions.


  Acknowledgements | Terms & Conditions

Copyright © 2006. All rights reserved.

Site designed and maintained by: Sonjara

UNESCO Bangkok JFIT InfoDev (World bank) AED Knowledge Enterprise