Evaluation framework for ICT-based learning technologies for disabled people

This paper presents the first systematic approach to evaluation of inclusive ICT-based learning technologies and ICT-based learning technologies for disabled people. The first systematic approach to classification of these technologies is presented in a companion paper. The aims of the evaluation approach can be summarised as follows.1. Evaluating various features of existing technologies from the perspectives of disabled learners and other stakeholders, comparing technologies and identifying gaps in technology provision.2. Evaluating the impact of technology use on user outcomes, including barriers to learning, self-confidence, motivation, increasing participation in learning activities and achievement of desired learning outcomes.The evaluation framework comprises three main components:1. Aims which specify the purpose(s) of the evaluation or what it is intended to achieve.2. Principles which provide a framework and context in which the evaluation should be carried out and, in particular, specify the constraints, rules and factors to be taken into account.3. Methodologies which specify the approaches used to carry out the evaluation taking account of the principles in order to achieve the aims.Development of the evaluation framework took place as part of a network project and involved a multi-stage process, including cycles of discussion, comment and validation using ICT based learning technologies used in the 16 partner countries. The resulting framework has several important applications in terms of establishing for the first time a clear evaluation framework which can be used to discuss and evaluate existing ICT-based learning technologies for disabled people, identify gaps in provision or the need for modifications and support the design and development process for new technologies.