Methodology for Evaluating Quality and Reusability of Learning Objects
Keywords:learning objects, multiple criteria decision analysis, quality evaluation, reusability, optimisation
AbstractThe aim of the paper is to present the scientific model and several methods for the expert evaluation of quality of learning objects (LOs) paying especial attention to LOs reusability level. The activities of eQNet Quality Network for a European Learning Resource Exchange (LRE) aimed to improve reusability of LOs of European Schoolnet’s LRE service for schools are analysed in more detail. As a pan‑European service, the LRE particularly seeks to identify LOs that can “travel well” (i.e., reusable) across national borders and can be used in a cultural and linguistic context different from the one in which they were created. The primary aim is to improve the quality of LOs in LRE. eQNet is doing this by establishing a network consisting of researchers, policy makers, and practitioners (teachers) that develops and applies “travel well” quality criteria to both existing LRE content as well as that to be selected in future from national repositories. The vision driving the LRE is that a significant percentage of high quality LOs developed in different countries, in different languages and to meet the needs of different curricula can be re‑used at European level. The main problem of all existing approaches in the area is a high level of the expert evaluation subjectivity. The authors analyse several scientific approaches, theories, methods and principles to minimise the subjectivity level in expert evaluation of LOs quality, namely: (1) multiple criteria decision analysis approaches for identification of quality criteria, (2) technological quality criteria classification principle, (c) fuzzy group decision making theory to obtain evaluation measures, (d) normalisation requirement for criteria weights, (e) scalarisation method and (f) trapezoidal fuzzy method for LOs quality optimisation. The authors show that the complex application of these approaches could significantly improve the quality of expert evaluation of LOs and noticeably reduce the expert evaluation subjectivity level. The paper also presents several examples of practical application of these approaches for LOs quality evaluation for Physics and Mathematics subjects.
Open Access Publishing
The Electronic Journal of e-Learning operates an Open Access Policy. This means that users can read, download, copy, distribute, print, search, or link to the full texts of articles, crawl them for indexing, pass them as data to software, or use them for any other lawful purpose, without financial, legal, or technical barriers other than those inseparable from gaining access to the internet itself. The only constraint on reproduction and distribution, and the only role for copyright in this domain, is that authors control the integrity of their work, which should be properly acknowledged and cited.