An Intelligent Tutoring System Oriented to the Integration of People with Intellectual Disabilities A. Conde, K. López de Ipiña, M. Larrañaga, J.A. Elorriaga, J.M. López, E. Irigoyen, N. Garay-Vitoria, A. Ezeiza, and J. Rubio*
Abstract. The development of Intelligent Tutoring Systems (ITS) based on mobile platforms offers new perspectives for a better integration of people with intellectual disabilities. The LAGUNTXO System aims to achieve the performance of human tutors. Due to the wide diversity related to a person with disabilities, an intelligent structure that may achieve a convenient tutoring system configuration for A. Conde . K. López de Ipiña . E. Irigoyen . A. Ezeiza Departamento Ingeniería de Sistemas y Automática, Escuela Técnica superior de Ingeniería, Bilbao, Escuela Politécnica Donostia, Grupo de Inteligencia Computacional e-mail: {angel.conde,karmele.ipina,eloy.irigoyen, aitzol.ezeiza}@ehu.es *
M. Larrañaga . J.A. Elorriaga Departamento de Lenguajes y Sistemas Informáticos, Grupo GALAN, Facultad de Informática e-mail: {mikel.larranaga,jon.elorriaga}@ehu.es N. Garay-Vitoria Departamento de Arquitectura y Tecnología de Computadores, Laboratorio de Interacción Persona Computador para Necesidades Especiales, Facultad de Informática Universidad del País Vasco/Euskal Herriko Unibertsitatea Plaza de Europa1, Donostia, 20008 e-mail:
[email protected] J.M. López Departmento de Informática e Ingeniería Industrial, Grupo de Investigación en Interacción Persona Ordenador y Bases de Datos (GRIHO) Universitat de Lleida, Pl. Víctor Siurana 1, 25003, Lleida e-mail:
[email protected] J. Rubio Fundación LEIA CDT Industrial Safety Unit, P.T. Alava – C/ Leonardo Da Vinci, 11, 01510 Miñano (Álava) - Spain e-mail:
[email protected] Y. Demazeau et al. (Eds.): Trends in PAAMS, AISC 71, pp. 639–647. springerlink.com © Springer-Verlag Berlin Heidelberg 2010
640
A. Conde et al.
each case has been incorporated. With an appropriate design of the structure and architecture of this task handler, it is very easy to operate by stakeholders. An automaton-based mechanism has been performed to technologically adapt the large amount of possibilities related to the interaction between people with disabilities, the task that is going to be made autonomously by users, and the mobile system elements. In this paper, LAGUNTXO architecture, operational ways, heuristic evaluation and a pilot study with final users are presented. Keywords: People with intellectual and physical disabilities, Intelligent Tutoring System, Integration enhancement.
1 Introduction Integrating people with disabilities into working and social environments is one of the main issues in applying Information and Communication Technologies (ICTs) into the Assistive Technology field. Particularly, it is necessary to pay special attention to the integration problem of people with intellectual disabilities. The origin of this project lies in a request of GUREAK ARABA S.L. (GRUPO GUREAK), a company that works in the integration of people with disabilities. Computer aided systems have been successfully applied in many fields [1]. Intelligent Tutoring Systems (ITSs) are computer-based instructional systems with models of instructional content that specify what to teach, and teaching strategies that specify how to teach [2, 3]. The ITS monitors the learner performance to determine the student's mastery on certain topics or tasks and how to satisfy their requirements by selecting the most appropriate pedagogical strategy and content to be taught. Intelligent Tutoring Systems working into mobile platforms are an appropriate response to one of the main problems of people with disabilities: their integration into social and working environments [4]. These devices are designed to reach the user adaptation and to obtain an interaction that allows overcoming personal disabilities, for increasing the performance, individual autonomy, working capability, personal safety and a healthy environment in workplaces [5]. At the moment, the project has been carried out by a multidisciplinary re-search group with researchers from different fields such as Computing, Psychology, Medicine, and Engineering. These studies have also caused several works with social environment associations and companies devote to the industrial integration of people with disabilities. The level of success achieved within the project life is described in detail in the next sections. Section 2 describes in detail the architecture of LAGUNTXO SYSTEM. Section 3 shows results that have been obtained from the heuristic evaluation and a pilot study with final users. Finally, some conclusions and future work are shown in section 4.
2 Architecture of LAGUNTXO System The LAGUNTXO system has been developed for the purpose of enhancing the integration of people with intellectual disabilities into their working and social
An ITS Oriented to the Integration of People with Intellectual Disabilities
641
environments. It has to achieve the performance of human tutors, going a further step than those classical tutoring systems [3] by dealing not only with the management of the tasks to be performed but also with the broad diversity of people with cognitive disabilities. Hence, the designed LAGUNTXO prototype has been structured in four main sub-systems: the Task Management System (TMS), the Intelligent Tutoring System in Mobile Platform (ITS-MP), the Intelligent Dialog System (IDS), and the Human Emotions Analysis System (HEAS). The Task Management System (TMS) has been developed to overcome the lack of suitable tools that deal properly with the broad diversity of people with disabilities when defining the tasks to be performed.
(b)
(a)
Fig. 1 (a) Structure of the TMS, (b) Structure of the ITS-MP
In this work, a system that provides the possibility of personalized configuration has been created: it handles any possible case in separate profiles due to the diversity of the disabled people collective. The TMS is composed by three modules where the information is divided in the following parts: Tasks to carry out, Ergonomic characteristics and Users’ personal information: to prevent accidents and emotional blockage situations for avoiding personal and physical damage. In the TMS (Figure 1.a) this information is organized in several databases or repositories which can be continuously updated by users, tutors, caregivers and relatives. Moreover, the TMS has been designed to allow a comfortable and simple configuration, giving to users an easy way to build the profile that will be loaded into ITS-MP (Figure 1.b). In this sense, TMS has inside an automaton-based
642
A. Conde et aal.
mechanism supporting sev veral functions. First, the automaton handles the commuunication with tutors, careegivers and relatives to allow better understanding of iits functionality. Finally, it geenerates the characteristics map of all Intelligent Tutorinng configurable devices whicch will be activated. Finally, Figure 2a shows an editioon screen to configure autom maton states. These states are organized in several leveels which are connected by conditional transitions. Each state represents a different subtask (simple or compleex) to perform in order to solve the entire tasks. Dependding on user disabilities, taasks profiles, and handheld mobile platforms, appropriaate states and transitions willl be charged on those platforms. Furthermore, the approopriate media type (image, sound, etc.) will be used considering both the user profiile and the device features. TMS T manages information about people with disabilitiees and the existing mobile pllatforms.
(a)
(b)
(c) Fig. 2 (a) Interface to createe the automata (b) Main Screen and Control Panel for configuuring the TMS (c) ITS-MP inteerfaces
For every device, inforrmation that might be used to determine if it is appropriaate for a particular user or chaaracteristic is provided. Meanwhile, the users records conntains their personal inform mation in an anonymous way, as well as the personal taskks involved. This information n is encrypted with different levels of access by passworrd. Database structure is co omposed by several states. These states have items aas
An ITS Oriented to the Integration of People with Intellectual Disabilities
643
images, videos, texts, etc., configuring the skeleton of the task. There exist two types of states. For interconnecting states, different transitions, defined by the stakeholders, have been created. The program is user-friendly, reliable, usefulness, agreeable, with a clear interface to be used by people with low computing knowledge. These interfaces are presented on tables or menus, depending on handled data (Figure 2).activated. Looking at ITS-MP in Figure 1b, and due to the characteristics of the people who will use these devices, it is absolutely necessary to design an interface that shows the following features: friendly, comfortable, flexible and ergonomically adapted to their characteristics. The main objective of this project lays in providing these users with a cognitive tool that contributes to the improvement of their autonomy, quality of life as well as help in the occupational health and safety management. Another objective is to integrate a task management into the portable device. To improve this, intelligent technologies based on fuzzy systems are used [2]. The basic structure of ITS-MP is based on rules and on an automaton mechanism to communicate with all sub-system of the ITS, similar to the mechanism previously detailed. An interface example can be seen at Figure 2c. It shows several screens where users may select the next subtask step by audio-video messages.
3 Evaluation 3.1 Heuristic Evaluation Heuristic evaluation is a well-known and used usability evaluation method. To apply this technique, a group of experts must evaluate the fulfilment of a set of principles (or heuristics) by the user interface of the system to be evaluated [6]. In this sense, a Heuristic Evaluation has been carried out on the user interface of LAGUNTXO system. The evaluation process has been divided in two parts. First, the user interface of the tutor generator was evaluated using the set of heuristics proposed by Pierotti [7]. Second, the user interface of a concrete tutor was evaluated in a mobile phone, using the eight heuristics principles defined by Bertini [8]. A ninth heuristic was incorporated to evaluate learnability, as it is considered an important issue for LAGUNTXO system. Each heuristic principle was composed by a set of subheuristics that evaluators had to evaluate by following the Severity Ranking Scale (SRS) proposed by Nielsen [6], which ranks the potential usability errors according to their importance. A total of 12 experts participated in the evaluation from different fields such as Computing, Psychology, Medicine, and Engineering. Every expert evaluated both ITS-TMS and ITS-MP systems, each of them using its corresponding set of heuristics and subheuristics. The procedure established that every expert had to pass all the heuristic and their corresponding subheuristics to the user interface. For every subheuristic, as a first step, experts had to check whether it was applicable or not to the user interface been studied. In case the subheuristic was applicable, the experts had to rank it according to Nielsen’s SRS, ranging from 0 (no usability problem at all) to 4 (usability catastrophe). Not applicable subheuristics have not been represented in the results of the evaluation as the focus was set on identifying potential usability errors on applicable subheuristics.
644
A. Conde et al.
Fig. 3 Percentages of Cosmetic, Minor and Major usability problems found for ITS-TMS (a) and ITS-MP (b)
In order to normalize the results, values have been divided into three groups. Every group has been represented regarding its percentage for every subheuristic, so their relevance for every subheuristic can easily be seen in the figure. A first group was composed by subheuristics that are not considered as potential usability errors and the ones considered as cosmetic problems; this group has been represented in the figure with blue color. On the other hand, brown color represented the subheuristics identified as minor usability problems. Finally, major and catastrophic usability problem have been represented by using green color in the figure. Figure 3 shows the results of the heuristic evaluation for both ITS-TMS and ITS-MP systems. Results show that studied systems have achieved a remarkable usability level. Even if there still are a number of major usability issues to solve, their amount is significantly low compared to the amount of subheuristics applicable on both studied user interfaces. Moreover, the sets of heuristics employed comprised 292 and 48 subheuristics respectively and have been based on solid foundations found in literature. This fact indicates that performed evaluation has been complete enough to ensure the validity of employed sets of heuristics and subheuristics. Besides, according to Nielsen [6], a number of five expert evaluators is enough to discover a relevant amount of usability problems in a user interface. In this sense, the amount of experts involved in the evaluation ensures that a relevant number of usability problems belonging to the user interface have been identified in the evaluation process.
3.2 Pilot Test So as to test a first version of the ITS, we developed a prototype which has been used with people with intellectual disabilities and with people in risk of exclusion, both in working and collective environments. This prototype has been integrated into a mobile phone, as shown in Fig. 4. For evaluation purposes a module that collects data of the use of the tutor was developed. Initially, 14 users participated in the test: 7 people were chosen in indoor working places, and other 7 in a flat dedicated to the learning of daily life skills.
An ITS Oriented to the Integration of People with Intellectual Disabilities
645
Fig. 4 An user of the ITS by a mobile phone
From the beginning of each test the implication of users and caregivers or working trainers was sought. Different indicators covering both subjective and objective parameters were created and measured during the test. This allowed the project team to evaluate the usability of the tools taking into account the efficacy and efficiency of the tool and the satisfaction of the people implicated in the test. With relation to objective indicators (Table1), results show that tutor help was mainly used during first days and that performance is rapidly enhanced when using the tutor. Both caregivers/human tutors and researchers involved in this work expressed a remarkable satisfaction and considered it very useful. It is worth mentioning the short cycle of use and that it is used even outside the workinghours. Table 1 Evaluation items and (b) subjective and (c) objective indicators Type Subjetive
Objetive
What
Work activities User Satisfaction Trainer Client Efficiency Trainer and client Efficacy Trainer
Subjective Indicators User Trainer Very High high Usefulness Very High high Improve the trainHigh Moderate ing Improve the autonHigh Moderate omy Improve speed Low Low Reduce errors high Moderate Attribute Satisfaction
Initial/final interviews and questionnaires Initial/final interviews and questionnaires Final interviews Number of calls Number of questions % os success in tasks
Client High High
Objetive Indicators Task perMost sucformance cessfully finished Questions Few/first days Phone Calls Few first days
646
A. Conde et al.
5 Concluding Remarks and Future Outlines A Due to the wide casuistic of the people with intellectual disabilities a friendly, comfortable, flexible and ergonomically adapted Intelligent Tutoring System into mobile platforms has been designed. A prototype called LAGUNTXO has been developed (free software under GNU license). It works as an active distributed support system, and allows compensating user disabilities through task programming, facilitating suspension and resuming of tasks, offering help in blockage situations. Heuristic evaluation and pilot tests indicate a high level of satisfaction of both the users and the stakeholders. On the one hand, it is increasing the users’ autonomy, improving their training and the quality of their work. On the other hand, stakeholders have a new and easily configurable tool that reduces the time they have to dedicate in training. Moreover, the job made so far has offered an opportunity to establish a solid link of communication between the social world of disabled people, caregivers and trainers, and the technological world of researchers. This link is leading to improve the knowledge and to overcome the gap between these two often separated worlds. In these sense, work is already being done to fulfil the new challenges that the project collaboration is generating. Complementary tools are being integrated in the system to improve its usefulness and to include the system within an ambient intelligence architecture. These tools are based on pattern matching (images and speech), human emotional feeling analysis, contextual information deployment (GPS, networking), and Artificial Intelligent (AI) techniques, giving the system the capacity of dynamic adaptation to the learning process. Acknowledgements. The involved work has received financial support from the Spanish Ministerio de Ciencia y Tecnología, project TSI2006-14250-C02-01, and the Spanish Ministerio de Industria, Turismo y Comercio, project PDM-2006-178.
References 1. Sammour, G., et al.: The role of knowledge management and e-learning in professional development. International Journal of Knowledge and Learning 4(5), 465–477 (2008) 2. Wenger, E.: Artificial Intelligence and Tutoring Systems. Morgan Kaufmann, Los Altos (1987) 3. Yazdani, M.: Intelligent tutoring systems: an overview. In: Lawler, C.R., Yazdani, M. (eds.) Learning environments & tutoring systems, pp. 182–201. Ablex, Norwood (1987) 4. Conde, A., López de Ipiña, K., Larrañaga, M., Garay-Vitoria, N., Irigoyen, E., Ezeiza, A., Rubio, J.: LAGUNTXO: A rule-based intelligent tutoring system oriented to people with intellectual disabilities. In: Lytras, M.D., Damiani, E., Carroll, J.M., Tennyson, R.D., Avison, D., Naeve, A., Dale, A., Lefrere, P., Tan, F., Sipior, J., Vossen, G. (eds.) WSKS 2009. LNCS (LNAI), vol. 5736, pp. 186–195. Springer, Heidelberg (2009) 5. Kenny, C., Pahl, C.: Personalised correction, feedback and guidance in an automated tutoring system for skills training. International Journal of Knowledge and Learning 4(1), 75–92 (2008)
An ITS Oriented to the Integration of People with Intellectual Disabilities
647
6. Nielsen, J.: Heuristic evaluation. In: Nielsen, J., Mack, R.L. (eds.) Usability Inspection Methods. John Wiley & Sons, New York (1994) 7. Pierotti, D.: Heuristic Evaluation - A System Checklist, http://www.stcsig.org/usability/topics/articles/ he-checklist.html (Retrieved December 2009) 8. Bertini, E., Gabrielli, S., Stephen, K.: Appropriating and assessing heuristics for mobile computing. In: AVI 2006, pp. 119–126 (2006)
