a semantic web approach for automated test generation

IADIS INTERNATIONAL CONFERENCE

WWW/INTERNET 2012

ii

PROCEEDINGS OF THE IADIS INTERNATIONAL CONFERENCE

WWW/INTERNET 2012

MADRID, SPAIN OCTOBER 18-21, 2012

Organised by IADIS International Association for Development of the Information Society

iii

Copyright 2012 IADIS Press All rights reserved This work is subject to copyright. All rights are reserved, whether the whole or part of the material is concerned, specifically the rights of translation, reprinting, re-use of illustrations, recitation, broadcasting, reproduction on microfilms or in any other way, and storage in data banks. Permission for use must always be obtained from IADIS Press. Please contact [email protected]

Edited by Bebo White and Pedro Isaías Associate Editor: Luís Rodrigues

ISBN: 978-989-8533-09-8

iv

TABLE OF CONTENTS

FOREWORD

xi

PROGRAM COMMITTEE

xv

KEYNOTE LECTURES

xix

FULL PAPERS SEMANTIC RETRIEVAL OF DOCUMENTS FROM DIGITAL REPOSITORIES IN THE MOODLE ENVIRONMENT

3

Renan Rodrigues de Oliveira, Fábio Moreira Costa, Cedric Luiz de Carvalho and Ana Paula Ambròsio

HTML SEGMENTATION USING ENTROPY GUIDED TRANSFORMATION LEARNING

11

Evelin Carvalho Freire de Amorim

WPPS: A NOVEL AND COMPREHENSIVE FRAMEWORK FOR WEB PAGE UNDERSTANDING AND INFORMATION EXTRACTION

19

Ruslan R. Fayzrakhmanov

AN APPROACH FOR EXTRACTING WEB FORM LABELS BASED ON DISTANCE ANALYSIS OF HTML COMPONENTS

27

Leonardo Bres dos Santos, Carina F. Dorneles and Ronaldo dos S. Mello

EXTRACTING AND EXPOSING RELATIONAL DATABASE METADATA ON THE WEB

35

João Carlos da Silva, Elisabete Tomomi Kowata and Auri Marcelo Rizzo Vincenzi

BUSINESS MODELS FOR MOBILE APPLICATIONS

43

Alexandra Chapko, Andreas Emrich, Marc Gräßle, Dirk Werth and Peter Loos

AN INFLUENCE PERSPECTIVE: IS USER PARTICIPATION CRUCIAL IN THE WEB DEVELOPMENT PROCESS?

51

Tomayess Issa and Pedro Isaias

AWARENESS OF OTHERS IN ACCESSIBLE COLLABORATIVE RICH INTERNET APPLICATIONS

60

Leonelo D. A. Almeida and M. Cecília C. Baranauskas

DATA QUALITY IN WEB PORTALS FOR INTERACTION WITH OTHER PEOPLE Carmen Moraga, Mª Ángeles Moraga, Angélica Caro, Rodrigo Romo Muñoz and Coral Calero

v

68

AUTHORITYRANK: COGNITIVE AUTHORITY AND INFORMATION RETRIEVAL IN THE WEB

76

Filipe Roseiro Côgo, Sérgio Roberto P. da Silva and Roberto Pereira

A WEB-BASED METHOD FOR ONTOLOGY POPULATION

85

Hilário Oliveira, Rinaldo Lima, João Emanoel and Fred Freitas

DOMAIN ONTOLOGIES MODELING VIA SEMANTIC ANNOTATIONS OF UNSTRUCTURED WIKI KNOWLEDGE

93

Roberto Boselli, Mirko Cesarini, Fabio Mercorio and Mario Mezzanzanica

SOCIAL LEARNING: DEFINING LEARNING OBJECTS FROM SOCIAL TOOL

101

André Luís Andrade Menolli, Sheila Reinehr and Andreia Malucelli

A UBIQUITOUS ELECTRONIC TOURIST GUIDE FOR THE CAMINHOS DE PEDRA ITINERARY

109

Humberto Costa, Cristiano Costa, Eduardo Silva, Sandro Rigo, Jorge Barbosa, Luiz Silveira Jr. and Underlea Bruscato

RECO – A FRAMEWORK FOR EXPERIMENTATION WITH RECOMMENDERS

117

Jakub Ševcech, Michal Kompan and Mária Bieliková

TRANSLATING XML QUERIES INTO EQUIVALENT SQL STATEMENTS

125

Marta Breunig Loose and Deise de Brum Saccol

A SURVEY ON SOCIAL NETWORK SITES' FUNCTIONAL FEATURES

133

Antonio Tapiador and Diego Carrera

A STUDY OF THE CONDITIONS FOR A GOOD DIGITAL CITIZEN IN A NEW MEDIA ERA

141

Heein Yang, Misoo Kwon, Gilwoo Nam and Jongsoo Jeon

WEB-BASED INFORMATION EXPLORATION OF SENSOR WEB USING THE HTML5/X3D INTEGRATION MODEL

149

Byounghyun Yoo

A RUBY DOMAIN SPECIFIC LANGUAGE (DSL) FOR WEB MASHUPS

157

Richard J Barnett and Carianne Cowley

A REAL-TIME WEB-BASED HEALTH MONITORING SYSTEM BASED ON ENTERPRISE SERVICE BUS

165

Yohanes Baptista Dafferianto Trinugroho, Kamyar Rasta, Trinh Hoang Nguyen, Rune Fensli and Frank Reichert

HOW CAN A MOBILE VENDOR ENGENDER SHOPPER TRUST AND REDUCE PERCEIVED OPPORTUNISM?

173

Sonia San-Martín

INFRASTRUCTURE TO NEXT-GEN PROACTIVE E-COMMERCE ENVIRONMENT THROUGH INTERNET: UBIQUITOUS COMMERCE FOR THE MASSES

180

Paulo H. Cazarotto, Cristiano André da Costa, Rodrigo da Rosa Righi and Jorge L. V. Barbosa

ABANDONMENT IN WEB APPLICATIONS FOR PURCHASING AIRLINE TICKETS

188

Malcolm Mactavish and Lyndon Veale

CYBERSQUATTING DETECTION BY AUTOMATIC DOMAIN NAME RE-ACCENTING Jean Ceccato and Anthony Don

vi

195

WHAT DETERMINES E-LOYALTY? AN ANALYSIS OF FACTORS AFFECTING ON-LINE CUSTOMER RETENTION

203

Donnacha Clifford and Michael Lang

INFLUENCE OF PERCEIVED QUALITY OF UNIVERSITY OFFICIAL WEBSITE TO PERCEIVED QUALITY OF UNIVERSITY EDUCATION AND ENROLLMENT INTENTION

211

Achmad Nizar Hidayanto, Fanny Rofalina and Putu Wuri Handayani

AUTOMATIC AND CONTINUOUS MONITORING AND COMPOSITION OF NONDETERMINISTIC WEB SERVICES

219

Gustavo B. Valfre, Angelo E. M. Ciarlini and Sean W. M. Siqueira

USABILITY EVALUATION OF ELECTRONIC SIGNATURE BASED E-GOVERNMENT SOLUTIONS

227

Thomas Zefferer and Vesna Krnjic

A SEMANTIC WEB APPROACH FOR AUTOMATED TEST GENERATION

235

Bogdan Drăgulescu, Marian Bucos and Radu Vasiu

EXPLORING PARTICIPATORY DESIGN FOR SNS-BASED AEH SYSTEMS

242

Lei Shi, Dana Al Qudah and Alexandra I. Cristea

DEAF LITERACY: A COMPUTATIONAL PROCESS TO DESIGN SIGN LANGUAGE/PORTUGUESE ARTIFACTS FOR INTERNET

250

Cayley Guimarães, Diego R. Antunes, Laura S. García, Letícia M. Peres and Sueli Fernandes

PARALLEL HIGHER-ORDER SVD FOR TAG-RECOMMENDATIONS

257

Philipp Shah, Christoph Wieser and François Bry

A TRAVEL SEQUENCE RECOMMENDATION APPROACH BASED ON MARKOV MODEL

266

Dalu Guo, Richong Zhang, Xudong Liu and Hailong Sun

LEARNING SYNONYM RELATIONS FROM FOLKSONOMIES

273

Alex Rêgo, Leandro Marinho and Carlos Eduardo Pires

EXPLORING THE EFFECTS OF SOCIAL INFLUENCE ON USER BEHAVIOR TARGETED TO FEEDBACK SHARING

281

Agnis Stibe and Harri Oinas-Kukkonen

USABILITY EVALUATION OF FACEBOOK´S PRIVACY FEATURES: COMPARISON OF EXPERTS AND USERS

290

Marcos H. Kimura, Marcio J. Mantau, Avanilde Kemczinski, Isabela Gasparini and Carla D. Medeiros Berkenbrock

SUBJECT CLASSIFICATION OF WEB PAGES

298

Ludger Martin

USATASKER: A TASK DEFINITION TOOL FOR SUPPORTING THE USABILITY EVALUATION OF WEB APPLICATIONS

307

Leandro Guarino de Vasconcelos and Laércio Augusto Baldochi Jr.

ASSESSING THE PERFORMANCE OF JAVA AND ERLANG IN WEB 2.0 APPLICATIONS Jucimar Maia da Silva Jr., Rafael Dueire Lins and Lanier Menezes dos Santos

vii

315

EMULATION OF COMPLEX NETWORK INFRASTRUCTURES FOR LARGE-SCALE TESTING OF DISTRIBUTED SYSTEMS

323

Robert Lübke, Robin Lungwitz, Daniel Schuster and Alexander Schill 331

A CLIQUE BASED WEB GRAPH MODEL Zhiming Chen and András Faragó

INTEGRATING PROCESS AND SERVICES THROUGH META-MODELS

339

Patricia Bazán, Roxana Giandini, Gabriela Perez, Elsa Estevez and Javier Diaz

AN ADAPTIVE APPROACH FOR IDENTIFYING REPUTATION OF RESEARCHERS

347

Cristiano Roberto Cervi, Renata Galante and José Palazzo Moreira de Oliveira

STRATEGIES AND MOTIVATIONS BEHIND ARTIFICIAL TRENDING TOPICS IN TWITTER

355

Raquel Recuero and Ricardo Araujo

GUIDE OF ACCESSIBILITY AND USABILITY RECOMMENDATIONS AIMING FOR THE DEVELOPMENT OF HYPERMEDIA FOR DEAF

363

Vanessa Tavares de Oliveira Barros, Kátia Tavares Meserlian, Rodolfo Miranda de Barros, Flávio Ogawa and Francisco Antônio Pereira Fialho

COMPARISON OF USABILITY TESTING TOOLS FOR WEB GRAPHICAL INTERFACES

371

Bernardo Santos, Carlos Teixeira and Ana Respício

IDENTIFYING PRAGMATIC PATTERNS OF COLLABORATIVE PROBLEM SOLVING

379

Heiko Hornung, Roberto Pereira, M. Cecilia C. Baranauskas, Rodrigo Bonacin and Julio Cesar Dos Reis

INTERPRETATION OF WEB SITE USER INTERACTION AS A BASE FOR CONTEXT-AWARE PAGE ADAPTATION

388

Pascal Bihler

SHORT PAPERS HEURISTIC AND AI APPROACH TO OPTIMIZE PLAGIARISM DETECTION TOOL USING A PUBLIC SEARCH ENGINE

399

Ondrej Vesely, Jan Kolomaznik and Tomas Foltynek

ONTOLOGY ON THE LEVEL G OF THE SOFTWARE PROCESS MODEL MPS.BR TO ASSIST BUSINESS PROCESSES MODELING

404

Alessandro Viola Pizzoleto, Hilda Carvalho de Oliveira and Celso Socorro Oliveira

A MULTI-TOOL SCHEME FOR SUMMARIZING TEXTUAL DOCUMENTS

409

Rafael Dueire Lins, Steven J. Simske, Luciano de Souza Cabral, Gabriel de França Silva, Rinaldo Lima, Rafael F. Mello and Luciano Favaro

AUTOMATION OF A VENDING SYSTEM USING SMARTPHONES Tiago Jost, Cristiano Costa, Rodrigo Righi and Alexandre Andrade

viii

415

RERANKING IMAGE SEARCH RESULT BASED ON PHOTOGRAPHIC QUALITY ASSESSMENT WITHOUT IMAGE FEATURES

420

Masaharu Hirota, Shohei Yokoyama, Naoki Fukuta and Hiroshi Ishikawa

TOPIC PAGE MINING BASED ON PHRASERANK FOR ADVERTISEMENT IMAGE

425

Jian Sun, Siyuan Chen, Yingju Xia and Jun Sun

ON THE USE OF SOCIAL MEDIA FOR IMPORTANT THINGS: FACEBOOK AS A COPING TOOL

431

Felix S. Hussenoeder

GENAPI: A GENERIC SOCIAL-NETWORKING API

436

Richard J. Barnett and Simon de la Rouviere

DISTINCTION BETWEEN OPINION AND INFORMATION SPEADING IN SOCIAL NETWORKS

442

Igor Kanovsky and Omer Yaari

A MODELING APPROACH FOR KNOWLEDGE MANAGEMENT IN COMPLEX BUSINESS SYSTEMS

447

Abdussalam Ali and Igor Hawryszkiewwycz

AN INCREMENTAL APPROACH TO TECHNOLOGY-SUPPORTED CURRICULUM DESIGN AND APPROVAL

453

Jim Everett, George Macgregor and Rehman Mohamed

MEANINGFUL LEARNING IN MATHEMATICS EDUCATION: A PROPOSAL OF DEVELOPING A PROTOTYPE OF AN AUGMENTED REALITY TOOL TO SUPPORT THE TEACHING OF CALCULATION

458

Edson Pacheco and Rodolfo Miranda de Barros

SOCIAL NETWORK ENGINEERING AND ONTOLOGY ENGINEERING FOR E-LEARNING: HOW DO THESE WORK TOGETHER?

463

Seid Maglajlic

DETERMINATION OF TOPIC DESCRIPTION TERMS IN TOPIC MODELS

468

Kota Kamura, Hung-Hsuan Huang and Kyoji Kawagoe

METROPOLITALIA: A CROWDSOURCING PLATFORM FOR LINGUISTIC FIELD RESEARCH

473

Fabian Kneissl and François Bry

INVESTIGATING COLLABORATION AND EFFECTIVENESS OF VIRTUAL TEAMS WITH DISTINCT ORGANIZATION TYPES

477

Juliana de Melo Bezerra, Celso Massaki Hirata and André Antônio Battagello

WEB ANALYTICS AS ONE OF THE FEEDBACK MECHANISMS IN ELECTRONIC GOVERNMENT MANAGEMENT

483

Rasim Alguliev, Hana Skalska, Farhad Yusifov and Mahammad Sharifov 487

BRICK: A LINKED DATA EXPERIENCE Nadia Catenazzi, Lorenzo Sommaruga and Ingrid Domenighetti

LESSONS LEARNED FROM CREATING A TRUST SYSTEM FOR P2P MARKETPLACES Mauro Nunes and João Correia

ix

492

REFLECTION PAPERS EDUCA REPOSITORY SERVICE: API TO SUPPORT DIFERENTES DIGITAL REPOSITORIES

499

Jorge Rocha, Ana Caixinha, Joaquim Arnaldo Martins and Marco Fernandes

INTERACTION DESIGN ISSUES FOR MOBILE MULTI-TOUCH APPS

503

Huberta Kritzenberger

BUILDING TEST SUITES FROM TEST RECORDINGS OF WEB APPLICATIONS: REFLECTION PAPER

507

Martin Filipsky, Miroslav Bures and Ivan Jelinek

PEOPLE’S HISTORY APPLICATIONS: USING THE WWW TO RE-WRITE HISTORY

511

Lorie Loeb and Sang Jin Lee

DATA PROTECTION AND EMPLOYEE BEHAVIOUR: THE ROLE OF INFORMATION SYSTEMS SECURITY CULTURE

516

Lena Connolly and Michael Lang

POSTERS 523

E-LEARNING IN INFORMATICS TEACHING Olga Mironova, Irina Amitan and Jüri Vilipõld

SOCIAL CHEESECAKE: AN UX-DRIVEN INTERFACE FOR MANAGING CONTACTS

526

Alicia Díez and Antonio Tapiador

DESCRIPTION STANDARDS: CROSSWALK PROPOSAL FOR EDUCA

529

Ana Caixinha, Joaquim Arnaldo Martins, Jorge Rocha and Marco Fernandes

CAREER EDUCATION SUPPORT UTILIZING MOBILE DEVICES

533

Rumiko Kurita, Motoo Kusano, Asahiro Arai, Shoichi Nakamura, Setsuo Yokoyama and Youzou Miyadera

TOWARDS AN APPROACH BASED ON ELECTRONIC CONTRACT TO ADDRESS THE VENDOR LOCK-IN IN CLOUD COMPUTING Gabriel Costa Silva and Itana Maria de Souza Gimenes

AUTHOR INDEX

x

537

FOREWORD These proceedings contain the papers and posters of the IADIS International Conference WWW/Internet 2012, which was organised by the International Association for Development of the Information Society, Madrid, Spain, 18-21 October 2012. The IADIS WWW/Internet 2012 Conference aims to address the main issues of concern within WWW/Internet. WWW and Internet had a huge development in recent years. Aspects of concern are no longer just technical anymore but other aspects have arisen. This conference aims to cover both technological as well as non-technological issues related to these developments. Submissions were accepted under the following main tracks and topics:  Web 2.0  Collaborative Systems  Social Networks  Folksonomies  Enterprise Wikis and Blogging  Mashups and Web Programming  Tagging and User Rating Systems  Citizen Journalism  Semantic Web and XML  Semantics Web Architectures  Semantic Web Middleware  Semantic Web Services  Semantic Web Agents  Ontologies  Applications of Semantic Web  Semantic Web Data Management  Information Retrieval in Semantic Web  Applications and Uses  e-Learning  e-Commerce / e-Business  e-Government  e-Health  e-Procurement  e-Society  Digital Libraries  Web Services/SaaS  Application Interoperability  Web-based multimedia technologies

xi

 Services, Architectures and Web Development  Wireless Web  Mobile Web  Cloud/Grid Computing  Web Metrics  Web Standards  Internet Architectures  Network Algorithms  Network Architectures  Network Computing  Network Management  Network Performance  Content Delivery Technologies  Protocols and Standards  Traffic Models  Research Issues         

Web Science Digital Rights Management Bioinformatics Human Computer Interaction and Usability Web Security and Privacy Online Trust and Reputation Systems Data Mining Information Retrieval Search Engine Optimization

The IADIS WWW/Internet 2012 Conference had 201 submissions from more than 33 countries. Each submission has been anonymously reviewed by an average of four independent reviewers, to ensure the final high standard of the accepted submissions. The final result was the approval of 49 full papers, which means that the acceptance rate was 25%. A few more papers have been accepted as short papers, reflection papers, and poster/demonstrations. Best papers will be selected for publishing as extended versions in the IADIS International Journal on WWW/Internet (IJWI) and in other selected journals. The conference, besides the presentation of full papers, short papers, reflection papers, and posters presentations also included two keynote presentations from internationally distinguished researchers. We therefore would like also to express our gratitude to Dr. Irwin King, The Chinese University of Hong Kong, Hong Kong and Dr. Ricardo Baeza-Yates, VP of Yahoo! Research, Barcelona, Spain. As we all know, organising a conference requires the effort of many individuals. We would like to thank all members of the Program Committee for their hard work in reviewing and selecting the papers that appear in the proceedings.

xii

We are especially grateful to the authors who submitted their papers to this conference and to the presenters who provided the substance of the meeting. These Proceedings book contain a rich experience of the academic & research institutions and the industry on diverse themes related to the Internet and Web. We do hope that researchers, knowledge workers and innovators both in academia and the industry will find it a valuable reference material. Last but not the least, we hope that everybody will have a good time in Madrid and we invite all participants for the next year’s edition of the IADIS International Conference WWW/Internet that will be held in Fort Worth, Texas, USA. Bebo White, Stanford University, USA Program Chair Pedro Isaías, Universidade Aberta (Portuguese Open University), Portugal Conference Chair

Madrid, Spain 18 October 2012

xiii

PROGRAM COMMITTEE PROGRAM CHAIR Bebo White, Stanford University, USA

CONFERENCE CHAIR Pedro Isaías, Universidade Aberta (Portuguese Open University), Portugal

COMMITTEE MEMBERS Abdolhossein Sarrafzadeh, UNITEC New Zealand, New Zealand Agostino Poggi, Universitat Degli Studi Di Parma, Italy Alberto Barrón-Cedeño, Universitat Politècnica de Catalunya, Spain Alessandro Soro, Crs4, Italy Alexander Schill, TU Dresden, Germany Alexander Troussov, IBM Dublin Center for Advanced Studies, Ireland Alexander Woehrer, St. Poelten University of Applied Sciences, Austria Alexiei Dingli, University Of Malta, Malta Ana Fermoso, Universidad Pontificia De Salamanca, Spain Ana Sanz, Universidad Carlos III De Madrid, Spain Ana Regina Cavalcanti Da Rocha, Centroin, Brazil Ananya S. Guha, Indira Gandhi National Open University, India Andrea Kienle, University of Applied Sciences, Dortmund, Germany Andreas Papasalouros, University Of The Aegean, Greece Andreas Schrader, Insitute of Telematics, University of Luebeck, Germany Angélica Antonio, Universidad Politécnica De Madrid, Spain Anirban Kundu, West Bengal University Of Technology, India Antonio Reyes, Instituto Superior de Intérpretes y Traductores, Mexico Arturo Mora-Soto, Carlos III University Of Madrid, Spain Asadullah Shaikh, Universitat Oberta de Catalunya, Spain Beob Kyun Kim, Korea Institute of Science and Technology Informat, South Korea Bo Hu, Universität Der Bundeswehr München, Germany Brahmananda Sapkota, University Of Twente, Netherlands Carsten Ulrich, Shanghai Jiao Tong University, China Charlie Abela, University Of Malta, Malta Chih Cheng Hung, Southern Polytechnic State University, USA Christos Bouras, University Of Patras, Greece Christos Georgiadis, University Of Macedonia, Thessaloniki, Greece Christos Katsanos, Hellenic Open University, Greece Ciprian Dobre, University Politehnica Of Bucharest, Romania Clodoveu Davis, Universidade Federal de Minas Gerais, Brazil Constantina Costopoulou, Agricultural University Of Athens, Greece Costas Yialouris, Agricultural University Of Athens, Greece Daniel Cunliffe, University Of Glamorgan, United Kingdom

xv

David F Barrero, Universidad De Alcalá, Spain Debajyoti Mukhopadhyay, Maharashtra Institute of Technology Pune, India Demetrios Sampson, University Of Piraeus, Greece Diana Andone, Politehnica University Of Timisoara, Romania Diana Pérez Marín, Universidad Rey Juan Carlos, Spain Dimitrios Rigas, De Montfort University, United Kingdom Dirk Thissen, Rwth Aachen, Germany Dongqiang Yang, Flinders University, Australia Elena Calude, Massey University At Albany, New Zealand Elias Kirche, Florida Gulf Coast University, USA Elif Ubeyli, Tobb Economics And Technology University, Turkey Eloisa Vargiu, Barcelona Digital, Spain Erick López Ornelas, Universidad Autónoma Metropolitana - Cuajimalpa, Mexico Erik Cambria, National University Of Singapore, Singapore Evangelos Sakkopoulos, University Of Patras, Greece Ezendu Ariwa, London Metropolitan University, United Kingdom Fan Zhao, Florida Gulf Coast University, Usa Florence Sedes, Universite Paul Sabatier Of Toulouse, France Florin Pop, University Politehnica Of Bucharest, Romania Francesco Pagliarecci, Università Politecnica delle Marche, Italy Gavin Mcardle, National Centre for Geocomputation, National Unive, Ireland George Gkotsis, University Of Warwick, United Kingdom George Koutromanos, University Of Athens, Greece George Vouros, University Of Piraeus, Greece Gheorghe Cosmin Silaghi, Babes-Bolyai University of Cluj-Napoca, Romania Giuseppe Patane, Cnr-imati, Italy Gonzalo Rojas Durán, University Of Concepcion, Chile Gustavo Rossi, Universidad Nacional De La Plata, Argentina Hakikur Rahman, Institute of Computer Management & Science (ICMS), Bangladesh Henry Oinas-Kukkonen, University Of Oulu, Finland, Finland Hetal Jasani, Northern Kentucky University, United States Holger Hinrichs, University Of Applied Sciences Lübeck, Germany Horst Hellbrück, University Of Applied Sciences Lübeck Horst, Germany Ioan Toma, University Innsbruck, Austria Irwin King, Chinese University Of Hong Kong, Hong Kong J. Enrique Agudo, Universidad De Extremadura, Spain J. K. Vijayakumar, King Abdullah University of Science and Technology, Saudi Arabia Jaime Ramírez Ramírez, Universidad Politécnica De Madrid, Spain James Thong, Hong Kong University Of Science And Technology, Hong Kong James Walden, Northern Kentucky University, United States Jamshid Shanbehzadeh, Tarbiat Moallem University, I. R. Iran Jan Zizka, SoNet/Dept. of Informatics, FBE, Mendel University, Czech Republic Janez Brank, Jozef Stefan Institute, Slovenia Javier Saldaña, Universidad Carlos III De Madrid, Spain Jessica Rubart, University of Applied Sciences Ostwestfalen-Lippe, Germany Jinjun Chen, Swinburne University Of Technology, Australia John Garofalakis, University of Patras, Greece Jörg Roth, University Of Applied Sciences Nuremberg, Germany Jorge Fox, Formal Methods Group, ISTI-CNR, Italy

xvi

José Laurindo Campos dos Santos, Instituto Nacional de Pesquisas Na Amazonia, Brazil Juhnyoung Lee, IBM T. J. Watson Research Center, Usa Julie Yazici, Florida Gulf Coast University, Usa Kai Jakobs, RWTH Aachen University, Germany Karl-heinz Krempels, RWTH Aachen University, Germany Konstantinos Kotis, University Of The Aegean, Greece Krzysztof Walkowiak, Wroclaw University Of Technology, Poland Lazaros Iliadis, Democritus University Of Thrace, Greece Liliana Ardissono, Università Degli Studi Di Torino, Italy Liping Liu, University Of Akron, Usa Loris Penserini, Future and Emerging Technologies, Belgium Luca Spalazzi, Polytechnic University Of Marche, Italy Lucia Rapanotti, The Open University, United Kingdom Manolis Tzagarakis, University Of Patras , Greece Mara Nikolaidou, Harokopio University Of Athens, Greece Margarida Romero, ESADE, Spain Margherita Antona, ICS - FORTH, Greece Maria Bielikova, Slovak University Of Technology, Slovakia Maria Claudia Buzzi, CNR - IIT, Italy María Del Puerto Paule Ruíz, University Of Oviedo, Spain María Isabel Sánchez-Segura, Universidad Carlos Iii De Madrid, Spain Martin Gaedke, Chemnitz University Of Technology, Germany Massimo Marchiori, Unipd/ Utilabs, Italy Maurizio Vincini, Universita' Di Modena E Reggio Emilia, Italy Max J. Egenhofer, University of Maine, USA Maytham Safar, Kuwait University, Kuwait Michael Hartle, independent, Germany Michal Wozniak, Wroclaw University Of Technology, Poland Michalis Vaitis, University of the Aegean, Greece Miguel-Angel Sicilia Urbán, University Of Alcalá, Spain Miroslav Bures, Czech Technical University In Prague, Czech Republic Muhammad Akram Shaikh, Tsinghua University, China Naseem Memon, Mehran University Of Engineering And Technology, Pakistan Niki Lambropoulos, London South Bank University, United Kingdom Nikos Karacapilidis, University Of Patras, Greece Nikos Karousos, University Of Patras, Greece Nikos Tsirakis, University Of Patras, Greece Omair Shafiq, University Of Calgary, Canada Ourania Hatzi, Harokopio University Of Athens, Greece Panagiotis Metaxas, Wellesley College, Usa Paolo Rosso, Universidad Politécnica De Valencia, Spain Perla Velasco, Centre for Matematical Research, Mexico Prashant R. Nair, Amrita University, India Raquel Hervas, Universidad Complutense de Madrid, Spain Robert Burduk, Wroclaw University Of Technology, Poland Robert Goodwin, Flinders University, Australia Robert Stahlbock, University Of Hamburg, Germany Rocío Abascal Mena, Universidad Autónoma Metropolitana – Cuajimalpa, Mexico Rui Lopes, Google, Usa

xvii

Runa Jesmin, University Of London, United Kingdom Samad Kolahi, Unitec Institute Of Technology, New Zealand Sattanathan Subramanian, Uni Computing, Norway Scott Overmyer, Nazarbayev University, Kazakhstan Sheila Reinehr, Catholic University Of Paraná, Brazil Sodel Vazquez Reyes, Universidad Autónoma de Zacatecas, Mexico Sotiris Karetsos, Agricultural University Of Athens, Greece Stefan Dietze, The Open University, United Kingdom Stefan Fischer, Universität Zu Lübeck, Germany Stefan Trausan, University Politehnica Of Bucharest, Romania Stuart Cunningham, Glyndwr University, United Kingdom Sung-kook Han, Wonkwang University, Korea, Republic Of Tayana Conte, Federal University Of Rio De Janeiro, Brazil Tharrenos Bratitsis, University Of Western Macedonia, Greece Tomas Foltynek, Mendel University In Brno, Czech Republic Torsten Reiners, Curtin University, Australien Vassilis Kapsalis, Technological Educational Institute of Patras, Greece Vic Grout, Glyndwr University, Wales, United Kingdom Viviana Patti, University of Torino, Italy Yogesh Deshpande, University Of Western Sydney, Australia Yuanbo Guo, Microsoft, USA Zhixian Yan, EPFL, China

xviii

IADIS International Conference WWW/Internet 2012

A SEMANTIC WEB APPROACH FOR AUTOMATED TEST GENERATION Bogdan Drăgulescu, Marian Bucos and Radu Vasiu Faculty of Electronics and Telecommunication, “Politehnica” University of Timisoara - Timisoara, Romania

ABSTRACT In this paper we describe our approach on automatic test generation. In order to validate the test generation process, we organized the questions related to a specific topic to be available for the applications. To do this, we used semantic web technologies to build a small vocabulary, which defines all the information related to the questions in RDF format (question label, question type, correct answer, destructor, relations among questions etc.). The resulted data should be stored in a RDF store. To generate a test from the question bank (in our case a RDF store), patterns for extraction of random unrelated questions are defined. Evaluation of vocabulary and query patterns are done by running the test generation algorithm several times in different scenarios, thus, ensuring that the questions have a normal distribution of usage in tests. This test generation method could be used by tutors, to cut their workload, and by students for selfevaluation. KEYWORDS Test generation, semantic web, test ontology.

1. INTRODUCTION To ensure the correct measurement of academic performance of students, teachers must design evaluation tests as scientifically and professionally as possible. However, careful preparation of test items and evaluation of results is time-consuming and therefore an expensive part of course production. In classical test theory the total test score is made up of multiple items. The raw score obtained by the student is made up of a true component and a random error component. The true score of a person can be found by taking the mean score that the person would get on the same test if they had an infinite number of testing sessions (Anderson et al. 2000). Because this is not possible, test designers have to minimize the error. The method by which a teacher designs test items is related to the context and material for which it is built. The main steps necessary in order to build evaluation tests are (Crocker & Algina 1986): • Identify purpose (test score / self-evaluation); • Establish test specification (number of test items, question type, estimated time for completion, etc.); • Build up initial test items base; • Review test items; • Preliminary item tryouts; • Check test items on large sample of examinee population; • Determine statistical properties of item scores and test improvement; • Release proof of reliability and validity of the final test; • Develop guidelines for administration, scoring and interpretation of test scores. The quality of the test items can be easily assessed by the teacher. He can build highly focused and detailed test items based on course or learning units. Knowing what material is presented to the students, the teacher may identify witch test items should be familiar and which imply a deeper understanding of the course (Mislevy & Braun 2003). This makes the teacher the perfect candidate for test item creation.

235

ISBN: 978-989-8533-09-8 © 2012 IADIS

From the steps listed above we can presume that generation of tests will consume large amounts of the teacher’s time. Although we cannot intervene in the test items design, we can ensure that the review process, items testing, test generation, test evaluation are done in an automated system. The same automated system can be used by students to self-evaluate their knowledge in a particular course or subject of a course, without teacher’s intervention. Students can receive feedback from the system that analyses their responses, and highlights the gaps in their knowledge. Another factor that motivated us in designing an automatic test generation system was to improve the grade distribution. Figure 1 shows the grade distribution for Object-Oriented Programming and Database Systems courses at our University, from 2009 to 2011. These courses have a distributed evaluation, which implies a test for each half-semester. Graph one and two show the grade distribution for Database Systems in first (ED1) and second (ED2) evaluations, while graph three and four show the grade distribution for ObjectOriented Programming in first (ED1) and second (ED2) evaluations. On each graph the grade curves for course evaluation (ED) and re-evaluation (RED) between 2009 and 2011 are shown. We can observe that some of the grade curves do not even resemble the bell curve and they are very different from one evaluation to another.

Figure 1. Grade distribution for Database Systems (1. and 2.) and Object-Oriented Programming courses (3. and 4.) 2009 – 2011

These tests were generated manually by the teacher, by picking 18 to 24 unrelated test items from a pool of questions based on his experience. The questions may be multiple answers, true–false or a short answer question. The purpose of our research is to build a system that will reduce the workload of the teacher by supplying a mean for automated test construction, evaluating test difficulty, generating statistics and at the same time sharing some of the data between agents or applications. To accomplish this matter, we can use semantic web technologies that enable storing of information for application consumption, data is defined and organized to form rich expressions, integration and sharing is simplified, enabled inference, and allow meaningful information extraction while the information remains distributed (Hebeler et al. 2009). An approach of semantic web in test generation is presented in papers (Soldatova & R. Mizoguchi 2003)(Dicheva et al. 2009), where an ontology is proposed that formalizes the key terms in test development and defines the functionality and components of test generation systems. Another example is the use of Linked Open Data (LOD) to semi-automatically generate learning artifacts described in the paper (Rey et al. 2012). In our case, the tests are designed by the teacher, based on knowledge taught. LOD cannot be used to evaluate students because the questions answers have to be in the course material. In order to build the system, first of all we need to have a mean of storing the test items in a manner that can allow agents or applications to access and interact with the data. The question pool can be converted to

236

IADIS International Conference WWW/Internet 2012

RDF and inserted in a triple store. To introduce concepts, relationships and constraints for the test items, we defined a small ontology. After conversion and storing of the question pool in RDF format, a prototype of test generation is presented.

2. TEST ONTOLOGY To design the small ontology needed to formalize concepts, relationship and constraints, we had to identify the type of test items. When evaluating the question pools for Object-Oriented Programming and Database Systems courses, we observed the following types of test items: • Multiple choice, where the student has to select all correct answer from the given amount; • True-false, similar to multiple choice with only two possible answers and one correct; • Short answer, where the student will have to give a short answer. Besides the above presented cases tests, the students can have a multiple choice question, where the logic of the answer is to select one correct answer. A ranking question may be used in some evaluation scenarios, where the student has to compare different items to one another. On the topic of organizing the question we have the following constraints: • Questions belong with a specific section of the course that may be related to other questions on the same topic; • Sections belong with a specific course.

Figure 2. Quiz Ontology Graph (fragment)

With the above constraints in mind, we designed the ontology presented in figure 2. We used RDFS (RDF Schema) to describe the classes and properties. To reduce the number of triples necessary to describe a question, we used the following properties rdfs:subClassOf, rdfs:domain, rdfs:range. By using these properties some of the information can be inferred (Allemang & Hendler 2008). A test item is an instance of one of the following classes MultipleAnswer, TrueFalse, TextAnswer, and Rank. These classes represent the type of questions available in a test and they are subclasses of Questions

237

ISBN: 978-989-8533-09-8 © 2012 IADIS

class. This way, if a test item is an instance of MultipleAnswer class in an inference capable store (ex: Sesame’s native RDFS store), it’s inferred that the test item is also an instance of Questions class. To organize test items, two classes are used: CourseSection and Course. The sectionOfCourse property associates a section with a specific course. This way, we can limit the selection of questions to a specific subject and/or to a specific course. The wrongAnswer and corectAnswer properties are used to define the answers for multiple choice and true-false questions. To limit the maximum number of words for short answer questions, the numberOfWords property is used. When a question is inserted for the first time in the RDF store, a difficulty level is assigned by the teacher using the difficultyLevel property. Further, our test generation software uses this information to keep the overall difficulty of the test in a specific interval. The difficulty level of a question could be changed by evaluating the results produced by students on that specific question. To make sure that the questions pulled out from the store are not addressing the same topic, we have to declare all the related questions. This is done by using the relatedQuestion property binding all related questions to a blank node. We defined a minimalist vocabulary that could be easily extended to include other concepts and dependencies. For now, we consider that the presented ones will suffice for the completion of the task.

3. TEST GENERATION In order to generate tests, first we need to select the test specifications: number of questions and the question type distribution, from which sections and courses to select the test items, and the overall test difficulty level. Each type of question can occur in a set interval or a fixed number of times, and the sum of all test items has to be a given number, specified by the tutor. The tutor has to choose if test items are needed for distributed evaluation, specific subject evaluation or self-evaluation. To select the test items and to extract all the needed information we built a SPARQL query that satisfies the formula below. The meaning of the parameters is: the type of question that we want to select (t), a list of identifiers for the test items already selected (R) and a list of course section to which the test item belongs. Test item is selected randomly and has to be of specified type (t), non-related with already selected items (R) and to be from a selected section (S). The selection process is repeated for each type of question by the number specified by the tutor (fixed number or number within interval).

Where: t – type of question R – denotes the question has already been extracted S – denotes the course section from which the question was extracted q – selected question If the selected question is multiple choice or true-false type we need to select the answers for that item. This process is done by building a SPARQL query that satisfies the formula below. For multiple choice questions the tutor could select a fixed number of choices specified by n parameter. For true-false questions only the correct answer could be selected, true or false, and therefor n equals one.

Where: q – the question for which answers have been selected n – number of answers to be selected When the selection process was closed (all needed test items, questions, and answers have been selected), the test have to be validated for a specific overall difficulty level and made available for external application

238

IADIS International Conference WWW/Internet 2012

that feeds the test to the student (PDF generation module, online test module). For validating a test from the point of overall difficulty, the generated test difficulty level has to be in a specified interval. If this condition was not met, there are two approaches to correct this: drop the test and generate another one, or replace a test item. In the second approach, the replaced test item has to have a low difficulty level if the overall difficulty is under the specified interval and a high difficulty level if the overall difficulty level exceeds it. The new selected test item has to have a greater difficulty level in the first case, and lower in the second one. This process is repeated until the condition is met.

4. EVALUATION To test the ontology and the test generation method, we converted the question pool for Database Systems course in RDF format using the above mentioned classes and properties to define the data. We let the teacher to organize the questions in an excel file for defining the relationships between test items, then an automated conversion process was used to produce the triples in turtle serialization. The pool has 215 questions (164 multiple choice, 21 short answer and 30 true-false), divided into ten sections. The conversion produced 1817 triples (as seen in Figure 3. section 1) of which 430 represent the relationship among questions (as seen in Figure 3. section 2), 215 link a question to a section, and most of the rest represent the answers and labels. The RDF triples were uploaded in a native RDFS Sesame store alongside the ontology to make use of the inference capabilities. Sesame is an open source Java framework that offers the possibility to store and query RDF data, and comes out of the box with RDF Schema inference capable store (Aduna n.d.).

Figure 3. All nodes and edges (1.) and related questions (2.) for the Database Systems question pool

Running a query to count in the store all the triples with inference set to true, will produce 4429 triples. There are six ontology specific classes which have instances not declared in the original RDF data, but inferred: Course class with only one instance because the data are for one course only, CourseSection class with ten instances, Questions class has 215 instances and represent the total number of questions in the pool, MultipleAnswer class has 164 instances and represent the number of multiple choice questions, TrueFalse class has 30 instances and represent the number of true-false questions and TextAnswer class has 21 instances and represent the number of short answer questions. The properties from the test ontology and the number of triples where they are used are: questionBelongsTo, dificultyLevel and relatedQuestion, that appears in 215 triples (the exact number of questions described, because they are specific to every question); wrongAnswer appears in 164 triples and corectAnswer in 194 triples (that describe the answers for the multiple choice questions); numberOfWords appears in 21 triples (the exact number of short answer questions). To confirm the correct generation of tests using the method described in the previous section, we implemented the algorithm in PHP programming language. To complete this task we used the phpSesame library to interact with the Sesame RDF Store (Latchford n.d.). Using this library we generated the statistics

239

ISBN: 978-989-8533-09-8 © 2012 IADIS

presented above and submitted the SPARQL queries that gathered the test items. To make sure that test items are evenly distributed over several tests (this way the random selection of test items are correct), and each test does not contain related items, we set the system to produce 7000 of them to be evaluated. For this we chose to generate 18 question tests with two or three true-false items, one to three short answer items and the rest multiple choice items. The questions were selected from all the ten course sections. In order to produce all tests with the correct amount of question, the system has to validate the parameters set for that test. For example, the maximum number of short answer questions cannot be bigger than the groups of related questions of that type. If this does not satisfy, the system may produce tests with fewer questions. The test items distribution by type, for the 7000 tests generated is presented in figure 4, where tf means true-false test items, sa short answer test items, and mc multiple choice test items. For example, tf 3 represent the number of tests that have three true-false test items. We can see that the short answer and true-false test items number of appearances in tests are almost perfectly divided by the number of possibilities (three for short answer and 2 for true-false). The number of multiple choice test items is obtained by removing the other two types from the given number of questions. We obtained a normal distribution, where tests have higher chances of having 13 or 14 rather the 12 or 15 multiple choice test items.

Figure 4. Test items distribution by type

Figure 5. All test items distribution (1.) and multiple choice test items distribution (2.)

Every question appears in 500 to 700 tests, with some exceptions. The number of occurrences of a question in tests is shown in figure 5 by the blue line, correlated with the number of related questions represented by the red line. In figure 5 section 1, constructed using data for all test items, we can see that the number of choices drops when the number of related questions rises. However, we can see some peaks. The

240

IADIS International Conference WWW/Internet 2012

motive for this is a relatively low number of true-false (30) and short answer (21) questions, and thus, raising the probability of selection. This is observed in figure 5 section 2; data shown is only for multiple answer questions, where most of the peaks are gone. Those that remain are for multiple answer questions that are related only with true-false or short answer questions. In sum, the distribution of selected test items from the question pool guarantees that every test item is used and the number of occurrences slightly varies in large amounts of tests. Furthermore, we evaluated each test to make sure that there are no duplicate or related questions, and in the 7000 tests generated we did not find one.

5. CONCLUSIONS AND FURTHER WORK In this paper we described a system of storing question pools and generating tests using semantic web technologies. We used a minimalist vocabulary that could be easily extended to include other concepts needed for different testing scenarios. We converted the question pool for our Database Systems course in RDF format. Also, we inserted all the questions in a Sesame store and we built a test generation method. By generating 7000 tests, we validated that the ontology and extraction method produce well-formed tests. Our system can be used by teachers to minimize the amount of time needed to produce tests and by the students in self-evaluation scenarios. To ensure the fairness of the evaluation an overall test difficulty can be calculated and verified that it is in a specified range for that exam. To check if this method improves the grade distribution, the generated tests could be formatted for online or print evaluation. We implemented a print module that generates tests in PDF format, and use it in one exam. In order to correctly asses if the grade distribution could be improved we have to gather more data. We also want to integrate this method in our University e-learning platform, based on Moodle. This is a two-step process: first, to convert question pool from Moodle blocks, Questionnaire and Feedback, by using a relational database mapping tool (D2R platform (Bizer n.d.)); second, to build a Moodle block that generates tests from RDF store, and lets the user to interact with the data. One of the advantages of using semantic web technologies is the possibility to easily share the stored RDF data with multiple agents. Another direction to explore is the use of Linked Data in improving quality of generated tests.

REFERENCES Aduna, Sesame framework. Available at: http://www.openrdf.org/. Allemang, D. & Hendler, J., 2008. Semantic Web for the Working Ontologist: Effective Modeling in RDFS and OWL 1st ed., Morgan Kaufmann. Anderson, L.W. et al., 2000. A Taxonomy for Learning, Teaching, and Assessing: A Revision of Bloom’s Taxonomy of Educational Objectives, Abridged Edition, Allyn & Bacon. Bizer, C., D2RQ platform. Available at: http://d2rq.org/. Crocker, L. & Algina, J., 1986. Introduction to classical and modern test theory., Holt, Rinehart and Winston, 6277 Sea Harbor Drive, Orlando, FL 32887. Available at: http://eric.ed.gov/ERICWebPortal/recordDetail?accno=ED312281 [Accessed July 3, 2012]. Dicheva, D., Mizoguchi, Riichiro & Greer, J.E., 2009. Semantic Web Technologies for E-Learning, IOS Press. Hebeler, J. et al., 2009. Semantic Web Programming 1st ed., Wiley. Latchford, A., phpSesame. Available at: https://github.com/alexlatchford/phpSesame. Mislevy, R.J. & Braun, H.I., 2003. Intuitive test theory. In Annual Dinner Meeting of the Princeton Association for Computing Machinery (ACM) and Institute of Electrical and Electronics Engineers (IEEE) Computer Society Chapters, Kingston, NJ, May. Available at: http://www.education.umd.edu/EDMS/mislevy/papers/ITT09.pdf [Accessed June 26, 2012]. Rey, G.Á. et al., 2012. Semi-Automatic Generation of Quizzes and Learning Artifacts from Linked Data. Proceedings of the 2nd International Workshop on Learning and Education with the Web of Data (LiLe2012). Soldatova, L. & Mizoguchi, R., 2003. Ontology of test. Proc. Computers and Advanced Technology in Education, pp.173–180.

241

AUTHOR INDEX Alguliev, R. .................................................... 483 Ali, A. ............................................................ 447 Almeida, L. ....................................................... 60 Ambròsio, A. ...................................................... 3 Amitan, I. ....................................................... 523 Amorim, E. ....................................................... 11 Andrade, A. .................................................... 415 Antunes, D. .................................................... 250 Arai, A. .......................................................... 533 Araujo, R. ....................................................... 355 Baldochi Jr., L. ............................................... 307 Baranauskas, M. ....................................... 60, 379 Barbosa, J. .............................................. 109, 180 Barnett, R. .............................................. 157, 436 Barros, R................................................. 363, 458 Barros, V. ...................................................... 363 Battagello, A................................................... 477 Bazán, P. ........................................................ 339 Berkenbrock, C. ............................................. 290 Bezerra, J. ...................................................... 477 Bieliková, M. .................................................. 117 Bihler, P. ......................................................... 388 Bonacin, R. .................................................... 379 Boselli, R. ......................................................... 93 Bruscato, U. .................................................... 109 Bry, F. .................................................... 257, 473 Bucos, M. ....................................................... 235 Bures, M. ....................................................... 507 Cabral, L. ........................................................ 409 Caixinha, A............................................. 499, 529 Calero, C........................................................... 68 Caro, A. ............................................................ 68 Carrera, D. ..................................................... 133 Carvalho, C. ....................................................... 3 Catenazzi, N. .................................................. 487 Cazarotto, P. .................................................. 180 Ceccato, J. ...................................................... 195 Cervi, C. ........................................................ 347 Cesarini, M. ..................................................... 93 Chapko, A......................................................... 43 Chen, S. ......................................................... 425 Chen, Z. ......................................................... 331 Ciarlini, A. ..................................................... 219 Clifford, D. ..................................................... 203 Côgo, F. ........................................................... 76

Connolly, L. .................................................. 516 Correia, J. ....................................................... 492 Costa, C. ......................................... 109, 180, 415 Costa, F. ............................................................ 3 Costa, H.......................................................... 109 Cowley, C. ..................................................... 157 Cristea, A. ..................................................... 242 Diaz, J. ........................................................... 339 Díez, A. ......................................................... 526 Domenighetti, I. ............................................. 487 Don, A. ........................................................... 195 Dorneles, C. ..................................................... 27 Drăgulescu, B. ................................................ 235 Emanoel, J. ....................................................... 85 Emrich, A. ....................................................... 43 Estevez, E. ...................................................... 339 Everett, J. ...................................................... 453 Faragó, A. ...................................................... 331 Favaro, L. ....................................................... 409 Fayzrakhmanov, R. ......................................... 19 Fensli, R. ....................................................... 165 Fernandes, M.......................................... 499, 529 Fernandes, S. .................................................. 250 Fialho, F. ........................................................ 363 Filipsky, M. ................................................... 507 Foltynek, T. .................................................... 399 Freitas, F. ......................................................... 85 Fukuta, N. ...................................................... 420 Galante, R. ..................................................... 347 García, L. ...................................................... 250 Gasparini, I. ................................................... 290 Giandini, R. ................................................... 339 Gimenes, I. ..................................................... 537 Gräßle, M. ........................................................ 43 Guimarães, C. ................................................ 250 Guo, D. ........................................................... 266 Handayani, P. ................................................ 211 Hawryszkiewwycz, I. ..................................... 447 Hidayanto, A. ................................................. 211 Hirata, C. ....................................................... 477 Hirota, M. ....................................................... 420 Hornung, H. .................................................. 379 Huang, H. ...................................................... 468 Hussenoeder, F. .............................................. 431 Isaias, P. ........................................................... 51

Ishikawa, H..................................................... 420 Issa, T. .............................................................. 51 Jelinek, I. ........................................................ 507 Jeon, J. ............................................................ 141 Jost, T. ........................................................... 415 Kamura, K. ..................................................... 468 Kanovsky, I. ................................................... 442 Kawagoe, K. ................................................... 468 Kemczinski, A. .............................................. 290 Kimura, M. .................................................... 290 Kneissl, F. ....................................................... 473 Kolomaznik, J. ............................................... 399 Kompan, M..................................................... 117 Kowata, E. ....................................................... 35 Kritzenberger, H. ............................................ 503 Krnjic, V. ........................................................ 227 Kurita, R. ....................................................... 533 Kusano, M. .................................................... 533 Kwon, M. ....................................................... 141 Lang, M. ................................................. 203, 516 Lee, S. ............................................................ 511 Lima, R. ........................................................... 85 Lima, R. ......................................................... 409 Lins, R. ........................................................... 315 Lins, R. ........................................................... 409 Liu, X. ............................................................ 266 Loeb, L. ......................................................... 511 Loos, P.............................................................. 43 Loose, M......................................................... 125 Lübke, R. ........................................................ 323 Lungwitz, R. .................................................. 323 Macgregor, G. ................................................ 453 Mactavish, M. ................................................ 188 Maglajlic, S. ................................................... 463 Malucelli, A. ................................................... 101 Mantau, M. ..................................................... 290 Marinho, L. .................................................... 273 Martin, L......................................................... 298 Martins, J. .............................................. 499, 529 Mello, R. ................................................... 27, 409 Menolli, A. .................................................... 101 Mercorio, F. ...................................................... 93 Meserlian, K. ................................................. 363 Mezzanzanica, M.............................................. 93 Mironova, O. ................................................. 523 Miyadera, Y. .................................................. 533 Mohamed, R. .................................................. 453 Moraga, C. ....................................................... 68

Moraga, M. ...................................................... 68 Nakamura, S. ................................................. 533 Nam, G. .......................................................... 141 Nguyen, T. .................................................... 165 Nunes, M. ...................................................... 492 Ogawa, F. ...................................................... 363 Oinas-Kukkonen, H. ...................................... 281 Oliveira, C. ..................................................... 404 Oliveira, H...................................................... 404 Oliveira, H. ...................................................... 85 Oliveira, R. ......................................................... 3 Oliveira, J. ...................................................... 347 Pacheco, E. .................................................... 458 Pereira, R. ................................................ 76, 379 Peres, L. ......................................................... 250 Perez, G. ........................................................ 339 Pires, C. .......................................................... 273 Pizzoleto, A. .................................................. 404 Qudah, D. ....................................................... 242 Rasta, K. ........................................................ 165 Recuero, R. .................................................... 355 Rêgo, A. ........................................................ 273 Reichert, F. ..................................................... 165 Reinehr, S. ...................................................... 101 Reis, J. ............................................................ 379 Respício, A. .................................................... 371 Righi, R. ................................................. 180, 415 Rigo, S............................................................ 109 Rocha, J. ................................................ 499, 529 Rofalina, F. .................................................... 211 Romo, R. .......................................................... 68 Rouviere, S. .................................................... 436 Saccol, D. ....................................................... 125 San-Martín, S. ................................................ 173 Santos, B. ...................................................... 371 Santos, L. ....................................................... 315 Santos, L. ........................................................ 27 Schill, A. ........................................................ 323 Schuster, D. ................................................... 323 Ševcech, J. ...................................................... 117 Shah, P. ......................................................... 257 Sharifov, M. ................................................... 483 Shi, L. ............................................................. 242 Silva Jr., J. ...................................................... 315 Silva, E. ......................................................... 109 Silva, G. ................................................. 409, 537 Silva, J. ............................................................ 35 Silva, S. ........................................................... 76

Silveira Jr., L. ................................................. 109 Simske, S. ...................................................... 409 Siqueira, S. ..................................................... 219 Skalska, H. ..................................................... 483 Sommaruga, L. .............................................. 487 Stibe, A. .......................................................... 281 Sun, H. ........................................................... 266 Sun, J. ............................................................. 425 Tapiador, A............................................. 133, 526 Teixeira, C. ..................................................... 371 Trinugroho, Y. ............................................... 165 Valfre, G. ........................................................ 219 Vasconcelos, L. ............................................. 307 Vasiu, R. ......................................................... 235 Veale, L. ......................................................... 188 Vesely, O. ...................................................... 399 Vilipõld, J. ...................................................... 523 Vincenzi, A....................................................... 35 Werth, D. ......................................................... 43 Wieser, C. ....................................................... 257 Xia, Y. ............................................................ 425 Yaari, O. ......................................................... 442 Yang, H. ......................................................... 141 Yokoyama, S. ........................................ 420, 533 Yoo, B. ........................................................... 149 Yusifov, F. ..................................................... 483 Zefferer, T. .................................................... 227 Zhang, R. ....................................................... 266