May 5, 2017 - Use of Web-/mobile solutions for sign language assessment. ⢠Sign language test portal. ⢠Survey results on Web-/mobile-based testing. ⢠Automatic sign language ... Development - Results of an International Surey. Deafness ...
ALTE International Conference 3-5 May 2017, Bologna Panel Insights from research on sign language tests Web-based sign language assessment: Challenges and innovations Tobias Haug, HfH Zurich
Overview • Current situation of sign language learning and assessment • Use of Web-/mobile solutions for sign language assessment • Sign language test portal • Survey results on Web-/mobile-based testing • Automatic sign language recognition and generation • Collaborations
3.-5.5.2017
ALTE Conference
2
Current situation • Implementation of CEFRaligned curricular, e.g., • France, Ireland, The Netherlands, Germany... • Europen projects, like ECML-project ProSign 1, ProSign 2 • Lack of sign language assessment instruments (www.ecml.at)
3.-5.5.2017
ALTE Conference
3
Use of Web-/mobile solutions for sign language assessment
! (www.signlang-assessment.info) 3.-5.5.2017
ALTE Conference
4
Sign language test portal
• Developed by Sign Language Assessment Services • Preliminary version used in EU project SignMET (2014-15)
(www.signmet.eu)
3.-5.5.2017
ALTE Conference
5
[Portal]
Key features of portal • Different user profiles (e.g., institution, test developer, test taker etc.) • Different item types and response formats (incl. online video recording!) • Create different online scoring instruments (e.g., holistic, analytic) and score reporting • Create background questionnaire for test takers • Localization into different languages • Responsive design • Runs on any standard browser and different devices • Media library 3.-5.5.2017
ALTE Conference
6
[Portal]
3.-5.5.2017
ALTE Conference
7
[Portal]
3.-5.5.2017
ALTE Conference
8
[Portal]
3.-5.5.2017
ALTE Conference
9
Survey results: Advantages and disadvantages Advantages
Disadvantages
Accessibility, easy set up
Lack of IT support, firewall, no highspeed Internet connection
Automatic scoring of receptive sign language tests
Internet security
Interactive in nature
Technical glitches
More time effective (e.g., entering demographic data)
Data protection issues (e.g., new EU data protection law, 2018) with online stored data
Implementing current Internet security technologies (e.g., SSL) More motivating for young test takers
3.-5.5.2017
ALTE Conference
10
[Survey results]
Survey results: Thinking out of the Box (“wish-list”) • Better technical infrastructure at test sites, e.g., schools • Automatic recognition of signed answers (lexical level) • Data base with data across sign languages > platform for research and discussion among researchers and teachers • Touch-screen technology for comprehension tests (Haug, 2015)
3.-5.5.2017
ALTE Conference
11
Automatic sign language recognition • Swiss National Science Foundation research project SMILE • Scalable multimodal sign language technology for sign language learning and assessment • Automatic sign language recognition and its usage for an automatic vocabulary assessment system 3.-5.5.2017
ALTE Conference
Pose tracking (SMILE project, 2016)
12
Automatic sign language generation
From project „Trainslate“, University of Zurich English translation: Please spread yourselves over the entire platform and move towards the center of the wagon immediatly after boarding. 3.-5.5.2017
ALTE Conference
13
Collaboration with spoken language testing community • This panel • Presentations at ALTE conference 2014, LTRC 2014 • Edited volume on language testing (with Wolfgang Mann, UK and Ute Knoch, Australia), Oxford University Press • Paired-papers on sign language and spoken language testing
3.-5.5.2017
ALTE Conference
14
Reference Haug, T. (2015). Use of Information and Communication Technologies in Sign Language Test Development - Results of an International Surey. Deafness & Education International, 17, 1, 33-48.
3.-5.5.2017
ALTE Conference
15
Links • Project ProSign • www.ecml.at/prosign • Information about sign language test • www.signlang-assessment.info • Sign Language Test Portal • www.signlang-portal.com • Sign Language Assessment Services • www.slas.ch
3.-5.5.2017
ALTE Conference
16
