SMILE II: Automated sign language recognition at sentence level
Category Project
Ausgangslage und Ziele
The project builds on the groundwork of the SNSF Sinergia project SMILE I, in which an automated assessment system of manual components for DSGS at word level was developed. SMILE II extends this technology to sign language recognition and assessment of DSGS at sentence level production, including both manual and non-manual components.
Project Management
Facts
-
Duration01.202112.2024
-
Project number
4_45
Project Team
- Katja Tissi
- Sandra Sidler-Miserez
- Franz Holzknecht
Cooperations
Financial support
Publications
- Using automatic sign language recognition for sentence-level assessment ofSwiss German Sign Language - SMILE-II[Konferenzvortrag].Language Testing Research Colloquium 2020,online.
- Modalitätsspezifische Aspekte von Gebärdensprachen: Lernen, Testen und Ressourcen.Ringvorlesung Universität Bern, Institut für Allgemeine Sprachwissenschaften,Bern, Schweiz.
- KI-gesteuerte Überprüfung von Gebärdensprachkompetenz.Bürgenstock-Konferenz der Schweizer Fachhochschulen und Pädagogischen Hochschulen,Luzern, Schweiz.
- Web SMILE demo: a web application providing automated feedback on sign language vocabulary production[Konferenzvortrag].44th Language Testing and Research Colloquium: Language Assessment for a Global, Digital, and More Equitable Era,New York City, USA.
- (2024).Automated Sign Language Vocabulary Assessment: Comparing Human and Machine Ratings and Studying Learner Perceptions.Language Assessment Quarterly.
- Reforming sign language assessment: Setting up a longitudinal learner corpus of rated elicited imitation performances to develop an AI-driven sign language assessment system[Konferenzvortrag].Language Testing Research Colloquium (LTRC) 2024,Innsbruck.
- (2024).Modelling the Distribution of Human Motion for Sign Language Assessment.In ECCV 2024 (Hrsg.),Twelfth International Workshop on Assistive Computer Vision and Robotics at ECCV 2024,
- (2024).Sign language assessment: Common misconceptions and the need for language assessment literacy development.In B. Baker, & L. Taylor (Hrsg.),Language Assessment Literacy and Competence Volume 1: Research and Reflections from the Field(S. 195–203).Cambridge University Press.
- (2024).The Impact of COVID-19 on Sign Language Assessment.Language Education & Assessment,7(1),1–18.