Sign Language
Sign language research focuses on developing technologies to improve communication for deaf and hard-of-hearing individuals, primarily through automated sign language recognition and translation. Current research emphasizes mitigating biases in datasets and models, improving the accuracy and temporal consistency of sign language video generation, and incorporating both manual and non-manual features (facial expressions, body language) for more comprehensive understanding. This work leverages deep learning architectures, including transformers, convolutional neural networks, and recurrent neural networks, often combined with techniques like multi-stream processing and attention mechanisms, to achieve higher accuracy and robustness across diverse sign languages and environments. The ultimate goal is to create accessible and inclusive communication tools, impacting both the scientific understanding of sign languages and the daily lives of sign language users.
Papers
Diverse Sign Language Translation
Xin Shen, Lei Shen, Shaozu Yuan, Heming Du, Haiyang Sun, Xin Yu
MM-WLAuslan: Multi-View Multi-Modal Word-Level Australian Sign Language Recognition Dataset
Xin Shen, Heming Du, Hongwei Sheng, Shuyun Wang, Hui Chen, Huiqiang Chen, Zhuojie Wu, Xiaobiao Du, Jiaying Ying, Ruihan Lu, Qingzheng Xu, Xin Yu
1DCNNTrans: BISINDO Sign Language Interpreters in Improving the Inclusiveness of Public Services
Muchammad Daniyal Kautsar, Ridwan Akmal, Afra Majida Hariono
The NGT200 Dataset: Geometric Multi-View Isolated Sign Recognition
Oline Ranum, David R. Wessels, Gomer Otterspeer, Erik J. Bekkers, Floris Roelofsen, Jari I. Andersen
3D-LEX v1.0: 3D Lexicons for American Sign Language and Sign Language of the Netherlands
Oline Ranum, Gomer Otterspeer, Jari I. Andersen, Robert G. Belleman, Floris Roelofsen
Empowering Sign Language Communication: Integrating Sentiment and Semantics for Facial Expression Synthesis
Rafael Azevedo, Thiago Coutinho, João Ferreira, Thiago Gomes, Erickson Nascimento
From Rule-Based Models to Deep Learning Transformers Architectures for Natural Language Processing and Sign Language Translation Systems: Survey, Taxonomy and Performance Evaluation
Nada Shahin, Leila Ismail