Sign Language
Sign language research focuses on developing technologies to improve communication for deaf and hard-of-hearing individuals, primarily through automated sign language recognition and translation. Current research emphasizes mitigating biases in datasets and models, improving the accuracy and temporal consistency of sign language video generation, and incorporating both manual and non-manual features (facial expressions, body language) for more comprehensive understanding. This work leverages deep learning architectures, including transformers, convolutional neural networks, and recurrent neural networks, often combined with techniques like multi-stream processing and attention mechanisms, to achieve higher accuracy and robustness across diverse sign languages and environments. The ultimate goal is to create accessible and inclusive communication tools, impacting both the scientific understanding of sign languages and the daily lives of sign language users.
Papers
1DCNNTrans: BISINDO Sign Language Interpreters in Improving the Inclusiveness of Public Services
Muchammad Daniyal Kautsar, Ridwan Akmal, Afra Majida Hariono
The NGT200 Dataset: Geometric Multi-View Isolated Sign Recognition
Oline Ranum, David R. Wessels, Gomer Otterspeer, Erik J. Bekkers, Floris Roelofsen, Jari I. Andersen
3D-LEX v1.0: 3D Lexicons for American Sign Language and Sign Language of the Netherlands
Oline Ranum, Gomer Otterspeer, Jari I. Andersen, Robert G. Belleman, Floris Roelofsen
Empowering Sign Language Communication: Integrating Sentiment and Semantics for Facial Expression Synthesis
Rafael Azevedo, Thiago Coutinho, João Ferreira, Thiago Gomes, Erickson Nascimento
From Rule-Based Models to Deep Learning Transformers Architectures for Natural Language Processing and Sign Language Translation Systems: Survey, Taxonomy and Performance Evaluation
Nada Shahin, Leila Ismail
An Efficient Sign Language Translation Using Spatial Configuration and Motion Dynamics with LLMs
Eui Jun Hwang, Sukmin Cho, Junmyeong Lee, Jong C. Park
BAUST Lipi: A BdSL Dataset with Deep Learning Based Bangla Sign Language Recognition
Md Hadiuzzaman, Mohammed Sowket Ali, Tamanna Sultana, Abdur Raj Shafi, Abu Saleh Musa Miah, Jungpil Shin
Event Stream based Sign Language Translation: A High-Definition Benchmark Dataset and A New Algorithm
Xiao Wang, Yao Rong, Fuling Wang, Jianing Li, Lin Zhu, Bo Jiang, Yaowei Wang