Overview

Sign language translation turns continuous video of signing into text, requiring models to capture hand motion, facial expression, timing, and sign-language grammar. Systems may predict intermediate glosses or translate directly from video or pose, using methods such as CTC pretraining, temporal alignment, multimodal fusion, and language-model decoding. Researchers evaluate translation on benchmarks such as PHOENIX14T, CSL-Daily, How2Sign, and OpenASL, while also exploring low-resource languages and real-time streaming. A key tension is that standard text-overlap scores can miss meaning errors, and results may be inflated by signer overlap or inconsistent evaluation; reliable progress also depends on broader data and community-informed testing.

Latest papers

CardsList

55 papers5 papers in the last four weeks, down 29% on the four weeks before. 0.0% of all new papers.

  1. CausalGloss: Multi-Evidence Action Control for a Simultaneous Mandarin Speech-to-ASL Gloss Cascade

    Nov 14, 2026Mingze Li, Satoshi NakamuraSign Language TranslationSimultaneous Speech Translation

  2. SemRAG: Semantic-Guided Sentence-Level Retrieval-Augmented Sign Language Production

    Nov 13, 2026Xiao Liu, Shiwei Gan, Yafeng Yin +5Sign Language GenerationMultimodal RAG

  3. IsharaBART: An efficient BART-Based Framework for Low-Resource Bangla Sign Language Translation

    Nov 12, 2026Aonmoy Das, Ananna Dev Aishi, Md. Fazlul KaderSign Language TranslationLow-Resource Language Processing

  4. Maswao: An automatically collected, prepared, and benchmarked dataset for South African Sign Language

    Nov 2, 2026Thapelo Sindane, Unarine Netshifhefhe, Vukosi Marivate +3Sign Language DatasetsSign Language Translation

  5. Isharah-Selfie: Continuous Sign Language Recognition Dataset for One-handed Signing

    Oct 23, 2026Ahmed Abul Hasanaath, Murtadha Aljubran, Sarah Alyami +2Sign Language DatasetsSign Language Recognition

  6. SignRAG: Unified Retrieval-Augmented Gloss-Free Sign Language Translation

    Oct 8, 2026Zhi Rao, Yucheng Zhou, Qianran Sun +8Sign Language TranslationRetrieval-Augmented Generation

  7. Not What a Child Expressed: Auditing the Sign-to-Text Safety Interface in Child-Facing AI

    Oct 5, 2026Muhammad Rafiullah Memon, Viet Vo, Wanlun Ma +1Sign Language TranslationAI Safety Evaluation

  8. ReSCUE: Re-translation with Sentence Commitment for Unsegmented Long-Form Simultaneous Sign Language Translation

    Oct 2, 2026Sihan Ren, Gaozheng Li, Yuanshang Quan +5Sign Language TranslationMachine Translation

  9. Machine Translation for Sign Languages

    Oct 1, 2026Ozge Mercanoglu Sincan, Anton Pelykh, Edward Fish +7Sign Language TranslationSign Language Recognition

  10. Simultaneous Translation between Sign Languages

    Sep 28, 2026Zetian Wu, Bowen Xie, Stefan Lee +1Sign Language Translation

  11. SignFLIP: A Unified Model for Sign Language Translation and Generation via Stage-wise Alignment at Scale

    Sep 28, 2026Zhaoyi An, Sihan Tan, Youngbae Hwang +2Sign Language TranslationRepresentation Alignment

  12. OneSign: Unifying Sign Language Understanding Tasks with One Model

    Sep 27, 2026Shiwei Gan, Yafeng Yin, Xiao Liu +3Sign Language RecognitionUnified Multimodal Models

  13. SignGPT: Toward LLM-Mediated Sign Language Interaction through Gloss-Free Translation and Generation

    Sep 18, 2026Ronghui Li, Jun Dong, Zhongyuan Hu +8Sign Language TranslationSign Language Generation

  14. Investigating Temporal Motion Features for Pose-to-Text Indian Sign Language Translation

    Sep 11, 2026Manav Dhamecha, Praveen Kumar Chandaliya, Pruthwik MishraSign Language TranslationTransformer

  15. Rethinking Sign Language Translation: The Impact of Signer Dependence on Model Evaluation

    Sep 7, 2026Keren Artiaga, Sabyasachi Kamila, Haithem Afli +2Sign Language TranslationSign Language Datasets

  16. Beyond BLEU: A Case for Redefining Sign Language Translation Benchmarks

    Sep 3, 2026Oline Ranum, Edward Fish, Simon Hadfield +1Sign Language TranslationMT Evaluation

  17. ODE-Based Transformer Decoders for Iterative Sign Language Translation

    Aug 11, 2026Tuğçe Kızıltepe, Hacer Yalim KelesSign Language TranslationIterative Refinement

  18. Bridging the Gap Between Semantics and Reconstruction:Unifying Sign Language Translation and Production

    Aug 10, 2026Xiao Liu, Shiwei Gan, Yafeng Yin +5Sign Language TranslationRepresentation Learning

  19. SignLlama: Enhancing Gloss-free Sign Language Translation by Prioritizing Visual Features for LLMs

    Aug 10, 2026Shiwei Gan, Xiao Liu, Yafeng Yin +5Sign Language TranslationVLM Adaptation

  20. Attention-Steered Vision-Language Models for Sign Language Translation

    Jul 31, 2026Meibo Hu, Guohao Sun, Annemarie D. Ross +2Sign Language TranslationVision-Language Models

  21. DualAnchor: Preserving Language Priors and Improving Lexical Fidelity in Gloss-Free Sign Language Translation

    Jul 30, 2026Hongbin Zhang, Junhao Liu, Xuefeng Bai +3Sign Language TranslationVision-Language Alignment

  22. Q-BridgeNet: A Quantization Network for Cross-Lingual Sign Language Translation

    Jul 13, 2026Liqian Feng, Lintao Wang, Xiaochen Liu +5Sign Language TranslationCross-Lingual Transfer

  23. Toward Real-Time Sentence-Level Sign Language Translation

    Jul 10, 2026Thanh-Hoang Nguyen DoanSign Language TranslationStreaming Inference

  24. VTaMo: Video-Text Alignment Model for Sign Language Translation

    Jul 10, 2026Junyi Hu, Zhewen He, Haomian Huang +2Sign Language TranslationCross-Modal Alignment

  25. ViPo-MLLM: Visual-Pose Multimodal LLM for Gloss-Free Sign Language Translation

    Jul 4, 2026Ahmed Abul Hasanaath, Bicheng Xu, Mir Rayat Imtiaz Hossain +2Sign Language TranslationMultimodal Large Language Models

  26. BackTranslation2.0 -- A Linguistically Motivated Metric to Assess Sign Language Production

    Jun 27, 2026Oliver Cory, Maksym Ivashechkin, Karahan Sahin +6Sign Language TranslationAutomated Evaluation

  27. SIGNET: Motion-Level Knowledge Transfer for Cross-Language Sign Language Translation

    Jun 26, 2026Sobhan Asasi, Ozge Mercanoglu Sincan, Richard BowdenSign Language TranslationCross-Lingual Transfer

  28. SignNet-1M: Large-Scale Multilingual Sign Language Video Dataset with Downstream Benchmarks

    Jun 23, 2026Zhewen He, Junyi Hu, Haomian Huang +3Distribution Shift RobustnessSynthetic Data Augmentation

  29. Deep Learning-Based Sign Language Recognition from Videos and Cross-Lingual Translation to Indian Vernaculars

    Jun 21, 2026Ramesh Nandipalli, Chandranath AdakSign Language TranslationSign Language Recognition