Overview

Sign language generation studies how to turn text, glosses, or other signals into signed motion and video, including the hands, face, and body cues that carry meaning. Common approaches use diffusion models, autoregressive motion-token models, flow matching, or retrieval and refinement, with gloss timing and phonological features providing structure and control. Systems are evaluated on datasets such as PHOENIX14T, CSL-Daily, and How2Sign using measures of motion quality, linguistic accuracy, and back-translation. A central challenge is ensuring that visually plausible movement faithfully expresses the intended signs, especially when paired data is scarce and standard metrics may miss errors in meaning or articulation.

Latest papers

CardsList

39 papers4 papers in the last four weeks, down 50% on the four weeks before. 0.0% of all new papers.

  1. SIGNTOK: A Text-Aligned Continuous Pose Tokenizer for Sign Language Generation

    Nov 18, 2026Nabeela Khan, Gaurav Rai, Bowen Wu +4Sign Language GenerationCross-Modal Alignment

  2. SemRAG: Semantic-Guided Sentence-Level Retrieval-Augmented Sign Language Production

    Nov 13, 2026Xiao Liu, Shiwei Gan, Yafeng Yin +5Sign Language GenerationMultimodal RAG

  3. MySign: A High-Fidelity Motion-Capture Dataset for 3D Sign Generation in Bahasa Isyarat Malaysia

    Nov 8, 2026Jiayu Shen, Kalin Stefanov, Lay-Ki Soon +3Sign Language DatasetsSign Language Generation

  4. MV-Sign: Multi-View 3D Motion Integration and Enhanced Text-to-Motion Conditioning for Sign Language Production

    Nov 5, 2026Singyu Muk, Kaustubh Kundu, Kunyuan Xie +2Sign Language GenerationHuman Motion Generation

  5. Semantic Residual Vector Quantization for Sign Language Generation

    Nov 4, 2026Chang Liu, Ke Han, Niccolò Biondi +4Sign Language GenerationHuman Motion Generation

  6. BLANC: Adaptive Temporal Scheduling for Sign Language Production

    Oct 16, 2026Youngmin Kim, Seoyeong Hwang, Sujung Hong +1Sign Language GenerationDiffusion Models for Motion Generation

  7. Machine Translation for Sign Languages

    Oct 1, 2026Ozge Mercanoglu Sincan, Anton Pelykh, Edward Fish +7Sign Language TranslationSign Language Recognition

  8. SignFLIP: A Unified Model for Sign Language Translation and Generation via Stage-wise Alignment at Scale

    Sep 28, 2026Zhaoyi An, Sihan Tan, Youngbae Hwang +2Sign Language TranslationRepresentation Alignment

  9. Traceable Human-to-Humanoid Sign Language Benchmarking

    Sep 27, 2026Ao Liu, Shengeng Tang, Lechao Cheng +3Motion RetargetingSign Language Generation

  10. Naturalness-guided Manifold Flow Matching for Sign Language Production

    Sep 27, 2026Jiayi He, Shengeng Tang, Sisi You +3Flow MatchingHuman Motion Generation

  11. RoboSTAR: Next-Scale Autoregressive Sign Language Translation for Humanoid Robots

    Sep 26, 2026Yujia Zeng, Chensheng Peng, Yuxin Chen +3Finite Scalar QuantizationSign Language Generation

  12. PHOSA: Photorealistic 3D Sign Avatar Modeling and Benchmark

    Sep 24, 2026Haodong Wang, Hezhen Hu, Wengang Zhou +13D Avatar Generation3D Human Reconstruction

  13. SignGPT: Toward LLM-Mediated Sign Language Interaction through Gloss-Free Translation and Generation

    Sep 18, 2026Ronghui Li, Jun Dong, Zhongyuan Hu +8Sign Language TranslationSign Language Generation

  14. SignRefine: Adapting Foundational Video Models for Sign Language Generation

    Sep 8, 2026Anton Pelykh, Edward Fish, Ozge Mercanoglu Sincan +1Video Diffusion ModelsPose-Conditioned Video Generation

  15. SeRV: Semantic-Aligned Residual Vector Quantization for American Sign Language Generation

    Sep 4, 2026Hongyu Wu, Xu Wu, Tianhao Wu +4Sign Language GenerationText-to-Motion Generation

  16. SignRR: Retrieve and Refine Real Motion for Sign Language Production

    Aug 28, 2026Fidel Omar Tito Cruz, Angie Sanchez Marquina, Summy Farfan +1Human Motion GenerationMotion Representation Learning

  17. Bridging the Gap Between Semantics and Reconstruction:Unifying Sign Language Translation and Production

    Aug 10, 2026Xiao Liu, Shiwei Gan, Yafeng Yin +5Sign Language TranslationRepresentation Learning

  18. From Sign Language Generation to Humanoid Execution: Vision-Language Guided Retargeting with Collision Mitigation

    Jul 20, 2026Nabeela Khan, Bowen Wu, Runwu Shi +5Motion RetargetingHumanoid Robotics

  19. A Diffusion-Based Kinematics and Dynamics Model for 3D Sign Language Production

    Jul 16, 2026Emanuele Colonna, Moises Diaz, Gennaro Vessio +2Physics-Informed Diffusion ModelsHuman Motion Generation

  20. BackTranslation2.0 -- A Linguistically Motivated Metric to Assess Sign Language Production

    Jun 27, 2026Oliver Cory, Maksym Ivashechkin, Karahan Sahin +6Sign Language TranslationAutomated Evaluation

  21. The Impact of VAE Design on Latent Pose Representations for Diffusion-based Sign Language Production

    Jun 22, 2026Guilhem Fauré, Mostafa Sadeghi, Sam Bigeard +1Variational AutoencodersRepresentation Learning

  22. Context-Aware Autoregressive Diffusion for Gloss-Wise Sign Language Production

    Jun 19, 2026JungHoon Sung, Boeun Kim, Chu Xin +4Autoregressive DiffusionHuman Motion Generation

  23. Direct Translation between Sign Languages

    May 20, 2026Zetian Wu, Bowen Xie, Wuyang Meng +3Sign Language TranslationBack-Translation

  24. Towards Continuous Sign Language Conversation from Isolated Signs

    May 14, 2026Youngmin Kim, Kyobin Choo, Jiwoo Park +4Sign Language TranslationHuman Motion Generation

  25. KAN Text to Vision? The Exploration of Kolmogorov-Arnold Networks for Multi-Scale Sequence-Based Pose Animation from Sign Language Notation

    May 10, 2026Guanyi Du, Lintao Wang, Kun Hu +1Human Motion GenerationKolmogorov-Arnold Networks