cs.RONov 18, 2026

Emo-H2A: Driving a Facial Robot Directly from LLM Hidden States at Token Rate

Authors: Yige Liu, Jingcheng Huang, Hao Sun, Min Li, Zhouping Yin

Organizations: Huazhong University of Science and Technology, Wuhan 430074, China.

Abstract

Diverse, semantically synchronized, and low-latency facial expressions are essential for human-robot interaction. While large language models (LLMs) have endowed anthropomorphic robots with fluent speech, facial expression still struggles to follow the conversation. Motivated by this gap, we present Emo-H2A (hidden-to-actuation), a paradigm that drives a facial robot directly from LLM hidden states during autoregressive decoding. Without a separate emotion label, expression stays continuous and context-sensitive, and the face moves with the unfolding reply. We instantiate this paradigm as EmoManifold, a training-free method that extracts a valence-arousal-dominance (VAD) coordinate from each hidden state, projects it, and drives the face at token granularity. The readout is checked on six language models, and the same projection drives our 29-degree-of-freedom (DoF) facial robot. When driven by this projection, the face shifts its expression in the matching direction on 87.5% of within-reply valence transitions, whereas holding a single label for the whole reply leaves directional tracking near the 50% chance level, and first moves in 0.96s rather than waiting 10-26s for the reply to finish and a turn-level label to return.

Figures & tables

Explore similar work

CardsList
  1. EmoPose: Vision-Language Model Guided Emotion-Aware Gesture Generation for Humanoid Robots

    Sep 20, 2026Daojie Peng, Bingtao Wang, Fulong Ma +3Large Language Model-Based Robot PlanningHumanoid Robot Control

  2. EmoteGPT: 3D Human Facial Expressions from Natural Language Descriptions

    Jul 2, 2026Haoran Wang, Mohit Mendiratta, Christian Theobalt +1Text-to-3D GenerationFacial Expression Synthesis