Non Verbal Cue

Non-verbal cues, encompassing gestures, facial expressions, and vocalizations, are increasingly recognized as crucial components of human communication, impacting fields from human-robot interaction to mental health assessment. Current research focuses on developing multimodal models, often incorporating large language models (LLMs) and 3D morphable models (3DMMs), to analyze these cues from various data sources like video recordings and wearable sensors, aiming to predict emotions, engagement, and even mental health states. This work holds significant implications for improving human-computer interaction, enhancing mental health support, and advancing our understanding of social dynamics through more nuanced and comprehensive analyses of human behavior.