cs.CLMar 22, 2026

Reading Between the Lines: How Electronic Nonverbal Cues shape Emotion Decoding

Authors: Taara Kumar, Kokil Jaidka

Organizations: Department of Communications and New Media, National University of Singapore, Singapore · Centre for Trusted Internet and Community, National University of Singapore, Singapore

Abstract

As text-based computer-mediated communication (CMC) increasingly structures everyday interaction, a central question re-emerges with new urgency: How do users reconstruct nonverbal expression in environments where embodied cues are absent? This paper provides a systematic, theory-driven account of electronic nonverbal cues (eNVCs) - textual analogues of kinesics, vocalics, and paralinguistics - in public microblog communication. Across three complementary studies, we advance conceptual, empirical, and methodological contributions. Study 1 develops a unified taxonomy of eNVCs grounded in foundational nonverbal communication theory and introduces a scalable Python toolkit for their automated detection. Study 2, a within-subject survey experiment, offers controlled causal evidence that eNVCs substantially improve emotional decoding accuracy and lower perceived ambiguity, while also identifying boundary conditions, such as sarcasm, under which these benefits weaken or disappear. Study 3, through focus group discussions, reveals the interpretive strategies users employ when reasoning about digital prosody, including drawing meaning from the absence of expected cues and defaulting toward negative interpretations in ambiguous contexts. Together, these studies establish eNVCs as a coherent and measurable class of digital behaviors, refine theoretical accounts of cue richness and interpretive effort, and provide practical tools for affective computing, user modeling, and emotion-aware interface design. The eNVC detection toolkit is available as a Python and R package at https://github.com/kokiljaidka/envc.

Explore similar work

CardsList
  1. NICE Toolbox: Nonverbal Interpersonal Communication Exploration Toolbox

    Oct 15, 2026Aleksandr Evgrashin, Carolin Schmitt, Timo Lübbing +8

  2. Affect Decoding in Phonated and Silent Speech Production from Surface EMG

    Mar 12, 2026Simon Pistrosch, Kleanthis Avramidis, Zhao Ren +7Surface ElectromyographySpeech Emotion Recognition

  3. Machine learning and digital pragmatics: Which word category influences emoji use most?

    Aug 22, 2026Mohammed Q. Shormani, Lamia Alhassoun, Yehia A. AlSohbani