REFLECT: Role-Aware Detection of Sentiment, Emotion, Politeness, and Formality
Organizations: University of Florida
Abstract
Detecting communicative meaning in dialogue requires modeling not only lexical content but also the participant-role structures through which sentiment, emotion, politeness, and formality (SEPF) are expressed. Existing approaches rely on contextual language representations while leaving semantic roles implicit. We introduce a role-aware transformer architecture that maps the four SEPF dimensions to theory-grounded Semantic Role Labeling (SRL) configurations, incorporating these configurations directly into the transformer's self-attention mechanism. Role-aware attention models non-directional internal states (sentiment and emotion), while directional role-aware attention captures initiator-to-recipient relations for external cues (politeness and formality). The resulting role-aware representations are fused with contextual embeddings through a learned gate that adaptively weights how much role information each input contributes, rather than appending semantic roles as an auxiliary feature vector. Across four benchmark datasets, the framework yields statistically reliable gains over strong BERT-based baselines for emotion, politeness, and formality, with gains concentrated in theoretically predicted cases such as low-frequency, complex emotions and highly polite expressions; sentiment improvements are marginal and non-significant, suggesting that sentiment is conveyed more through lexical choice than participant-role structure. Additional evaluation on real-world data demonstrates that the framework improves both predictive performance and model traceability. These results demonstrate that linguistically grounded modifications to transformer self-attention improve the detection of communicative meaning, generalize beyond benchmark datasets to real-world mental-health data, and yield traceable, role-grounded explanations that extend beyond predictive performance to interpretability.
Figures & tables
| Model | Sentiment | Emotion | Politeness | Formality |
|---|---|---|---|---|
| Macro- | Macro- | Pearson’s | ||
| Baseline Models | ||||
| BERT (linear) | 0.6419 | 0.4594 | 0.6121 | 0.9342 |
| BERT (MLP) | 0.6594 | 0.4373 | 0.6222 | 0.9225 |
| SRL-informed Models | ||||
| Gated fusion, linear | 0.6594 | 0.4803 | 0.6412 | 0.9480 |
| Model | Pearson’s | p -value |
| Baseline Models | ||
| BERT (linear) | 0.5687 | |
| BERT (MLP) | 0.5529 | |
| SRL-informed Models | ||
| Gated fusion, linear | 0.5254 | |
| Gated fusion, MLP | 0.5526 |
| Politeness (range to ) Utterance: “Could you possibly send me the link?” Predicted: 3.49 |
|---|
| No SRL |
| Input: Utterance + score |
| LLM Explanation: The use of the modal verb “Could” combined with the conditional phrasing “you possibly” softens the request, and the interrogative form signals deference; these cues may be interpreted as indicating courteous intent. |
| With SRL |
| SRL Input: [ARGM-MOD: Could] [ARG0: you] [ARGM-ADV: possibly] [V: send] [ARG2: me] [ARG1: the link] Semantic-role repr.: ARG0 ARG2 ARGM |
| LLM Explanation: The utterance frames the agent (you) as the potential performer of the action (send) toward the recipient (me) with the object (the link). The presence of the modal “Could” and the adverb “possibly” softens the directive, which may be interpreted as a polite request, consistent with the high politeness score. |