cs.CLMay 8, 2026

SCENE: Recognizing Social Norms and Sanctioning in Group Chats

Authors: Mateusz JacniackiMaksymilian Bilski

Organizations: Humalike

Abstract

Online group chats are social spaces with implicit behavior patterns that, when broken, are often met with social sanctioning from the group. The ability and willingness of LLM-based agents to recognize and adapt to these norms remains mostly unexplored. We introduce SCENE, a social-interaction benchmark focused on implicit norms and social sanctioning in multi-party chat. SCENE generates plausible non-roleplay scenarios with scripted personas that follow a hidden norm, create opportunities for the subject agent to violate it, and sanction breaches when they occur. We further propose behavioral evaluation metrics for two functional adaptation abilities: responsiveness to negative sanctioning, and adapting norm from peers behavior. We evaluate six frontier and open-weight models on SCENE. Our results show that Claude Opus 4.7 and Gemini 3.1 Pro adapt to implicit norms significantly more than the evaluated open-weight models. SCENE contributes one benchmark in the direction of recent calls for dynamic, interactional evaluation of LLM social capabilities.

Explore similar work

CardsList
  1. LoSoNA: A Benchmark for Local Social Norm Adaptation in Group Conversations

    Jun 12, 2026Mateusz Winiarek, Maksymilian Bilski, Mateusz JacniackiSocial NormsChatbots

  2. Naturalistic measure of social norms alignment

    May 22, 2026Yevhen Kostiuk, Kenneth Enevoldsen, Peter Bjerregaard Vahlstrup +2Social NormsSocial Reasoning