cs.CLOct 31, 2026

Spotting the Artificial: Dialogic Humor Improvisation in Humans and LLMs

Authors: Lizeth Palacios Patiño, Ximena Gutierrez-Vasques, Daniel Rodriguez

Organizations: Posgrado de lingüística, UNAM, Mexico · CEIICH, UNAM, Mexico

Abstract

We propose a methodology for investigating the differences between natural and synthetic language in a challenging setting: humorous improvisational dialogue. Our experimental setting compares human-produced comedy improvisations with the dialogues generated by LLMs in a multi-agent environment that we designed. The analysis combines automated linguistic measures with manual annotation grounded in Systemic Functional Linguistics (SFL). The results show that, although LLMs can create coherent and creative scenes, they often fail to reproduce key characteristics of spontaneous spoken interaction. In addition, LLM-generated interactions display a strong tendency toward politeness and positive evaluations, contrasting with the broader range of attitudes found in human humorous improvisation. Our evidence highlights both the strengths and limitations of current LLMs in modeling dialogic humor and demonstrate the value of integrating linguistic theory with NLP methods for the analysis of machine-generated language

Figures & tables

Appendix figures & tables3 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. Semantic Delta: An Interpretable Signal Differentiating Human and LLMs Dialogue

    Mar 20, 2026Riccardo Scantamburlo, Mauro Mezzanzana, Giacomo Buonanno +1AI-Generated Text DetectionLanguage Model Generation Evaluation

  2. Re-defining Humor Data Objects for AI Humor Research

    May 24, 2026Anna Arnett, Bang Nguyen, Meng JiangLLM PromptingHumor Explanation Generation