cs.CLAug 18, 2026

Figurative and Cultural Knowledge in LLMs: Investigating Cross-Domain Transfer through Fine-Tuning

Authors: Mena Attia, Mona Diab, Thamar Solorio

Organizations: MBZUAI · Carnegie Mellon University

Abstract

Figurative language is deeply culturally embedded; fluent use requires not just linguistic competence but cultural immersion. We ask whether LLMs can learn this link: does fine-tuning on cultural data improve figurative language understanding, and vice versa? We conduct a systematic study across four models (ALLaM-7B, Fanar-1-9B, Qwen3-8B, Llama-3.1-8B) and six Arabic datasets spanning cultural commonsense, proverbs, and poetry across diverse dialects and regions. Fine-tuning on poetry improves idiom comprehension (+2.33%, p<0.05), a gain our ArabicMMLU control does not reproduce, indicating that it stems from figurative content rather than Arabic language adaptation and pointing to a sensitivity to non-literal meaning that transfers across figurative types. Cultural fine-tuning, by contrast, lowers proverb-interpretation accuracy in both Arabic-centric models. Transfer between the two domains is otherwise indistinguishable from noise, with Arabic models frequently regressing after fine-tuning, suggesting prior saturation of relevant knowledge, while multilingual models show greater adaptation headroom. Error analysis further reveals that fine-tuning reinforces experiential cultural knowledge while destabilizing historically grounded factual knowledge. Our findings suggest that the relationship between culture and figurative language, though conceptually natural, is not straightforwardly captured through fine-tuning alone.

Figures & tables

Appendix figures & tables33 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. Wisdom in Unity: The Role of Multilingual Training in Figurative Language Identification in Proverbs

    Aug 8, 2026Rama Alomair, Remas Alsubaie, Walaa Saifalislam +5Figurative Language UnderstandingMultilingual Language Models

  2. VIVID: A Culturally Grounded Benchmark Exposing the Figurative Language Gap in Vietnamese NLP

    Aug 4, 2026Tu Tran Do, Nhat Ngoc Nguyen, Khanh-Tung Tran +3Figurative Language UnderstandingMultilingual Language Model Evaluation