Cultural Knowledge in Language Models

Follow this topic Ask about this topic

Momentum

13 papers in the last four weeks, up 44% on the four weeks before. 0.1% of all new papers.

Jul 13Week of Sep 28

Latest papers 77

All topics

Cultural Benchmarking of LLMs in Standard and Dialectal Arabic Dialogues
Apr 30, 2026Muhammad Dehan Al Kautsar, Saeed Almheiri, Momina Ahsan +13Multilingual Language Model Evaluation Arabic NLP
Mohamed bin Zayed University of Artificial Intelligence · IBM Research AI · American University in the Emirates
Progressing beyond Art Masterpieces or Touristic Clichés: how to assess your LLMs for cultural alignment?
Apr 28, 2026António Branco, João Silva, Nuno Marques +10Cultural Alignment Cultural Bias in Language Models
†University of Lisbon · ‡University of Beira Interior
Do LLMs Capture Embodied Cognition and Cultural Variation? Cross-Linguistic Evidence from Demonstratives
Apr 28, 2026Yu Wang, Emmanuele Chersoni, Chu-Ren HuangMultilingual Language Model Evaluation LLM Grounding
Department of Language Science and Technology · The Hong Kong Polytechnic University · Hung Lok Road, Hung Hom, Kowloon, Hong Kong (China)
Culture-Aware Machine Translation in Large Language Models: Benchmarking and Investigation
Apr 27, 2026Zekun Yuan, Yangfan Ye, Xiaocheng Feng +5LLM Evaluation Cultural Knowledge in Language Models
Harbin Institute of Technology · Peng Cheng Laboratory · Huawei Technologies Co., Ltd
Why are all LLMs Obsessed with Japanese Culture? On the Hidden Cultural and Regional Biases of LLMs
Apr 23, 2026Joseba Fernandez de Landa, Carla Perez-Almendros, Jose Camacho-ColladosMultilingual Language Model Evaluation Cultural Bias in Language Models
HiTZ Center - Ixa, University of the Basque Country EHU · Cardiff University
The GaoYao Benchmark: A Comprehensive Framework for Evaluating Multilingual and Multicultural Abilities of Large Language Models
Apr 22, 2026Yilun Liu, Chunguang Zhao, Mengyao Piao +14Multilingual Language Model Evaluation LLM Evaluation
Huawei, China · Fudan University, China
Culturally uneven urban perception in large language models
Apr 21, 2026Rong Zhao, Wanqi Liu, Zhizhou Sha +3VLM Evaluation Social Bias in Language Models
Centre for Advanced Spatial Analysis (CASA), UCL, London, UK · Department of Computer Science, UT Austin, Austin, TX, USA · School of Architecture, Tsinghua University, Beijing, China
CulturALL: Benchmarking Multilingual and Multicultural Competence of LLMs on Grounded Tasks
Apr 21, 2026Peiqin Lin, Chenyang Lyu, Wenjiang Luo +22Multilingual Language Model Evaluation LLM Evaluation
Alibaba Group · Beijing Language and Culture University · LMU Munich +6
AlignCultura: Towards Culturally Aligned Large Language Models?
Apr 21, 2026Gautam Siddharth Kashyap, Mark Dras, Usman NaseemCross-Cultural Language Model Evaluation Cultural Alignment
School of Computing, Macquarie University, Australia
Do LLMs Use Cultural Knowledge Without Being Told? A Multilingual Evaluation of Implicit Pragmatic Adaptation
Apr 20, 2026Mehwish Nasim, Sanjeevan Selvaganapathy, Neel Ganapathi Sabhahit +6Multilingual Language Models Multilingual Language Model Evaluation
1Network Analysis and Social Influence Modelling (NASIM) Lab · 3Computational Social Science & Systems Analysis University of Münster · School of Computing Macquarie University
Jupiter-N Technical Report
Apr 19, 2026George DraysonLLM Alignment Cultural Alignment
Locai Labs, University College London
AdaCultureSafe: Adaptive Cultural Safety Grounded by Cultural Knowledge in Large Language Models
Mar 9, 2026Hankun Kang, Di Lin, Zhirong Liao +6Language Model Safety Evaluation Cultural Knowledge in Language Models
School of Computer Science, Wuhan University, China · Tsinghua University, China · Jiangxi University of Finance and Economics, China
The Role of Dataset Linguistic Structure in the Cultural Awareness of Large Language Models
Feb 1, 2026Reem I. Masoud, Chen Feng, Shunta Asano +3LLM Fine-Tuning Cultural Alignment
University College London · King Abdulaziz University · Queen’s University Belfast +3
AVMeme Exam: A Multimodal Multilingual Multicultural Benchmark for LLMs' Contextual and Cultural Knowledge and Thinking
Jan 25, 2026Xilin Jiang, Qiaolin Wang, Junkai Wu +30Audio-Visual Understanding Multimodal Large Language Models
Columbia University · University of Washington · University of Illinois Urbana-Champaign +5
Camellia: Benchmarking Cultural Biases in LLMs for Asian Languages
Oct 6, 2025Tarek Naous, Anagha Savit, Carlos Rafael Catalan +17Multilingual Language Model Evaluation Cultural Bias in Language Models
Georgia Institute of Technology · Samsung R&D Institute Philippines · Sungkyunkwan University +6
Language Specific Knowledge: Do Models Know Better in X than in English?
May 21, 2025Ishika Agarwal, Nimet Beyza Bozdag, Dilek Hakkani-TürMultilingual Language Models Multilingual QA
Department of Computer Science University of Illinois, Urbana-Champaign
KoSimpleQA: A Korean Factuality Benchmark with an Analysis of Reasoning LLMs
Date pendingDonghyeon Ko, Kyubyung Chae, Yeguk Jin +6Multilingual Language Model Evaluation LLM Evaluation
Naver Cloud · Graduate School of Data Science, Seoul National University

Apr 30, 2026, cs.CLJ/K move · Enter open · S save

Cultural Benchmarking of LLMs in Standard and Dialectal Arabic Dialogues

Muhammad Dehan Al Kautsar, Saeed Almheiri, Momina Ahsan, Bilal Elbouardi+12

Mohamed bin Zayed University of Artificial Intelligence · IBM Research AI · American University in the Emirates

Multilingual Language Model Evaluation Arabic NLP Cultural Knowledge in Language Models Low-Resource Language Processing Text Generation MT Evaluation

Open paper AskPDF arXiv

There is a significant gap in evaluating cultural reasoning in LLMs using conversational datasets that capture culturally rich and dialectal contexts. Most Arabic benchmarks focus on short text snippets in Modern Standard Arabic (MSA), overlooking the cultural nuances that naturally arise in dialogues. To address this gap, we introduce ArabCulture-Dialogue, a culturally grounded conversational dataset covering 13 Arabic-speaking countries, in both MSA and each country's respective dialect, spanning 12 daily-life topics and 54 fine-grained subtopics. We utilize the dataset to form three benchmarking tasks: (i) multiple-choice cultural reasoning, (ii) machine translation between MSA and dialects, and (iii) dialect-steering generation. Our experiments indicate that the performance gap between MSA and Arabic dialects still exists, whereby the models perform worse on all three tasks in the dialectal setup, compared to the MSA one.

Momentum

Related topics

Latest papers 77