Cultural Knowledge in Language Models

Follow this topic Ask about this topic

This field studies whether language models can understand and use knowledge tied to particular communities, languages, regions, and historical contexts—not just recall cultural facts. Researchers test this with multilingual question answering, pragmatic dialogue, proverb and metaphor tasks, and cultural-heritage or meme images, often using native-speaker judgments. Methods include retrieval-augmented generation, culturally targeted fine-tuning, activation steering, and mechanistic interpretability. Models often perform unevenly across cultures and languages, and may represent relevant knowledge without applying it; the central challenge is improving cultural grounding without flattening differences or reinforcing stereotypes.

Latest papers

132 papers18 papers in the last four weeks, down 22% on the four weeks before. 0.1% of all new papers.

Do Language Models Understand Igbo Culture? Beyond Multiple Choice
Oct 26, 2026Blessing Ngozi Uzor, Valdini Douglace Lemofouet, Paula Chikaodinaka Anyanwu +7Cultural Knowledge in Language Models Cross-Cultural Language Model Evaluation
African Institute for Mathematical Sciences (AIMS), Cameroon · University of Nigeria, Nsukka · Brown University +5
WikiOriginQA: Automated Construction of a QA Dataset with Knowledge Origins for Analyzing Cultural Bias
Oct 22, 2026Kento Haneda, Yosuke Kishinami, Ryo Fujii +2Cultural Knowledge in Language Models Cultural Bias in Language Models
Future Corporation · Tohoku University
CulturalRiddles: A Multicultural Benchmark of Riddles
Oct 21, 2026My Chiffon Nguyen, Tianyi Hu, Vinod Anbalagan +161Cross-Cultural Language Model Evaluation Cultural Knowledge in Language Models
The Culture Within: Towards Mechanistic Understanding of Cultural Reasoning in LLMs
Oct 19, 2026Samee Arif, Furkan Danisman, Angana Borah +6Cultural Bias in Language Models Cultural Knowledge in Language Models
Aligning Cultural Behaviors in Arabic Language Models via Preferences
Oct 18, 2026Junhong Liang, Daniil Orel, Saeed Almheiri +11Arabic Language Models Cultural Alignment
Mohamed bin Zayed University of Artificial Intelligence · IBM Research AI
Aligning Language Models with Indigenous Community Cosmovision through Constitutional AI
Oct 18, 2026Silvia Fernández-Sabido, Jorge Reyes-Magaña, Jesús Adrián Chay Tun +3LLM Alignment Cultural Knowledge in Language Models
Secretaría de Ciencia, Humanidades, Tecnología e Innovación (SECIHTI), commissioned to CentroGeo, Mérida, Yucatán, Mexico · Facultad de Matemáticas, Universidad Autónoma de Yucatán, Mérida, Yucatán, Mexico · Aymara Community / Global Council for Latin America and the Caribbean, United Religions Initiative (URI), Buenos Aires, Argentina
Cultural (In)Competence: Investigating Culture-Specific Stereotype Detection Capabilities of LLMs
Oct 15, 2026Maximilian Spliethöver, Jannes Lötfering, Dominik Bachmann +4Social Bias in Language Models Cultural Bias in Language Models
Institute of Artificial Intelligence & L3S Research Center, Leibniz University Hannover · Institute for Logic, Language & Computation, University of Amsterdam · Department of Experimental Psychology, Utrecht University
ChronoCulture: Evaluating Cultural Awareness Across Time in Large Language Models
Oct 14, 2026Rusali Saha, Nitya Khurana, Ruihong Huang +1Cultural Knowledge in Language Models Cross-Cultural Language Model Evaluation
Texas A&M University
Analyzing performance of Retrieval Augmented Generation models for Question Answering Tasks
Oct 14, 2026Fazle Mohammed Tasfiq, Sabab Attin, Sheikh Md. Tahmid Hossain +6RAG Evaluation Multilingual QA
Dept. of Computer Science and Engineering BRAC University Dhaka, Bangladesh
Tanawpamana: Benchmarking Vision-Language Models on Philippine Cultural Heritage Sites
Oct 13, 2026Ivan Yuri De Leon, Hiroki Ouchi, Sakriani SaktiVLM Evaluation Cultural Knowledge in Language Models
Ateneo de Manila University, Philippines · Globe Telecom, Philippines · Nara Institute of Science and Technology, Japan
Communication, Vocalisation, and Language
Oct 12, 2026Peter WallisLLM Grounding Cultural Knowledge in Language Models
North or South? Diagnosing LLMs' Understanding of North Korean Language, Society, and Knowledge
Oct 11, 2026Kiwoong Park, Seyoung Song, Donghyun Woo +1Cultural Knowledge in Language Models Cross-Cultural Language Model Evaluation
KAIST
Knowing Is Not Telling: Identity Ossification in LLM Representations of Trans-border Communities
Oct 8, 2026Minglu Sun, Lan Chen, Hang JiangCultural Bias in Language Models Cultural Knowledge in Language Models
Northeastern University, Boston, MA, USA · The University of Texas at Austin, Austin, TX, USA
Language Unalignability: Why Some Concepts Resist Cross-Cultural Benchmark Evaluation
Oct 6, 2026Shu-Kai Hsieh, Da-Chen LianCultural Knowledge in Language Models LLM Evaluation
National Taiwan University
Artificial Intelligence and the New Science of Culture
Oct 5, 2026Douglas R. Guilbeault, Bhargav Srinivasa Desikan, James A. EvansCultural Evolution Computational Social Science
Graduate School of Business, Stanford University, U.S. · Oxford Internet Institute, University of Oxford, U.K. · Sociology & Data Science, University of Chicago, U.S.
Knowing the Rules, Applying the Rules: Evaluating Language Models on Traditional Chinese Bazi
Oct 5, 2026Jiulin Li, Ping HuangLLM Evaluation Cultural Knowledge in Language Models
Beijing Liuyi Guanhua Technology Co., Ltd. · State Key Laboratory of General Artificial Intelligence, BIGAI
CineSubBench: Evaluating LLMs on Long-Form Narrative and Cultural Understanding from Multilingual Movie Subtitles
Sep 28, 2026Mir Tafseer Nayeem, Susmoy Chakraborty, Davood RafieiMultilingual Language Model Evaluation Long-Context Language Model Evaluation
University of Alberta · Independent Researcher
AraDynFact: Dynamic Evaluation of Factual Knowledge in Arabic
Sep 28, 2026Ignacio Iacobacci, Faroq Altam, Zhaozhi Qian +1LLM Evaluation Arabic NLP
Elm Company
CRISP: Cultural Reward Modeling for Implicit Situated Propriety
Sep 28, 2026Zekun Yuan, Yangfan Ye, Baohang Li +6Reward Modeling RL for Language Models
Harbin Institute of Technology · Huawei Technologies Co., Ltd · Peng Cheng Laboratory
Supporting and Performing Culture from the Inside
Sep 26, 2026Lea Frermann, Steven BirdCultural Alignment Human-Centered AI
The University of Tübingen, Tübingen, Germany · The University of Melbourne, Melbourne, Australia · Charles Darwin University, Darwin, Australia
Evaluating Cultural Awareness of LLMs for Haitian Creole
Sep 25, 2026Christelle Clervilsson, Yanzhu GuoCultural Knowledge in Language Models Cultural Bias in Language Models
Telecom Paris, Institut Polytechnique de Paris, France
From annotation to reasoning: Culture in language models
Sep 25, 2026Daniel Hershcovich, Alexander Conroy, Jens Bjerring-HansenCultural Knowledge in Language Models Cross-Cultural Language Model Evaluation
Department of Computer Science, University of Copenhagen, Vermundsgade 5, 2100, Copenhagen, Denmark · Department of Nordic Studies and Linguistics, University of Copenhagen, Copenhagen, Denmark
Recognized but Not Produced: A Generation Benchmark for Culturally Specific Kinship Terms
Sep 22, 2026Sahil Pardasani, Madhusudan SinghMultilingual Language Model Evaluation Language Model Generation Evaluation
Blockchain Data Intelligence Lab The Pennsylvania State University University Park, PA, USA
FineWeb-CLaR: Culture, Language, and Region Annotations for Benchmark-Aligned Corpus Auditing
Sep 21, 2026Yusser Al Ghussin, Eva Gavaller, Cristina España-Bonet +2Multilingual Language Model Evaluation LLM Auditing
Saarland University · German Research Center for Artificial Intelligence (DFKI) · Barcelona Supercomputing Center (BSC-CNS), Barcelona, Catalonia, Spain
Tutoring Large Language Models to be Domain-adaptive, Precise and Safe
Sep 19, 2026Somnath BanerjeeLLM Safety LLM Safety Alignment
CultureMINE: Datasets and Methods for Improving the Cultural Capabilities of NLP Systems
Sep 18, 2026Tania Chakraborty, Eylon Caplan, Zhaoqing Wu +4Cultural Knowledge in Language Models
Purdue University · University of Pennsylvania
CIBuzzBench: A Benchmark for Cross-Lingual Understanding of Chinese Internet Buzzwords
Sep 18, 2026Yifan Wang, Junyu Lu, Qifan Wang +6Cross-Cultural Language Model Evaluation Cultural Knowledge in Language Models
People’s Public Security University of China · Dalian University of Technology · Meta AI +3
MUSE: Benchmarking Large Vision-Language Models on Multi-Modal Understanding in Situated Education
Sep 16, 2026Luyao Zhu, Xun Wei Yee, Wei Li +2VLM Evaluation Large Vision-Language Models
AI Singapore, National University of Singapore, Singapore · Institute of Advanced Intelligence and Computing, A*STAR · School of Computing, National University of Singapore, Singapore
Cultural Competence in Context: A Large Language Model Passes the Turing Test in Finland
Sep 16, 2026Otto Segersven, Pentti HenttonenMultilingual Language Model Evaluation LLM Evaluation
Department of Computer Science, University of Helsinki · Faculty of Social Sciences, University of Tampere
Knowledge-Graph Based Augmentation versus Retrieval Augmented Generation for Cultural-Related Question Answering
Sep 16, 2026Pablo Poulenard, Yannis Karmim, Valentin BarrièreRetrieval-Augmented Generation Graph Retrieval-Augmented Generation
DCC, Universidad de Chile, Santiago, Chile · École Polytechnique, Palaiseau, France · Inria, Almanach, Paris, France +2

Oct 26, 2026J/K move · Enter open · S save

Do Language Models Understand Igbo Culture? Beyond Multiple Choice

Blessing Ngozi Uzor, Valdini Douglace Lemofouet, Paula Chikaodinaka Anyanwu, Mmesoma Peace Orji+6

African Institute for Mathematical Sciences (AIMS), Cameroon · University of Nigeria, Nsukka · Brown University+5

Cultural Knowledge in Language Models Cross-Cultural Language Model Evaluation LLM Evaluation Multilingual Language Model Evaluation

Open paper AskPDF arXiv

The value of language models for any community depends on whether a model actually understands the culture of the people it intends to serve. We use the Igbo language as a case study. Existing benchmarks test translated Western ideas, lacking depth. To address this, we introduce CAB-Igbo, a benchmark developed from indigenous cultural sources and verified by native speakers across six domains. We evaluated diverse models under varying conditions, incorporating regional personas. Performance was assessed using multiple-choice accuracy and human evaluations across Epistemic Fidelity, Representational Richness, Linguistic Quality, and Pragmatic Proficiency. Results reveal a stark dissociation between language fluency and cultural knowledge. Through statistical testing, we show that for most models, the severe lack of Epistemic Fidelity and Representational Richness is already present in English and does not significantly worsen when switching to Igbo. Instead, native language prompting mainly degrades Linguistic Quality and Pragmatic Proficiency. Gemini 2.0 Flash is the only model whose cultural knowledge scores improve under Igbo prompting. We find that current models struggle to demonstrate the knowledge needed for true alignment with Igbo, and multiple-choice formats allow pattern-matching to appear as understanding. Furthermore, automated judges agree with humans on linguistic quality but fail on epistemic fidelity. Ultimately, cultural evaluation must be built from community knowledge, establishing human evaluation as the gold standard to prevent misrepresenting low-resource communities globally.