Cultural Bias in Language Models

Follow this topic Ask about this topic

Momentum

5 papers in the last four weeks, down 17% on the four weeks before. 0.0% of all new papers.

Jul 13Week of Sep 28

Latest papers 91

All topics

Calibrated to Whom? Persona and Language Effects on Cultural Values in JEV
Sep 28, 2026Bushra Asseri, Abdulaziz AsseriMultilingual Language Model Evaluation Cross-Cultural Language Model Evaluation
College of Engineering and Advanced Computing, Alfaisal University, Riyadh, Saudi Arabia · Proxa.sa, Riyadh, Saudi Arabia
Cultural Divergence Preservation: Diagnosing Flattening and Caricature in LLM-Simulated Survey Populations
Sep 24, 2026Yeeun Chae, Yewon Choi, Seunghyun Lee +1Cultural Bias in Language Models Language Model Bias Evaluation
Yonsei University · NAVER · Seoul National University Hospital
GYROval: A Robust Benchmark for Cultural Value Orientation in Large Language Models
Sep 16, 2026Alexander Didenko, Anna Shabanova, Vladislav Zapylikhin +2LLM Evaluation Cross-Cultural Language Model Evaluation
Artificial Intelligence Laboratory, SKOLKOVO School of Management, Moscow · Artificial Intelligence Laboratory, University of Tyumen · Institute of Business Studies, Russian Presidential Academy of National Economy and Public Administration, Moscow
Prompt Revision as a Source of Cultural Bias in Text-to-Image Systems
Sep 12, 2026Aleksandra Urman, Elsa Lichtenegger, Salima Jaoua +7T2I Generation Cultural Bias in Language Models
University of Zurich · University of Helsinki · ETH Zurich +1
DiSCo: A Distribution-First Steering and Cultural Prior Evaluation Framework for Measuring Cultural Preference Bias in LLMs
Sep 9, 2026Bhuvan Arora, Devesh Saraogi, Sravya Varada +1LLM Prompting Cultural Bias in Language Models
BITS Pilani, Pilani, India.
CHARM: Character Hallucination for Multicultural Role Play Benchmark
Sep 1, 2026Sunkyung Han, Nahyeon Park, Gaeun Seo +2LLM Evaluation Large Language Model-Based Role-Play Simulation
Sungkyunkwan University, Suwon, South Korea · Adobe Research, CA, USA
Right Frame, Wrong Rule: Cultural Cues Expose the Financial Knowledge Gap They Were Meant to Close
Sep 1, 2026Rania Elbadry, Ahmed Heakl, Saeed Almheiri +12Financial Services Cultural Bias in Language Models
♠MBZUAI · ♢The University of Tokyo · §The Fin AI +4
Aligned but Flattened: Analyzing the Trade-off between Cultural Alignment and Diversity in LLMs
Sep 1, 2026Jingshen Zhang, Shaoyang Xu, Wenxuan ZhangLLM Evaluation Cultural Alignment
School of Computer Science and Technology, Tianjin University · 2iNLP Lab, Singapore University of Technology and Design
MemeBridge: A Dataset for Benchmarking and Mitigating the Bidirectional Cultural Gap in Meme Interpretation
Aug 31, 2026Hangxiao Zhu, Suliu Qin, Zhuoyan Li +3Cultural Bias in Language Models Cultural Knowledge in Language Models
Texas A&M University · College Station, USA · Independent Researcher +4
Evaluating and Mitigating Anti-LGBTQ Biases in German and Multilingual Language Models
Aug 31, 2026Melina Morch, Daniel BraunMultilingual Language Model Evaluation Social Bias in Language Models
Marburg University · Computer Science · Cultural Data Studies +2
Every Token Counts: Exact Likert-Scale Distributions for Measuring LLM Attitudes and Biases
Aug 11, 2026Davood Wadi, Mohsen Ghodrat, Matthew PhilpLLM Evaluation Cultural Bias in Language Models
McGill University · University Canada West · Marketing Management +1
SurakshaEval: An Indic Safety Benchmark for Multilingual LLMs
Aug 8, 2026Debopriyo Banerjee, Kapil Rajesh Kavitha, Angana Borah +11LLM Safety Benchmarks Multilingual Language Model Evaluation
Inception · Mohamed bin Zayed University of Artificial Intelligence · University of Michigan +4
Critical Acclaim Orientation in Large Language Models: Evidence from Film Preference Elicitation
Aug 7, 2026Jonghyun Jee, Aaron ShawLLM Evaluation Cultural Bias in Language Models
Department of Communication Studies, Northwestern University
Cultural Awareness is Represented but Not Decoded: Tracing Mythological Knowledge across 18 Open-Source LLMs
Aug 3, 2026Iaroslav Chelombitko, Ekaterina Chelombitko, Mika HämäläinenMultilingual Language Models LLM Interpretability
1DataSpike · 2Metropolia University of Applied Sciences, Helsinki, Finland · 3Neapolis University Pafos, Paphos, Cyprus
TreeProbe : A Tibetan Medicine Benchmark for Cultural Bias in LLMs
Aug 1, 2026Jin Zhang, Linyu Li, Weili Jiang +7Cultural Bias in Language Models Language Model Bias Evaluation
University of Electronic Science and Technology of China · Peking University · Southwest Jiaotong University +1
A Heuristic Perspective on Debiasing Language Models
Aug 1, 2026Tian Lan, Yemin Wang, Chuancheng Shi +6Social Bias in Language Models Cultural Bias in Language Models
Inner Mongolia University · Xiamen University · University of Sydney +3
AI systems and the reproduction of (standard) language ideologies in World Englishes
Jul 30, 2026Kingsley UgwuanyiCultural Bias in Language Models Linguistic Bias in Language Models
University of Nigeria, Nsukka · King’s College London · SOAS, University of London
Generative AI and linguistic diversity in academic writing and publishing: Perspectives from World Englishes
Jul 30, 2026Kingsley Ugwuanyi, Christian Mair, Sender Dovchin +3Cultural Bias in Language Models Text Generation
SOAS University of London, UK · University of Freiburg, Germany · Curtin University, Australia +3
Evaluating Regional Bias in LLMs From Abstract Stereotype to Concrete Social Decision-Making
Jul 29, 2026Jiayuan Di, Haoyi Yang, Yufei Luo +2Social Bias in Language Models Cultural Bias in Language Models
East China University of Science and Technology · Mohamed bin Zayed University of Artificial Intelligence · Beijing University of Posts and Telecommunications +2
Inspect India Evals: An Open Benchmarking Framework for Evaluating Large Language Models in the Indian Linguistic and Cultural Context
Jul 28, 2026Abhishek Kumar Singh, Shrey Nag, Sachita +2LLM Safety Benchmarks Multilingual Language Model Evaluation
GTBIT¹ · TIET² · IGDTUW³ +2
Probing Latent Colombian Identity Inferences in Qwen2.5-7B with Natural Language Autoencoders
Jul 23, 2026Pablo Santiago Potes Velasco, María del Mar García Matabanchoy, Óscar Julián Pérez Ladino +3LLM Interpretability Cultural Bias in Language Models
Universidad Autónoma de Occidente Cali, Colombia · Universidad Autónoma de Occidente GobLab-UAI Cali, Colombia
REGARD: Regional Affective Differences in Large Language Models
Jul 22, 2026Andrei Chetvergov, Alexander Evseev, Mikhail Solovev +5Political Bias in Language Models Valence-Arousal Modeling
Ivannikov Institute for System Programming of the Russian Academy of Sciences, Moscow, Russia · Russian Presidential Academy of National Economy and Public Administration, Moscow, Russia
LKValues: Aligning Large Language Models with Sri Lankan Societal Values
Jul 22, 2026Nethmi Muthugala, Supryadi, Surangika Ranathunga +7Multilingual Language Model Evaluation LLM Alignment
TJUNLP Lab, School of Computer Science and Technology, Tianjin University, Tianjin, China · School of Mathematical and Computational Sciences, Massey University, Auckland, New Zealand · Department of Computer Science & Engineering, University of Moratuwa, Sri Lanka +2
When a Name Is Not a Name: A Benchmark Dataset and Distilled Reasoning for Culturally Entangled Bangla Homographs in Low-Resource LLMs
Jul 20, 2026Md. Asaduzzaman ShuvoCultural Bias in Language Models Language Model Bias Evaluation
United International University, Bangladesh
PLURAL: A Global Dataset for Value Alignment
Jul 9, 2026Dhruv Agarwal, Anya Shukla, Tanya Goyal +1LLM Alignment Cultural Alignment
Cornell University
Scalable and Culturally Specific Stereotype Dataset Construction via Human-LLM Collaboration
Jul 8, 2026Weicheng Ma, John Guerrerio, Soroush VosoughiMultilingual Language Model Evaluation Social Bias in Language Models
College of Computing, Georgia Institute of Technology · Computer Science Department, Dartmouth College
Rethinking Indic AI from a Lens of Cultural Heritage Preservation
Jul 7, 2026Aparna Madva, Sharath Srivatsa, Srinath Srinivasa +1Multilingual Language Models Cultural Bias in Language Models
International Institute of Information Technology, Bengaluru, India
Pluralis v0.1: Towards a Multicultural, Multimodal, Multilingual Benchmark for AI Risk and Reliability
Jul 7, 2026Alicia Parrish, Rajat Shinde, Sanket Badhe +57VLM Evaluation Cross-Cultural Language Model Evaluation
World Wide Models: Literary Tools for Cultural AI
Jul 2, 2026Nina BegusCultural Bias in Language Models
University of California, Berkeley
MSQA: A Natively Sourced Multilingual and Multicultural SimpleQA Benchmark
Jul 1, 2026Xianru Chen, Yukai Huang, Mingxiang Chen +6Multilingual Language Model Evaluation LLM Evaluation
ByteDance Seed · Nanjing University · M-A-P

Sep 28, 2026, cs.CLJ/K move · Enter open · S save

Calibrated to Whom? Persona and Language Effects on Cultural Values in JEV

Bushra Asseri, Abdulaziz Asseri

College of Engineering and Advanced Computing, Alfaisal University, Riyadh, Saudi Arabia · Proxa.sa, Riyadh, Saudi Arabia

Multilingual Language Model Evaluation Cross-Cultural Language Model Evaluation Cultural Bias in Language Models Demographic Bias in Language Models Persona-Conditioned Generation

Open paper AskPDF arXiv

Decision-only language models return a probability for every answer option instead of generating text, which makes them attractive as survey respondents and as judges. We audit the cultural values of one such model, TypeSafe's JEV, with the Values Survey Module 2013. We asked it the 24 items as 12 matched Saudi and 12 matched American personas and without a persona, in English and Arabic, under eight ways of formulating the request (288,000 answers). JEV's answers were highly repeatable (ICC 0.997), and without a persona they resembled those of its own American personas. When the persona was Saudi rather than American, the answers moved in the direction of the human Saudi-US difference, reproducing 87% of its size in English but 62% in Arabic, with long-term orientation reversed. A language cross shows that the smaller difference in Arabic comes from the language of the items, not from the language of the persona description. Age shifted the profiles about as much as nationality, gender shifted them more for Saudi than for American personas, and JEV was less confident in Arabic and for Saudi personas. These patterns held in every request design, although the model never generates text.

Momentum

Related topics

Latest papers 91