Multilingual VLM Evaluation

VLM: Vision-Language Model

Ask about this topic

Momentum

4 papers in the last four weeks, down 56% on the four weeks before. 0.0% of all new papers.

Jul 13Week of Sep 28
View on map

Latest papers 34

All topics
CardsList

  1. VISTA-Bench: Benchmarking Multilingual Image Translation with Image-Specific Rubrics

    Sep 29, 2026Bo Lv, Mao Zheng, Zheng Li +3Multilingual VLM EvaluationRubric-Based Evaluation

    Foundation Model Department, Tencent

  2. Vroom-Vroom at SHROOM-Visions: A Multi-Judge Committee for Detecting Hallucinated Spans in Vision-Language Outputs

    Sep 15, 2026Toqeer Ehsan, Nico Penttilä, Richard Schmidt +2VLM EvaluationHallucination Detection in VLMs

    Reliable Intelligence Team, Physical AI, VTT Technical Research Centre of Finland

  3. ChitraMiti: Benchmarking Visual Grounding and Modality Reliance in Bengali Geometric Reasoning

    Sep 14, 2026Khan Raiyan Ibne Reza, Sanjana Aktar Maria, Sumaiya Tabassum Nimi +1Mathematical Reasoning BenchmarksMultilingual VLM Evaluation

    North South University

  4. BanglaMemeX: Advancing Cultural Metaphoric Image Interpretation in Bangla with a Multimodal Explainable Dataset

    Sep 7, 2026Md. Sadman Sakib, Zisan Mahmud, Md. Fahim Arefin +1Figurative Language UnderstandingMultilingual VLM Evaluation

    University of Dhaka · University of Texas at Dallas

  5. MM-IFEval-Pro: A Multilingual and Attack-Resistant Benchmark for Instruction-Following in Vision-Language Models

    Sep 4, 2026Changming Xiao, Zhenliang Ni, Jinhui He +2VLM RobustnessAdversarial Attacks on VLMs

    Huawei Technologies Ltd. · Beijing, China · Shenzhen, China +1

  6. IchthyoNoma: Nomenclature and Context Sensitivity of Zero-Shot Biological Vision--Language Models for Bangladeshi Freshwater Fish Recognition

    Sep 3, 2026Nazim-E-Alam, Tarek Rahman, Md Kishor MorolVLM RobustnessPrompt Sensitivity

    American International University Bangladesh · United International University · ELITE Research Lab, Queens, New York, USA

  7. CulturalMenuBench: Probing the Knowledge-Application Gap in Multimodal Culinary Reasoning

    Sep 3, 2026Bo Zeng, Linfeng Gao, Peiqin Lin +9Multimodal ReasoningMultilingual VLM Evaluation

    Alibaba Group · Xiamen University · University of Hamburg

  8. MemeCULT-1K: Benchmarking South Asian Cultural Context and Humor Understanding of Multimodal Models

    Sep 1, 2026Tawsif Tashwar Dipto, Mehedi Ahamed, Radib Bin Kabir +5VLM EvaluationMultilingual VLM Evaluation

    1Islamic University of Technology · 2South East University · 3Vector Institute +3

  9. Where Do Multilingual Vision-Language Encoders Fail on Low-Resource Languages?

    Aug 31, 2026Donghoon Han, SungHyun Moon, Aidyn Zhakatayev +2Cross-Lingual Representation AlignmentMultilingual VLM Evaluation

    Dnotitia Inc.

  10. ImageEval 2026: Culturally Grounded Arabic Multimodal Evaluation

    Aug 31, 2026Samir Abdaljalil, Hunzalah Hassan Bhatti, Ahlam Bashiti +11Hallucination DetectionT2I Generation

    Texas A&M University · Qatar Computing Research Institute, Qatar · Birzeit University, Palestine +2

  11. Read the Room, Read the Image: Understanding Indirect Speech Acts in Multimodal Visual Contexts

    Aug 31, 2026Jaehee Kim, Ji Hoon Chung, Seoyoon Park +5Multimodal QAMultilingual VLM Evaluation

    Department of Korean Language and Literature, Yonsei University · Interdisciplinary Graduate Program of Linguistics and Informatics, Yonsei University · LG AI Research +1

  12. NARU: A Benchmark for NARrative Evolution and Cultural Nuance Understanding in Japanese Extreme Long Video

    Aug 13, 2026Yuheng Huang, Jianlang Chen, Jiayang Song +6Video UnderstandingVideo-Language Model Evaluation

    The University of Tokyo, Tokyo, Japan · Kyushu University, Fukuoka, Japan · Macau University of Science and Technology, Macau, China +2

  13. Polish Medical Visual Question Answering: Vision-Language Models Underutilize Visual Evidence

    Aug 13, 2026Jakub Pokrywka, Łukasz Grzybowski, Antoni Lasik +3Medical VQAMultilingual VLM Evaluation

    Adam Mickiewicz University · ARAAI Poland · NASK National Research Institute +2

  14. Jako Tako or Fluent? Presenting PoVisLE: A Polish Vision-Language Evaluation

    Aug 7, 2026Anna Kołos, Grzegorz Statkiewicz, Karolina Seweryn +3VLM EvaluationVisual Question Answering

    NASK National Research Institute, Warsaw, Poland

  15. Can Humans Dream of Electric Sheep? Human-Written Samples for Fine-Grained Vision-and-Language Hallucination Benchmarking

    Aug 2, 2026Timothee Mickus, Claudio Savelli, Eduardo Calò +10VLM EvaluationHallucination Detection in VLMs

    University of Helsinki

  16. Khondo: A Multimodal Benchmark for Document Packet Splitting of Bangla Forms

    Jul 23, 2026Abu Tyeb Azad, Fahim Ahmed, Ishita Sur Apan +7Document ChunkingMultilingual VLM Evaluation

    Wichita State University, USA · CCDS, Independent University, Bangladesh · Amazon GenAI, USA

  17. Test-Time Scaling for Small VLMs on Multilingual Visual MCQ

    Jul 10, 2026Spiros Baxevanakis, Peng-Jian YangVisual Question AnsweringTest-Time Scaling for VLMs

    University of Amsterdam, Science Park 904, 1098 XH Amsterdam, The Netherlands

  18. Evaluation of Multilingual Ability to Use Spatial Deictic Expressions in Vision-Language Models

    Jul 8, 2026Kaito Watanabe, Taisei Yamamoto, Tomoki Doi +1Visual Spatial ReasoningMultilingual VLM Evaluation

    The University of Tokyo · Riken · Tohoku University

  19. Pluralis v0.1: Towards a Multicultural, Multimodal, Multilingual Benchmark for AI Risk and Reliability

    Jul 7, 2026Alicia Parrish, Rajat Shinde, Sanket Badhe +57VLM EvaluationCross-Cultural Language Model Evaluation

  20. MORE: A Multilingual Document Parsing Benchmark and Evaluation

    Jul 3, 2026Long Xu, Binghong Wu, Tinghao Yu +6Document ParsingMultilingual VLM Evaluation

    Tencent, Shenzhen, China

  21. Resolution Thresholds in VLM Detection of Harmful ASCII Art Across Construction Modes and Languages

    Jun 28, 2026Yikai Hua, Peter WestVLM EvaluationVLM Robustness

    Department of Computer Science The University of British Columbia

  22. Beyond 'One Language, One Script': Quantifying Orthographic Bias in Multilingual VLMs with PuMVR

    Jun 18, 2026Prabhjot Singh, Bhushan Pawar, Madhu ReddiboinaVLM EvaluationVision-Language Models

    RediMinds Inc., USA

  23. Not Truly Multilingual: Script Consistency as a Missing Dimension in VLM Evaluation

    Jun 15, 2026Prabhjot Singh, Bhushan Pawar, Madhu Reddiboina +1VLM EvaluationMultilingual Language Models

    RediMinds Inc., USA · The University of Texas at Austin, USA · Indian AI Research Organization (IAIRO), India

  24. When Does Language Matter? Multilingual Instructions Reveal Step-wise Language Sensitivity in Vision-Language-Action Models

    Jun 10, 2026Xuan Dong, Zhe Han, Tianhao Niu +2VLM RobustnessMultilingual VLM Evaluation

    Harbin Institute of Technology

  25. MLingualFC: Evaluating Jailbreak Vulnerabilities in Multilingual Vision-Language Models

    Jun 5, 2026Rishabh Makwana, Mamta, Deeksha Varshney +1VLM EvaluationVLM Robustness

    Dwarkadas Jivanlal Sanghvi College of Engineering, Mumbai, India · King’s College London, London, UK · Indian Institute of Technology Jodhpur, Jodhpur, India

  26. Almieyar-Oryx-BloomBench: A Bilingual Multimodal Benchmark for Cognitively Informed Evaluation of Vision-Language Models

    Jun 4, 2026Mohammad Mahdi Abootorabi, Omid Ghahroodi, Anas Madkoor +4VLM EvaluationMultilingual VLM Evaluation

    Qatar Computing Research Institute (QCRI), Hamad Bin Khalifa University

  27. Exploring Adversarial Robustness and Safety Alignment in Multilingual Multi-Modal Large Language Models

    Jun 2, 2026Hashmat Shadab Malik, Muzammal Naseer, Salman KhanMultilingual Language Model EvaluationAdversarial Attacks on VLMs

    Mohamed Bin Zayed University of AI, UAE · Khalifa University, UAE · Australian National University, Australia

  28. Does Language Shift Break Medical Vision-Language Models? Indonesian Radiology Visual Question Answering Case Study

    Jun 2, 2026Pieter Christy Yan Yudhistira, Dzaki Rafif Malik, Novanto YudistiraVLM EvaluationVLM Robustness

    Intelligent System Laboratory, Faculty of Computer Science Brawijaya University, Malang, Indonesia

  29. A Pilot Study on Curator-Guided Multilingual Art Description for Blind and Low-Vision Audiences with Small Vision-Language Models

    May 29, 2026Iosif Tsangko, Andreas Triantafyllopoulos, George Margetis +2Image CaptioningVLM Adaptation

    Technical University of Munich Munich, Germany · Foundation for Research and Technology – Hellas Heraklion, Greece · National University of Science and Technology Politehnica Bucharest Bucharest, Romania

  30. Language-Conditioned Visual Grounding with CLIP Multilingual

    May 9, 2026J. de Curtò, Mauro Liz, I. de ZarzàVLM EvaluationMultilingual VLM Evaluation

    Department of Computer Applications in Science & Engineering, BARCELONA Supercomputing Center, Barcelona, Spain · Estudis d’Informàtica, Multimèdia i Telecomunicació, Universitat Oberta de Catalunya, Barcelona, Spain · Escuela T´ecnica Superior de Ingenier´ıa (ICAI), Universidad Pontificia Comillas, Madrid, Spain +2