Figurative Language Understanding

Follow this topic Ask about this topic

Momentum

4 papers in the last four weeks, with none the four weeks before. 0.0% of all new papers.

Jul 13Week of Sep 28

Latest papers 24

All topics

It's Not What the Image Shows: Irrelevant Context Destabilises VLM Judges Without Informing Them
Sep 29, 2026Nagham Omar, Mahmoud Jabarin, Kinan Ibraheem +1VLM Evaluation Figurative Language Understanding
Faculty of Data and Decision Sciences, Technion
AraMIP: Extending MIPVU Towards Metaphor Identification in Arabic
Sep 15, 2026Mandar Marathe, Manar Ali, Sara Nabhani +3Figurative Language Understanding Arabic NLP
1SOAS University of London, United Kingdom · 2CRC 1646 ‘Linguistic Creativity in Communication’, Bielefeld University, Germany · 3Computational Linguistics, CLCG, University of Groningen, The Netherlands +2
PunGraph: Retrieval-Enhanced Phonetic-Semantic Graph Reasoning for Pun Understanding
Sep 15, 2026Yuchen Su, Zijian Huang, Yaotian Shi +6Figurative Language Understanding Knowledge Augmentation for Language Models
School of Computer Science, University of Auckland, New Zealand · School of Computer and Information Technology, Shanxi University · School of Electronic Engineering and Computer Science, Queen Mary University of London
BanglaMemeX: Advancing Cultural Metaphoric Image Interpretation in Bangla with a Multimodal Explainable Dataset
Sep 7, 2026Md. Sadman Sakib, Zisan Mahmud, Md. Fahim Arefin +1Figurative Language Understanding Multilingual VLM Evaluation
University of Dhaka · University of Texas at Dallas
Wisdom in Unity: The Role of Multilingual Training in Figurative Language Identification in Proverbs
Aug 8, 2026Rama Alomair, Remas Alsubaie, Walaa Saifalislam +5Figurative Language Understanding Multilingual Language Models
College of Computer and Information Sciences, King Saud University
Discovering Conceptual Metaphors Across Topics and Media Types
Aug 6, 2026Alexandria Leto, Rohan Das, Juan Vásquez +2Figurative Language Understanding Political Discourse Analysis
University of Colorado Boulder
M $^3$ R-Bench: A Unified Benchmark for Evidence-Grounded Multimodal Metaphor Understanding
Aug 6, 2026Hong Jiang, Junnan Zhu, Jingwang Huang +9Figurative Language Understanding Multimodal Reasoning
School of Computer Science, Chongqing University, Chongqing, China · Institute of Automation, Chinese Academy of Sciences, Beijing, China · Institute of Advanced Intelligence and Computing (IAIC), Agency for Science, Technology and Research (A*STAR), Singapore +3
Simile Understanding in Text-to-Image Models: An Evaluation Framework
Aug 5, 2026Luecheng Wang, Shintaro Ozaki, Hidetaka Kamigaito +4Figurative Language Understanding Vision-Language Grounding
The University of Tokyo · Nara Institute of Science and Technology · Chungnam National University +1
Easy to Complete, Hard to Choose: Investigating LLM Performance on the ProverbIT Benchmark
Aug 5, 2026Enrico Mensa, Lorenzo Zane, Calogero Jerik Scozzaro +3Figurative Language Understanding LLM Evaluation
Department of Computer Science, University of Turin, Turin, Italy · Independent Researcher
Towards End-to-End Multilingual Metaphor Processing: Integrating Detection, Translation, and Evaluation
Aug 4, 2026Jiahui Liang, Lifeng HanFigurative Language Understanding Machine Translation
Centre for Linguistics, Humanities, Leiden University, NL · LIACS, Leiden University, NL · BDS, Leiden University Medical Centre, NL
VIVID: A Culturally Grounded Benchmark Exposing the Figurative Language Gap in Vietnamese NLP
Aug 4, 2026Tu Tran Do, Nhat Ngoc Nguyen, Khanh-Tung Tran +3Figurative Language Understanding Multilingual Language Model Evaluation
Posts and Telecommunications Institute of Technology (PTIT), Vietnam · School of Computer Science and Information Technology, University College Cork, Ireland
CAMMAR: Culture-Aware Matryoshka for Metaphorical Arabic Representations
Jul 17, 2026Suzan Awinat, Alfonso Ortega del PuenteFigurative Language Understanding Arabic NLP
Department of Computer Engineering Autonomous University of Madrid (UAM) School of Science and Technology IE University Madrid, Spain · Department of Computer Science Oviedo University Asturias, Spain
Conceptual Networks for Cross-Linguistic Idiomatic Expressions: A Feature-Based Graph Approach
Jul 10, 2026Kiran Pala, Punam Silu, Luxin YuFigurative Language Understanding Semantic Mapping
University of Eastern Finland, Finland · Indian Institute of Technology Ropar, India
G-IdiomAlign: A Gloss-Pivoted Benchmark for Cross-Lingual Idiom Alignment
Jun 17, 2026Fengying Ye, Yanming Sun, Runzhe Zhan +3Figurative Language Understanding Multilingual Language Model Evaluation
NLP2CT Lab, Department of Computer and Information Science, University of Macau · Faculty of Arts and Humanities, University of Macau
As Easy as Rocket Science: Assessing the Ability of Large Language Models to Interpret Negation in Figurative Language
Jun 17, 2026Jasmine Owers, Edwin Simpson, Martha LewisFigurative Language Understanding Prompt Sensitivity
Intelligent Systems Lab University of Bristol UK · ILLC University of Amsterdam The Netherlands
FigSIM: A Dataset for Fine-grained Suicide Severity and Figurative Language in Suicide Memes
Jun 1, 2026Liuliu Chen, Elise R. Carrotte, Brian E. Chapman +2Figurative Language Understanding Social Media Analysis
School of Computing and Information Systems, University of Melbourne, Australia · Orygen, The National Centre of Excellence in Youth Mental Health, Australia · Centre for Youth Mental Health, University of Melbourne, Australia +1
Multilingual Idioms in Sentences and Conversations Across High-, Medium-, and Low-Resource Languages
Jun 1, 2026Saeed Almheiri, Bilal Elbouardi, Salsabila Zahirah Pranida +16Figurative Language Understanding Multilingual Language Models
1Mohamed bin Zayed University of Artificial Intelligence · University of Hamburg · 3Manipal University +4
MetaphorVU: Towards Metaphorical Video Understanding
May 25, 2026Zhuoqun Li, Boxi Cao, Guiping Jiang +13VLM Evaluation Figurative Language Understanding
Chinese Information Processing Laboratory, Institute of Software, Chinese Academy of Sciences · University of Chinese Academy of Sciences · Kuaishou Technology +1
IdioLink: Retrieving Meaning Beyond Words Across Idiomatic and Literal Expressions
May 21, 2026Kai Golan Hashiloni, Daniel Fadlon, Lior Livyatan +3Figurative Language Understanding Semantic Search
Data Science Institute, Reichman University, Herzliya, Israel · EfiArazi School of Computer Science, Reichman University, Herzliya, Israel · Vrije Universiteit Amsterdam, The Netherlands
Post-Hoc Understanding of Metaphor Processing in Decoder-Only Language Models via Conditional Scale Entropy
May 20, 2026Lawhori Chakrabarti, Jennifer Johnson-Leung, Bert Baumgaertner +3Figurative Language Understanding Transformer Interpretability
Department of Computer Science, University of Idaho, Moscow ID 83844, USA · Department of Mathematics and Statistical Science, University of Idaho, Moscow ID 83844, USA · Department of Politics and Philosophy, University of Idaho, Moscow ID 83844, USA +2
SiNFluD: Creating and Evaluating Figurative Language Dataset for Sindhi
May 2, 2026Wazir Ali, Adeeb Noor, Saifullah TumraniFigurative Language Understanding Text Classification
Department of Data Science, Quaid-e-Awam University of Engineering, Science and Technology, Nawabshah, Pakistan. · SoloGenAI Pvt. Ltd. · Department of Information Technology, Faculty of Computing and Information Technology, King Abdulaziz University, Jeddah, Saudi Arabia. +1
IdiomX A Multilingual Benchmark for Idiom Understanding, Retrieval, and Interpretation
Apr 25, 2026Ayman Ali ShararaFigurative Language Understanding Multilingual Language Model Evaluation
MSc Data Science & Machine Learning (SPOC S21) Data ScienceTech Institute (DSTI)
Exploring Concreteness Through a Figurative Lens
Apr 20, 2026Saptarshi Ghosh, Tianyu JiangFigurative Language Understanding LLM Interpretability
University of Cincinnati
More Than Meets the Eye: Measuring the Semiotic Gap in Vision-Language Models via Semantic Anchorage
Apr 19, 2026Wei HeVLM Evaluation Figurative Language Understanding
IDSAI, University of Exeter Exeter, UK

Sep 29, 2026, cs.CLJ/K move · Enter open · S save

It's Not What the Image Shows: Irrelevant Context Destabilises VLM Judges Without Informing Them

Nagham Omar, Mahmoud Jabarin, Kinan Ibraheem, Lotem Peled-Cohen

Faculty of Data and Decision Sciences, Technion

VLM Evaluation Figurative Language Understanding VLM Robustness Counterfactual Evaluation of VLMs Vision-Language Model-as-a-Judge

Open paper AskPDF arXiv

Vision-language models (VLMs) are increasingly used in place of human annotators, making it important that substitutability tests reflect the model rather than incidental evaluation conditions. We introduce MIST, the Misleading-Image Stress Test: 200 English sentences, each built around a phrase readable either figuratively or literally and shown with an aligned image depicting its reading, a misleading image depicting the opposite, or no image at all. The guidelines require the label to be decided from the sentence alone, so no image should change any answer. We expected each image to pull a judge's labels toward the sense it depicts, and neither kind did. Across thirteen VLM judges, an aligned image changed 20.5% of labels and a misleading one 19.4%, close for every judge and both above the 11.6% produced by deleting the ignore-the-image instruction with the image left in place. Yet only 37% of the labels that differ between the two images moved toward the sense shown, and agreement with our human annotators is unchanged whether the image is absent, aligned or misleading. The effect is smaller in the seven judges that pass the alt-test than in the six that never do, but present in all of them: what moves a judge is that an image is there, not which of the two it is, so a substitutability verdict describes a configuration as much as a model.

Momentum

Related topics

Latest papers 24