Multimodal QA

QA: Question Answering

Overview

Multimodal question answering studies how models interpret visual, audio, and document evidence alongside language to answer questions, often requiring evidence to be combined across time, pages, or sources. Common approaches include vision-language models, retrieval-augmented generation, tool-using agents, and specialized training for tasks such as chart, medical, and video QA. Benchmarks increasingly test long-context and multi-hop reasoning, evidence localization, temporal understanding, and whether systems know when to abstain. A central challenge is making answers reliably grounded and verifiable while controlling errors, inference cost, and sensitivity to prompts and evaluation methods.

Latest papers

CardsList

195 papers19 papers in the last four weeks, up 12% on the four weeks before. 0.1% of all new papers.

  1. Proof-of-Perception: Certified Tool-Using Multimodal Reasoning with Compositional Conformal Guarantees

    Feb 27, 2026Arya Fayyazi, Haleh AkramiMultimodal ReasoningMultimodal Tool Use

  2. MM-NeuroOnco: A Multimodal Benchmark and Instruction Dataset for MRI-Based Brain Tumor Diagnosis

    Feb 26, 2026Feng Guo, Jiaxiang Liu, Yang Li +2Medical Image BenchmarksBrain MRI

  3. Exploring Multimodal LMMs for Online Episodic Memory Question Answering on the Edge

    Feb 25, 2026Giuseppe Lando, Rosario Forte, Antonino FurnariMultimodal QAEpisodic Memory

  4. RA-QA: A Benchmarking System for Respiratory Audio Question Answering Under Real-World Heterogeneity

    Feb 4, 2026Gaia A. Bertolino, Yuwei Zhang, Tong Xia +2Audio-Language Model EvaluationAudio QA

  5. EEmo-Logic: A Unified Dataset and Multi-Stage Framework for Comprehensive Image-Evoked Emotion Assessment

    Feb 1, 2026Lancheng Gao, Ziheng Jia, Zixuan Xing +4Multimodal Large Language ModelsMultimodal QA

  6. DeALOG: Decentralized Multi-Agents Log-Mediated Reasoning Framework

    Feb 1, 2026Abhijit Chakraborty, Ashish Raj Shekhar, Shiven Agarwal +1Multi-Agent CollaborationMultimodal QA

  7. Query-Guided Spatial-Temporal-Frequency Interaction for Music Audio-Visual Question Answering

    Jan 27, 2026Kun Li, Michael Ying Yang, Sami Sebastian BrandtMultimodal QAAudio-Visual QA

  8. AVMeme Exam: A Multimodal Multilingual Multicultural Benchmark for LLMs' Contextual and Cultural Knowledge and Thinking

    Jan 25, 2026Xilin Jiang, Qiaolin Wang, Junkai Wu +30Audio-Visual UnderstandingMultimodal Large Language Models

  9. SpatialMosaic: A Multiview VLM Dataset for Partial Visibility

    Dec 29, 2025Kanghee Lee, Jungi Hong, Sion Lee +4Multi-View ConsistencyOcclusion Reasoning

  10. Unexplored flaws in multiple-choice VQA make benchmarking unreliable

    Nov 27, 2025Fabio Rosenthal, Sebastian Schmidt, Thorsten Graf +3Visual Question AnsweringPrompt Sensitivity

  11. WaymoQA: A Multi-View Visual Question Answering Dataset for Safety-Critical Reasoning in Autonomous Driving

    Nov 25, 2025Seungjun Yu, Seonho Lee, Namho Kim +5Autonomous Driving DatasetsVisual Question Answering

  12. DocHop-QA: Towards Multi-Hop Reasoning over Multimodal Document Collections

    Aug 20, 2025Jiwon Park, Seohyun Pyeon, Jinwoo Kim +4Multi-Hop QAScientific QA

  13. Copy-Move Forgery Detection and Question Answering for Remote Sensing Image

    Dec 3, 2024Ze Zhang, Enyuan Zhao, Di Niu +3Remote Sensing Image UnderstandingImage Forgery Detection