Multimodal QA

QA: Question Answering

Overview

Multimodal question answering studies how models interpret visual, audio, and document evidence alongside language to answer questions, often requiring evidence to be combined across time, pages, or sources. Common approaches include vision-language models, retrieval-augmented generation, tool-using agents, and specialized training for tasks such as chart, medical, and video QA. Benchmarks increasingly test long-context and multi-hop reasoning, evidence localization, temporal understanding, and whether systems know when to abstain. A central challenge is making answers reliably grounded and verifiable while controlling errors, inference cost, and sensitivity to prompts and evaluation methods.

Latest papers

CardsList

195 papers19 papers in the last four weeks, up 12% on the four weeks before. 0.1% of all new papers.

  1. EuropeMedQA Study Protocol: A Multilingual, Multimodal Medical Examination Dataset for Language Model Evaluation

    Apr 15, 2026Francesco Andrea Causio, Vittorio De Vita, Olivia Riccomi +17Multilingual Language Model EvaluationMultilingual VLM Evaluation

  2. MultiDocFusion: Hierarchical and Multimodal Chunking Pipeline for Enhanced RAG on Long Industrial Documents

    Apr 14, 2026Joongmin Shin, Chanjun Park, Jeongbae Park +2Document ChunkingMultimodal RAG

  3. SynMulti: Synthetic-to-Real Learning for Multimodal Video Understanding

    Apr 14, 2026Tanzila Rahman, Renjie Liao, Leonid SigalSynthetic-to-Real Domain AdaptationSynthetic Data Augmentation

  4. PaperScope: A Multi-Modal Multi-Document Benchmark for Agentic Deep Research Across Massive Scientific Papers

    Apr 13, 2026Lei Xiong, Huaying Yuan, Zheng Liu +2AI Agent BenchmarksMultimodal Model Evaluation

  5. BoxTuning: Directly Injecting the Object Box for Multimodal Model Fine-Tuning

    Apr 13, 2026Zekun Qian, Ruize Han, Wei FengMultimodal Large Language ModelsMultimodal QA

  6. S3Mem: Structured Spatiotemporal Scene-Event Memory for Long-Horizon Interactive Question Answering

    Apr 10, 2026Encheng Su, Jianyu Wu, Jinouwen Zhang +9Long-Term Conversational MemoryTemporal QA

  7. MTA-Agent: An Open Recipe for Multimodal Deep Search Agents

    Apr 7, 2026Xiangyu Peng, Can Qin, An Yan +4Multimodal Search AgentsMultimodal QA

  8. HippoCamp: Benchmarking Contextual Agents on Personal Computers

    Apr 1, 2026Zhe Yang, Shulin Tian, Kairui Hu +9AI Agent BenchmarksMultimodal Search Agents

  9. CiQi-Agent: Aligning Vision, Tools and Aesthetics in Multimodal Agent for Cultural Reasoning on Chinese Porcelains

    Mar 30, 2026Wenhan Wang, Zhixiang Zhou, Zhongtian Ma +8Cultural HeritageCultural Knowledge in Language Models

  10. BUZZY: Contrastive Scoring to Mitigate Text-Induced Bias in Multimodal Multiple-Choice QA

    Mar 30, 2026Taeyun Roh, Suhyeong Park, Dongyoung Lee +4Vision-Language ModelsMultimodal QA

  11. EuraGovExam: A Multilingual Multimodal Benchmark from Real-World Civil Service Exams

    Mar 28, 2026Jaeseong Kim, Chaehwan Lim, Sang Hyun Gil +1Multilingual VLM EvaluationMultimodal QA

  12. AD-Reasoning: Multimodal Guideline-Guided Reasoning for Alzheimer's Disease Diagnosis

    Mar 25, 2026Qiuhui Chen, Yushan Deng, Xuancheng Yao +1Alzheimer's Disease ClassificationMedical Diagnosis

  13. Click-to-Ask: An AI Live Streaming Assistant with Offline Copywriting and Online Interactive QA

    Mar 19, 2026Ruizhi Yu, Keyang Zhong, Peng Liu +5E-CommerceConversational Agents

  14. HiMu: Hierarchical Multimodal Frame Selection for Long Video Question Answering

    Mar 19, 2026Dan Ben-Ami, Gabriele Serussi, Kobi Cohen +1Multimodal Large Language ModelsMultimodal QA

  15. Caption First, VQA Second: Knowledge Density, Not Task Format, Drives Multimodal Scaling

    Mar 17, 2026Hongjian Zou, Yue Ge, Qi Ding +2Multimodal Large Language ModelsMultimodal Learning

  16. Attention-guided Evidence Grounding for Spoken Question Answering

    Mar 17, 2026Ke Yang, Bolin Chen, Yuejie Li +5Spoken QAMultimodal QA

  17. A Skill-augmented Agentic Framework and Benchmark for Multi-Video Understanding

    Mar 16, 2026Yue Zhang, Liqiang Jing, Jia Li +4Video UnderstandingMultimodal QA

  18. Agentic DAG-Orchestrated Planner Framework for Multi-Modal, Multi-Hop Question Answering in Hybrid Data Lakes

    Mar 15, 2026Kirushikesh D B, Manish Kesarwani, Nishtha Madaan +6Multi-Hop QAMultimodal QA

  19. MMOU: A Massive Multi-Task Omni Understanding and Reasoning Benchmark for Long and Complex Real-World Videos

    Mar 14, 2026Arushi Goel, Sreyan Ghosh, Vatsal Agarwal +16Multimodal UnderstandingMultimodal Reasoning

  20. SciMDR: Advancing Scientific Multimodal Document Reasoning

    Mar 12, 2026Ziyu Chen, Yilun Zhao, Chengye Wang +3Multimodal ReasoningMultimodal QA

  21. AutoViVQA: A Large-Scale Automatically Constructed Dataset for Vietnamese Visual Question Answering

    Mar 10, 2026Nguyen Anh Tuong, Phan Ba Duc, Nguyen Trung Quoc +4Visual Question AnsweringMultimodal QA

  22. MEGC2026: Micro-Expression Grand Challenge on Visual Question Answering

    Mar 9, 2026Xinqi Fan, Jingting Li, John See +3Micro-Expression RecognitionVideo QA

  23. BRIDGE: Benchmark for multi-hop Reasoning In long multimodal Documents with Grounded Evidence

    Mar 9, 2026Biao Xiang, Soyeon Caren Han, Yihao DingMulti-Hop QAMultimodal QA

  24. MAviS: A Multimodal Conversational Assistant For Avian Species

    Mar 7, 2026Yevheniia Kryklyvets, Mohammed Irfan Kurpath, Sahal Shaji Mullappilly +5Multimodal Large Language ModelsMultimodal QA

  25. TumorChain: Interleaved Multimodal Chain-of-Thought Reasoning for Traceable Clinical Tumor Analysis

    Mar 6, 2026Sijing Li, Zhongwei Qiu, Jiang Liu +22Radiology VLMsMultimodal CoT Reasoning

  26. Evaluating GPT-5 as a Multimodal Clinical Reasoner: A Landscape Commentary

    Mar 5, 2026Alexandru Florea, Shansong Wang, Mingzhe Hu +5Clinical ReasoningMultimodal QA

  27. AutothinkRAG: Complexity-Aware Control of Retrieval-Augmented Reasoning for Image-Text Interaction

    Mar 5, 2026Jiashu Yang, Chi Zhang, Abudukelimu Wuerkaixi +5Multimodal RAGMultimodal QA

  28. NICO-RAG: Multimodal Hypergraph Retrieval-Augmented Generation for Understanding the Nicotine Public Health Crisis

    Mar 2, 2026Manuel Serna-Aguilera, Raegan Anderes, Page Dobbs +1Hypergraph-Based RAGMultimodal RAG

  29. According to Me: Long-Term Personalized Referential Memory QA

    Mar 2, 2026Jingbiao Mei, Jinghong Chen, Guangyu Yang +3LLM MemoryMemory Agent Benchmarks

  30. MM-DeepResearch: A Simple and Effective Multimodal Agentic Search Baseline

    Mar 1, 2026Huanjin Yao, Qixiang Yin, Min Yang +5Multimodal Search AgentsMultimodal QA