Multimodal QA

QA: Question Answering

Follow this topic Ask about this topic

Momentum

11 papers in the last four weeks, up 22% on the four weeks before. 0.1% of all new papers.

Jul 13Week of Sep 28

Latest papers 131

All topics

From Scenes to Elements: Multi-Granularity Evidence Retrieval for Verifiable Multimodal RAG
May 14, 2026Guanhua Chen, Chuyue Huang, Yutong Yao +4Multimodal RAG Multimodal Grounding
NLP2CT Lab, Department of Computer and Information Science, University of Macau
Multilingual OCR-Aware Fine-Tuning and Prompt-Guided Chain-of-Thought Reasoning for Multimodal Large Language Models
May 13, 2026Qinwu Xu, Yifan Jiang, Haoyu RenMultimodal Grounding CoT Reasoning
Meta AI · UT Austin · Current independent researcher
FIND: Toward Multimodal Financial Reasoning and Question Answering for Indic Languages
May 13, 2026Sarmistha Das, Vaibhav Vishal, Syed Ibrahim Ahmad +2Financial Services Financial QA
Indian Institute of Technology Patna, India · Microsoft, India
Instruct-ICL: Instruction-Guided In-Context Learning for Post-Disaster Damage Assessment
May 12, 2026Armin Zarbaft, Ehsan Karimi, Nhut Le +1Disaster Damage Assessment LLM Prompting
Lehigh Uniersity Pennsylvania, USA
Separate First, Fuse Later: Mitigating Cross-Modal Interference in Audio-Visual LLMs Reasoning with Modality-Specific Chain-of-Thought
May 11, 2026Xuanchen Li, Yuheng Lu, Chenrui Cui +6Cross-Modal Learning Multimodal QA
Tianjin Key Laboratory of Cognitive Computing and Application, Tianjin University, Tianjin, China · Tencent, China · Huiyan Technology Company, Ltd., Tianjin, China +1
DocScope: Benchmarking Verifiable Reasoning for Trustworthy Long-Document Understanding
May 9, 2026Xiang Feng, Jiawei Zhou, Zhangfeng Huang +6LLM Grounding LLM Answer Verification
School of Computer Science, National Engineering Research Center for Multimedia Software and Hubei Key Laboratory of Multimedia and Network Communication Engineering, Wuhan University, China · Alibaba Group, Hangzhou, China · Independent Researcher +1
Omni-DeepSearch: A Benchmark for Audio-Driven Omni-Modal Deep Search
May 9, 2026Tao Yu, yiming ding, Shenghua Chai +16Multi-Hop QA Multimodal IR
CASIA · UCAS · BAAI +2
A Dialogue-Based Framework for Correcting Multimodal Errors in AI-Assisted STEM Education
May 5, 2026Akshay Syal, Lawrence Swaminathan Xavier Prince, Evin Gultepe +2Multimodal Robustness AI in Education
KARMA-MV: A Benchmark for Causal Question Answering on Music Videos
May 5, 2026Archishman Ghosh, Abhinaba Roy, Dorien HerremansAudio-Visual Understanding Video QA
AMAAI Lab, Singapore University of Technology and Design
DiagramNet: An End-to-End Recognition Framework and Dataset for Non-Standard System-Level Diagrams
May 2, 2026Jincheng Lou, Ruohan Xu, Jiapeng Li +6Multi-Agent LLM Systems Electronic Design Automation
School of IC, Peking University, Beijing, China · College of Artificial Intelligence, Xi’an Jiaotong University, Xi’an, China · Department of Precision Instruments, Tsinghua University, Beijing, China +4
Learning from Medical Entity Trees: An Entity-Centric Medical Data Engineering Framework for MLLMs
Apr 28, 2026Jianghang Lin, Haihua Yang, Deli Yu +6Training Data Curation Multimodal QA
Key Laboratory of Multimedia Trusted Perception and Efficient Computing, Ministry of Education of China, Xiamen University, China · ByteDance · Northeastern University
M $^3$ -VQA: A Benchmark for Multimodal, Multi-Entity, Multi-Hop Visual Question Answering
Apr 28, 2026Jiatong Ma, Longteng Guo, Yuchen Liu +4Multimodal RAG Visual Question Answering
Institute of Automation, Chinese Academy of Sciences · School of Artificial Intelligence, University of Chinese Academy of Sciences
Can Multimodal Large Language Models Truly Understand Small Objects?
Apr 24, 2026Fujun Han, Junan Chen, Xintong Zhu +4Multimodal QA Multimodal Model Evaluation
Shanghai AI Laboratory · The Chinese University of Hong Kong, Shenzhen · University of Science and Technology of China +2
ChangeQuery: Advancing Remote Sensing Change Analysis for Natural and Human-Induced Disasters from Visual Detection to Semantic Understanding
Apr 24, 2026Dongwei Sun, Jing Yao, Kan Wei +6Remote Sensing Image Understanding Disaster Damage Assessment
School of Computer Science and Technology and the Ministry of Education Key Lab for Intelligent Networks and Network Security, Xi’an Jiaotong University, Xi’an 710049, China · State Key Laboratory of Remote Sensing and Digital Earth, Aerospace Information Research Institute, Chinese Academy of Sciences, Beijing, 100094, China · State Key Laboratory of Information Engineering in Surveying, Mapping and Remote Sensing, Wuhan University, China +4
Towards Temporal Compositional Reasoning in Long-Form Sports Videos
Apr 24, 2026Siyu Cao, Lu Zhang, Ruizhe Zeng +1Temporal Video Grounding Temporal Reasoning
MAIS, Institute of Automation, Chinese Academy of Sciences, Beijing 100190, China · School of Artificial Intelligence, University of Chinese Academy of Sciences, Beijing 100049, China · Nanjing Artificial Intelligence Research of IA, Nanjing, 211100, China
ProcessThinker: Enhancing Multi-modal Large Language Models Reasoning via Rollout-based Process Reward
Apr 23, 2026Jingpei Wu, Xiao Han, Weixiang Shen +3Process Reward Models Multimodal QA
LMU Munich · Harvard University · University of Cambridge +2
AUDITA: A New Dataset to Audit Humans vs. AI Skill at Audio QA
Apr 23, 2026Tasnim Kabir, Dmytro Kurdydyk, Aadi Palnitkar +3Audio QA Audio Reasoning
University of Maryland · Davidson College · Columbia University +1
Do MLLMs Understand Pointing? Benchmarking and Enhancing Referential Reasoning in Egocentric Vision
Apr 23, 2026Chentao Li, Zirui Gao, Mingze Gao +3Multimodal QA Vision-Language Grounding
Department of Automation, Tsinghua University · Academy of Art & Design, Tsinghua University
HiCrew: Hierarchical Reasoning for Long-Form Video Understanding via Question-Aware Multi-Agent Collaboration
Apr 23, 2026Yuehan Zhu, Jingqi Zhao, Jiawen Zhao +2Multi-Agent Collaboration Multimodal QA
School of Artificial Intelligence, Sun Yat-sen University, China
ARFBench: Benchmarking Time Series Question Answering Ability for Software Incident Response
Apr 23, 2026Stephan Xie, Ben Cohen, Mononito Goswami +6Time Series Reasoning Time Series QA
Machine Learning Department, Carnegie Mellon University, Pittsburgh, PA, USA · Datadog AI Research, New York, NY, USA · Amazon Web Services, Seattle, WA, USA
RSRCC: A Remote Sensing Regional Change Comprehension Benchmark Constructed via Retrieval-Augmented Best-of-N Ranking
Apr 22, 2026Roie Kazoom, Yotam Gigi, George Leifman +2Multimodal QA Remote Sensing Benchmarks
Google Research
WildFireVQA: A Large-Scale Radiometric Thermal VQA Benchmark for Aerial Wildfire Monitoring
Apr 22, 2026Mobin Habibpour, Niloufar Alipour Talemi, John Spodnik +2Thermal Imaging Visual Question Answering
Clemson University
A-MAR: Agent-based Multimodal Art Retrieval for Fine-Grained Artwork Understanding
Apr 21, 2026Shuai Wang, Hongyi Zhu, Jia-Hong Huang +6Multimodal RAG Multimodal Grounding
University of Amsterdam · Part of this work was done during interning at Amazon. · Also with Amazon AGI. +2
DR-MMSearchAgent: Deepening Reasoning in Multimodal Search Agents
Apr 21, 2026Shengqin Wang, Wentao Yan, Huichi Zhou +4Reward Shaping RL for Language Model Reasoning
East China Normal University · University College London · Huawei Noah’s Ark Lab +2
Where to Focus: Query-Modulated Multimodal Keyframe Selection for Long Video Understanding
Apr 19, 2026Shaoguang Wang, Weiyu Guo, Ziyang Chen +2Multimodal Large Language Models Multimodal QA
Thrust of Artificial Intelligence, HKUST (Guangzhou) Guangzhou, China · Department of CSE, HKUST Hong Kong SAR, China
LFRAG: Layout-oriented Fine-grained Retrieval-Augmented Generation on Multimodal Document Understanding
Apr 18, 2026Yifan Zhu, Yu Mi, Yue Lu +2Multimodal RAG Late Interaction Retrieval
Zhejiang University · Hangzhou, China · Institute of Blockchain and Data Security +1
Knowing When Not to Answer: Evaluating Abstention in Multimodal Reasoning Systems
Apr 16, 2026Nishanth Madhusudhan, Vikas Yadav, Alexandre LacosteMultimodal QA Multimodal Reasoning
ServiceNow Research
SynMulti: Synthetic-to-Real Learning for Multimodal Video Understanding
Apr 14, 2026Tanzila Rahman, Renjie Liao, Leonid SigalSynthetic-to-Real Domain Adaptation Synthetic Data Augmentation
University of British Columbia · Vector Institute for AI · Canada CIFAR AI Chair
BUZZY: Contrastive Scoring to Mitigate Text-Induced Bias in Multimodal Multiple-Choice QA
Mar 30, 2026Taeyun Roh, Suhyeong Park, Dongyoung Lee +4Vision-Language Models Multimodal QA
Korea University · AIGEN Sciences · KAIST +1
HiMu: Hierarchical Multimodal Frame Selection for Long Video Question Answering
Mar 19, 2026Dan Ben-Ami, Gabriele Serussi, Kobi Cohen +1Multimodal Large Language Models Multimodal QA
INSIGHT Lab, Ben-Gurion University of the Negev, Israel · Ben-Gurion University of the Negev, Israel

May 14, 2026, cs.CLJ/K move · Enter open · S save

From Scenes to Elements: Multi-Granularity Evidence Retrieval for Verifiable Multimodal RAG

Guanhua Chen, Chuyue Huang, Yutong Yao, Shudong Liu+3

NLP2CT Lab, Department of Computer and Information Science, University of Macau

Multimodal RAG Multimodal Grounding Multimodal QA Information Retrieval Fine-Grained Visual Perception Multimodal Understanding

Open paper AskPDF arXiv

Multimodal Retrieval-Augmented Generation (RAG) systems retrieve evidence at coarse granularities (entire images or scenes), creating a mismatch with fine-grained user queries and making failures unverifiable. We introduce GranuVistaVQA, a multimodal benchmark featuring real-world landmarks with element-level annotations across multiple viewpoints, capturing the partial observation challenge where individual images contain only subsets of entities. We further propose GranuRAG, a multi-granularity framework that treats visual elements as first-class retrieval units through three stages: element-level detection and classification, multi-granularity cross-modal alignment for evidence retrieval, and attribution-constrained generation. By grounding retrieval at the element level rather than relying on implicit attention, our approach enables transparent error diagnosis. Experiments demonstrate that GranuRAG achieves up to 29.2% improvement over six strong baselines for this task.

Momentum

Related topics

Latest papers 131