Multimodal QA

QA: Question Answering

Follow this topic Ask about this topic

Momentum

11 papers in the last four weeks, up 22% on the four weeks before. 0.1% of all new papers.

Jul 13Week of Sep 28

Latest papers 131

All topics

Multi-Agent Debate and Visual Information Extraction for SeePhys Pro: A 1st-Place Technical Report from ICML 2026 AI4Math Track 3 Challenge
Jul 24, 2026Jiseok Kwak, Suhyeon Jo, Taewoo Kim +3Visual Question Answering Multi-Agent Debate
KAIST
TAP-RAG: Task-Aware Policy Control for Long-Document Multimodal Question Answering
Jul 21, 2026Zhong Ji, Keqi Jin, Yan Zhang +1Multimodal RAG Retrieval-Augmented Generation
School of Electrical and Information Engineering, Tianjin University · The International Joint Institute of Tianjin University, Fuzhou, Tianjin University · Department of Automation, Tsinghua University
Querying Multimodal Scientific Papers with AI: Practices and Preferences Across Blind, Low-Vision, and Sighted Scientists
Jul 20, 2026Arnavi Chheda-Kothary, Lucy Lu Wang, Joseph Chee Chang +1Multimodal Large Language Models Scientific QA
Paul G. Allen School of Computer Science & Engineering University of Washington Seattle, WA, USA · Allen Institute for AI · The Information School University of Washington Allen Institute for AI Seattle, WA, USA +1
Audio-Visual Flamingo: Open Audio-Visual Intelligence for Long and Complex Videos
Jul 17, 2026Sreyan Ghosh, Arushi Goel, Kaousheik Jayakumar +19Audio-Visual Understanding Multimodal Large Language Models
1NVIDIA, USA · University of Maryland, USA
Reinforcing Egocentric Spatial Perception in Multimodal Large Language Models via Ego Scene Augmentation
Jul 16, 2026Chi Kit Wong, Ye Pan, Yuanhuiyi Lyu +6Visual Question Answering Visual Spatial Reasoning
The Hong Kong University of Science and Technology (Guangzhou) · Guangxi Zhuang Autonomous Region Information Center · The Hong Kong University of Science and Technology
EvoGraph-R1: Self-Evolving Multimodal Knowledge Hypergraphs for Agentic Retrieval
Jul 14, 2026Jiashi Lin, Changhong Jiang, Xiangru Lin +12Multimodal RAG Graph Retrieval-Augmented Generation
1Northwestern Polytechnical University · 3The University of Hong Kong · 5The Chinese University of Hong Kong (Shenzhen) +2
LakeQuest: A Three-Domain Benchmark for Grounded Question Answering across Data Lakes
Jul 14, 2026Michael Solodko, Steven Gong, Guangwei Yu +3Multimodal QA Agentic Retrieval
University of Waterloo · Layer 6 AI
Trust Before Fusion: QIMG-7 and Source-Aware Resolution for Polluted Multimodal RAG
Jul 12, 2026Saadeldine Eletter, Owais Aijaz, Preslav NakovMultimodal RAG Retrieval-Augmented Generation
Mohamed bin Zayed University of Artificial Intelligence
UNIBROWSE: A Data-to-Agent Framework for Multimodal BrowseComp
Jul 12, 2026Xiyu Wei, Qingwei Zong, Zhuocheng Yu +1Multimodal QA AI Agent Benchmarks
Key Laboratory of Computational Linguistics, MOE, Peking University · School of Software and Microelectronics, Peking University · School of Computer Science, Peking University
Empowering Long-form Omni-modal Understanding with Robust Audio Perception
Jul 11, 2026Kaiying Yan, Luoyi Sun, Xiao Zhou +1Audio-Visual Understanding Multimodal Pretraining
SAI, Shanghai Jiao Tong University, shanghai, China · Zhejiang University, Hangzhou, Zhejiang, china · Shanghai AI Lab, shanghai, China
What Does Your Short-Answer VQA Score Actually Measure? Evaluator-Dependent Instability in Multimodal Short-Answer Benchmarks
Jul 11, 2026Guanhua Ye, Niu Jingbin, Yan Li +4VLM Evaluation Visual Question Answering
Beijing University of Posts and Telecommunications Beijing, China
Task-Specific Multimodal Question Answering Agents via Confidence Calibration and Incremental Reasoning for QANTA 2026
Jul 10, 2026Nirjhar Das, Md. Al-Mamun ProvathQuestion Answering Multimodal QA
Department of Computer Science and Engineering, Chittagong University of Engineering & Technology, Chattogram, Bangladesh.
Ground3D-LMM: Fine-Grained 3D Point Grounding and Spatial Reasoning with LMM
Jul 6, 2026Amol Harsh, Zongyan Han, Jean Lahoud +53D Spatial Reasoning Multimodal QA
Mohamed bin Zayed University of Artificial Intelligence · The Hong Kong Polytechnic University · Linköping University
Seeing Once is Enough? Online Geometry-Aware Token Pruning for 3D Question Answering
Jul 5, 2026Ruei-Chi Lai, Bolivar Solarte, Chin-Hsuan Wu +2Efficient VLM Inference Multimodal QA
National Tsing Hua University · Industrial Technology Research Institute ITRI · University of Toronto +1
Q-TriM: Question-Guided Tri-Modal Attention for Audio-Visual Question Answering
Jul 4, 2026SungHun Kim, SeungJun BaekMultimodal QA Cross-Modal Attention
Dept. of Computer Science and Engineering Korea University Seoul, South Korea
Modality Relevance is not Modality Utility: Post-hoc Selective Modality Escalation for Cost-Aware Multimodal RAG
Jul 3, 2026Xue Li, Yiming GaiMultimodal RAG Efficient Multimodal Inference
Hangzhou International Innovation Institute, Beihang University Hangzhou, China
EduArt: An educational-level benchmark for evaluating art history knowledge in large language models
Jul 2, 2026Gianmarco Spinaci, Lukas Klic, Giovanni ColavizzaEducational Assessment Multimodal QA
Department of Classical Philology and Italian Studies, University of Bologna, Bologna, Italy · Villa i Tatti – The Harvard University Center for Italian Renaissance Studies, Firenze, Italy · Center for Computational and Digital Humanities, University of Copenhagen, Copenhagen, Denmark
MultAttnAttrib: Training-Free Multimodal Attribution in Long Document Question Answering
Jul 1, 2026Dang Quang Thien Tran, Quang V. Dang, Vinamra Tyagi +7Multimodal QA Document QA
University of Massachusetts, Amherst · 2Adobe Research, San Jose
Towards Developing a Multimodal Chat Assistant for University Stakeholders: RAG-based Approach
Jul 1, 2026Md Abu Hanif Shaikh, Abdullah Al ShafiMultimodal RAG Multimodal QA
Institute of Information and Communication Technology, Khulna University of Engineering & Technology, Khulna, Bangladesh
TACO: Tool-Augmented Credit Optimization for Agentic Tool Use
Jun 29, 2026Mingkuan Feng, Jinyang Wu, Hao Gu +5Tool Use in VLMs Multimodal QA
Department of Automation, BNRist, Tsinghua University · Institute of Automation, Chinese Academy of Sciences
Hybrid Retriever Evolution for Multimodal Document Reasoning Agents
Jun 28, 2026Bohan Yao, Shruthan Radhakrishna, Vikas YadavMultimodal RAG Multimodal QA
1ServiceNow · University of Washington
CORTEX: A Structured Reasoning Benchmark for Trustworthy 3D Chest CT MLLMs
Jun 25, 2026Hashmat Shadab Malik, Anees Ur Rehman Hashmi, Numan Saeed +3Radiology Report Generation 3D Medical Imaging
MBZUAI, Abu Dhabi, UAE · Hasso Plattner Institute, Potsdam, Germany · Khalifa University, Abu Dhabi, UAE
FlameVQA: A Physically-Grounded UAV Wildfire VQA Benchmark with Radiometric Thermal Supervision
Jun 25, 2026Mobin Habibpour, John Spodnik, Niloufar Alipour Talemi +1VLM Evaluation Visual Question Answering
Clemson University · Clemson, SC, USA
ViTexQA: A Multi-Frame Temporal Perception Dataset for Video Text Question Answering
Jun 23, 2026Zhentao Guo, Chen Duan, Tongkun Guan +3Multimodal Large Language Models Video QA
Meituan · Shanghai Jiao Tong University
Ground Then Rank: Revisiting Knowledge-Based VQA with Training-Free Entity Identification
Jun 22, 2026Qian Ma, Qiong Wu, Zhengyi Zhou +1Multimodal RAG Visual Question Answering
Rensselaer Polytechnic Institute · AT&T Chief Data Office
Efficient Multimodal Clinical Question Answering for Pulmonary Embolism Risk Assessment
Jun 21, 2026Xiangyuan Xue, Yang Yu, Yan Gao +5Efficient Multimodal Inference Multimodal QA
University of Auckland, Auckland, New Zealand · University of Cambridge, Cambridge, United Kingdom · University of Adelaide, Adelaide, Australia +1
EvidenceLens: A Claim-Evidence Matrix for Auditing Financial Question Answering
Jun 19, 2026Fengchen Gu, Xiaotian Ren, Zhengyong Jiang +6Data Visualization LLM Answer Verification
School of AI and Advanced Computing, XJTLU Entrepreneur College (Taicang), Xi’an Jiaotong-Liverpool University, Suzhou, Jiangsu, China · ETSI de Telecomunicaci´on, Universidad Polit´ecnica de Madrid, Madrid, Spain
CogniRoute: Learning to Route Social Evidence in Omni-Modal Models
Jun 18, 2026Yifan Shen, Pei Tian, Xinzhuo Li +8RL for Language Model Reasoning Mixture-of-Experts Inference
University of Illinois Urbana-Champaign · 2Columbia University · 3Google
Confidence Calibration for Multimodal LLMs: An Empirical Study through Medical VQA
Jun 18, 2026Yuetian Du, Yucheng Wang, Ming Kong +4Multimodal QA Language Model Calibration
College of Computer Science and Technology, Zhejiang University · School of Computer Science and Technology, Xidian University · Zhihui Medical Technology (Shanghai) Co., Ltd., Shanghai, China +1
VinQA: Visual Elements Interleaved Long-form Answer Generation for Real-World Multimodal Document QA
Jun 15, 2026Young Rok Jang, Hyesoo Kong, Kyunghwan An +3VLM Evaluation Multimodal Large Language Models
LG AI Research

Jul 24, 2026, cs.LGJ/K move · Enter open · S save

Multi-Agent Debate and Visual Information Extraction for SeePhys Pro: A 1st-Place Technical Report from ICML 2026 AI4Math Track 3 Challenge

Jiseok Kwak, Suhyeon Jo, Taewoo Kim, Yeongmin Kim+2

KAIST

Visual Question Answering Multi-Agent Debate Multimodal QA

Open paper AskPDF arXiv

This technical report presents our approach to Challenge Track~3: SeePhys Pro at the 3rd AI for Math Workshop, where the task is to answer college-level physics questions whose statement and figure may be given partly or entirely as an image. Visual physics problems become substantially harder for large language models when the decisive information resides in a figure rather than in the text, and this modality gap widens as more of the problem migrates into the image. We address the task with a two-stage framework: a visual information extraction stage that re-expresses figure content as solver-readable text to close the modality gap, and a reasoning stage that orchestrates three heterogeneous solvers through multi-agent debate. Our analysis yields two findings: the gain from orchestration comes from reliable answer selection rather than from additional debate, and the value of a figure aid scales with how much of the problem is locked inside the image. The resulting pipeline improves overall accuracy over a single-agent baseline from 0.643 to 0.802 on the public split, and won 1st place on both the public and the private leaderboard (private overall 0.743).

Momentum

Related topics

Latest papers 131