Multiple-Choice Questions

Follow this field Ask about this field

Recent momentum

emerging

0 papers in the last 28 days · 0.0% of indexed attention

Twelve weeks of publication activity for this topic as it is defined today.

Weekly history

Recent digests

What was published in this field, kept on the site without email delivery.

Period ending 2026-09-21

11 new papers

A weekly snapshot of new work published in Multiple-Choice Questions.

Period ending 2026-09-14

13 new papers

A weekly snapshot of new work published in Multiple-Choice Questions.

Period ending 2026-09-07

12 new papers

A weekly snapshot of new work published in Multiple-Choice Questions.

Inside this field

Focused directions

Focused topic

Multi-Hop Question Answering Benchmarks

Within Multiple-Choice Questions

104 papersExplore

Focused topic

Multiple-Choice Questions

Within Multiple-Choice Questions

79 papersExplore

Focused topic

Question-Answer Pairs

Within Multiple-Choice Questions

34 papersExplore

Focused topic

Closed-Book Question Answering

Within Multiple-Choice Questions

18 papersExplore

228 papers

Latest in Multiple-Choice Questions

Browse all topics →

When No Answer Is Correct: Diagnosing Absent Answer Detection for MLLMs in Video Understanding
Jun 6, 2026Yiheng Wang, Yueqian Lin, Lichen Zhu +3Video Multimodal Large Language Models Video Understanding
SurgiQ: A Large-Scale Multi-Domain Benchmark for Evaluating Surgical Understanding in Large Language Models
Jun 6, 2026Ayah Al-Naji, Edoardo Fazzari, Saif Alkindi +3Gradient Surgery Benchmarking Large Language Models
RealDocBench: A Benchmark for Field-Level QA and Layout Understanding on Real-World Regulated Documents
Jun 5, 2026Ameya Joshi, Joon Kim, Gus Eggert +5Closed-Book Question Answering Layouts
mmPISA-bench: Do LLMs Reason Equally Well Across 43 Languages?
Jun 5, 2026Yerzhan Sapenov, Jaromir SavelkaMultilingual Reasoning Multilingual Benchmark
Improving Answer Extraction in Context-based Question Answering Systems Using LLMs
Jun 4, 2026Hafez Abdelghaffar, Ahmed Alansary, Ali HamdiMulti-Hop Question Answering Benchmarks Rdf
Reducing Hallucinations in Complex Question Answering using Simple Graph-based Retrieval-Augmented Generation (long version)
Jun 4, 2026Christopher J. Wedge, Joshua Stutter, Danny Dixon +1Multi-Hop Question Answering Benchmarks Hallucination Mitigation
Personal AI Agent for Camera Roll VQA
Jun 3, 2026Thao Nguyen, Krishna Kumar Singh, Donghyun Kim +2Visual Memory Artificial Intelligence Assistants
Boosting Self-Consistency with Ranking
Jun 3, 2026Maria Marina, Daniil Moskovskiy, Sergey Pletenev +3Self-Consistency Multi-Hop Question Answering Benchmarks
Clustered Self-Assessment: A Simple yet Effective Method for Uncertainty Quantification in Large Language Models
Jun 2, 2026Qi Cao, Takeshi Kojima, Andrew Gambardella +3Large Language Model Uncertainty Self-Assessments
MeDxAgent: Multi-Agent Consultation for Interactive Medical Diagnosis
Jun 2, 2026Akshat Sanghvi, Naren Akash, Raza Imam +2Diagnostic Benchmark Multiple-Choice Questions
SEA-NLI: Natural Language Inference as a Lens into Southeast Asian Cultural Understanding
Jun 2, 2026Peerawat Chomphooyod, Jian Gang Ngui, Yosephine Susanto +5Philippines Legal Natural Language Processing Benchmarks
Mechanistic Diagnostics of Spatial Lexical Bias in Multimodal Large Language Model Spatial Reasoning
Jun 1, 2026Chuang Ma, Qianying Liu, Tomoyuki Obuchi +6Multi-Modal Large Language Models Spatial Reasoning
Ryze: Evidence-Enriched Data Synthesis from Biomedical Papers
May 30, 2026Yeqi Huang, Yue Chen, Yanwei Ye +2Biomedical Text Qwen3-Embedding-8B
FineVerify: Scaling Test-Time Compute with Fine-Grained Self-Verification for Agentic Search
May 30, 2026James Xu Zhao, Hui Chen, Bryan Hooi +1Agentic Search Verifier
DeSQ: Decomposition-based SPARQL Query Generation
May 29, 2026Papa Abdou Karim Karou Diallo, Aditya Sharma, Neshat Elhami Fard +1Sparql Multi-Hop Question Answering Benchmarks
What Am I Missing? Question-Answering as Hidden State Probing
May 29, 2026Chu Fei Luo, Samuel Dahan, Xiaodan ZhuLarge Language Model Reasoning Closed-Book Question Answering
MechVQA: Benchmarking and Enhancing Multimodal LLMs on Comprehensive Mechanical Drawing Understanding
May 29, 2026Qian Kou, Xiaofeng Shi, Yulin Li +4Textvqa Visual Reasoning
AMNESIA: A Large Scale Medical Unlearning Benchmark Suite with Disease-Informed Analysis
May 28, 2026Saeedeh Davoudi, Reihaneh Iranmanesh, Ophir Frieder +1Unlearning Aims Clinical Notes
Selective QA over Conflicting Multi-Source Personal Memory: A Diagnostic Testbed and Method Comparison
May 28, 2026Tiancheng Yang, Matthias Schonlau, Ilia SucholutskyMulti-Hop Question Answering Benchmarks Large Language Model Baselines
Internal Representation, Not Clinical Knowledge: Where Apparent LLM Triage Failures Originate
May 28, 2026David Fraile Navarro, Berardino Como, Jialei Sheng +2Large Language Model Performance Multiple-Choice Questions
CRITIC-R1: Learning Structured Critics for Retrieval-Augmented Generation
May 28, 2026Wenhan Xiao, Ziwei Zhang, Chuanyue Yu +4Retrieval-Augmented Generation Systems Multi-Hop Question Answering Benchmarks
Spurious Prompts: Can Irrelevant Prompts Steer Large Language Models?
May 28, 2026Pawel Batorski, Abtin Pourhadi, Jerzy Sarosiek +2Prompt Engineering Multi-Hop Question Answering Benchmarks
HiKEY: Hierarchical Multimodal Retrieval for Open-Domain Document Question Answering
May 28, 2026Joongmin Shin, Gyuho Shim, Jeongbae Park +2Multimodal Documents Multimodal Retrieval
Brain-IT-VQA: From Brain Signals to Answers
May 28, 2026Roman Beliy, Matias Cosarinsky, Oliver Heinimann +2Brain Magnetic Resonance Imaging Textvqa
DocArena: Turning Raw Documents into Controllable Training Environments for Document Search Agents
May 27, 2026Jiamian Wang, Ruiyi Zhang, Tong Yu +5Multimodal Documents Search Agents
Same Question, Different Source, Different Answer: Auditing Source-Dependence in Medical Multi-Source RAG
May 27, 2026Yubo Li, Rema Padman, Ramayya KrishnanMulti-Source Retrieval-Augmented Generation Multi-Hop Question Answering Benchmarks
Mind Your Tone: Does Tone Alter LLM Performance?
May 27, 2026Om Dobariya, Akhil KumarLarge Audio Language Models Multiple-Choice Questions
Knowledge Dependency Estimation for Reliable Question Answering
May 27, 2026Chaodong Tong, Qi Zhang, Nannan Sun +2Multi-Hop Question Answering Benchmarks Knowledge Graphs
Evolving and Detecting Multi-Turn Deception using Geometric Signatures
May 26, 2026Surender Suresh Kumar, Mary L. CummingsDeception Large Language Model Safety
Simorgh at SemEval-2026 task 7: Region-Aware Hybrid Retrieval for Low-Resource Cultural Reasoning in Multilingual Question Answering
May 26, 2026Hadi Bayrami Asl Tekanlou, Mahdi Bakhtiyarzadeh, Jafar RazmaraMultilingual Financial Question Answering Cross-Lingual Consistency
Chartographer: Counterfactual Chart Generation for Evaluating Vision-Language Models
May 26, 2026Yifan Jiang, Dae Yon Hwang, Jesse C. Cresswell +1Chart Visual Reasoning
IPIBench: Evaluating Interactive Proactive Intelligence of MLLMs under Continuous Streams
May 26, 2026Jinzhao Li, Yinuo Chen, Wenxuan Song +5Proactive Multi-Modal Large Language Models
Beyond Questions: Evaluating What Large Language Models (Actually) Know
May 26, 2026Luca Giordano, Simon RazniewskiMulti-Hop Question Answering Benchmarks
Second Guess: Detecting Uncertainty Through Abstention and Answer Stability in Small Language Models
May 25, 2026Ashwath Vaithinathan Aravindan, Mayank KejriwalLarge Language Model Uncertainty Multiple-Choice Questions
Knowing but Not Showing: LLMs Recognize Ambiguity but Rarely Ask Clarifying Questions
May 24, 2026Jinyan Su, Claire CardieClosed-Book Question Answering
CyberMaskQA: A Privacy-Aware Benchmark for Evaluating Large Language Models in Cybersecurity Question Answering
May 23, 2026Matilda Gaddi, Jin Noh, Onat Gungor +1Cybersecurity Large Language Model Safety
TS-Skill: A Benchmark for Evaluating Analytical Skills in Time-Series Question Answering
May 23, 2026Liying Han, Kang Yang, Oliver Wang +9Closed-Book Question Answering Time Series
QUEST: Training Frontier Deep Research Agents with Fully Synthetic Tasks
May 22, 2026Jian Xie, Tianhe Lin, Zilu Wang +16Deep Research Task Synthesis
Asking For An Old Friend: Diagnosing and Mitigating Temporal Failure Modes in LLM-based Statutory Question Answering
May 22, 2026Max Prior, Andreas Schultz, Matthias GrabmairLegal Domain Question-Answer Pairs
ARES: Automated Rubric Synthesis for Scalable LLM Reinforcement Learning
May 22, 2026Xiaoyuan Li, Keqin Bao, Moxin Li +5Rubric-Based Reinforcement Learning Question-Answer Pairs
DFKI-MLT at SemEval-2026 TASK 7: Steering Multilingual Models Towards Cultural Knowledge
May 21, 2026Yusser Al Ghussin, Daniil Gurgurov, Yasser Hamidullah +3Multilingual Language Models Multilingual Reasoning
Cambrian-P: Pose-Grounded Video Understanding
May 21, 2026Jihan Yang, Zifan Zhao, Xichen Pan +5Video Understanding Spatial Reasoning
When Cases Get Rare: A Retrieval Benchmark for Off-Guideline Clinical Question Answering
May 20, 2026Doeun Lee, Muge Zhang, Yi Yu +11Clinical Reasoning Multi-Hop Question Answering Benchmarks
ACL-Verbatim: hallucination-free question answering for research
May 20, 2026Gábor Recski, Szilveszter Tóth, Nadia Verdha +2Multi-Hop Question Answering Benchmarks Human Annotations
MTR-Suite: A Framework for Evaluating and Synthesizing Conversational Retrieval Benchmarks
May 20, 2026Junhao Ruan, Abudukeyumu Abudula, Bei Li +8Retrieval-Augmented Generation Systems Conversational Benchmarks
NeuroQA: A Large-Scale Image-Grounded Benchmark for 3D Brain MRI Understanding
May 19, 2026Mohammad H. Abbasi, Favour Nerrise, Shaurnav Ghosh +12Medical Visual Question Answering Magnetic Resonance Imaging
Response-free item difficulty modelling for multiple-choice items with fine-tuned transformers: Component-wise representation and multi-task learning
May 16, 2026Jan Netík, Patrícia MartinkováMultiple-Choice Questions Multi--Task Learning
Chain-of-Procedure: Hierarchical Visual-Language Reasoning for Procedural QA
May 14, 2026Guanhua Chen, Yutong Yao, Shenghe Sun +5Knowledge-Based Visual Question Answering Large Vision Language Models
RxEval: A Prescription-Level Benchmark for Evaluating LLM Medication Recommendation
May 14, 2026Shuhao Chen, Weisen Jiang, Changmiao Wang +4Medication Recommendation Framework Clinical Reasoning
Why Retrieval-Augmented Generation Fails: A Graph Perspective
May 13, 2026Kai Guo, Xinnan Dai, Zhibo Zhang +5Multi-Hop Question Answering Benchmarks Graph Representations
PolitNuggets: Benchmarking Agentic Discovery of Long-Tail Political Facts
May 13, 2026Yifei ZhuPolitical Discourse Fact-Checking
Code-Guided Reasoning for Small Language Models: Evaluating Executable MCQA Scaffolds
May 12, 2026Prateek Biswas, Dhaval Patel, Vedant Khandelwal +2Small Language Models Multiple-Choice Questions
MedHopQA: A Disease-Centered Multi-Hop Reasoning Benchmark and Evaluation Framework for LLM-Based Biomedical Question Answering
May 12, 2026Rezarta Islamaj, Robert Leaman, Joey Chan +13Multi-Hop Question Answering Benchmarks Biomedical Knowledge
Mitigating Context-Memory Conflicts in LLMs through Dynamic Cognitive Reconciliation Decoding
May 12, 2026Yigeng Zhou, Wu Li, Yifan Lu +6Conflict Contrastive Decoding
How Should LLMs Listen While Speaking? A Study of User-Stream Routing in Full-Duplex Spoken Dialogue
May 11, 2026Hui Lu, Xueyuan Chen, Huimeng Wang +4Full-Duplex Speech Models Full-Duplex Dialogue
ASTRA-QA: A Benchmark for Abstract Question Answering over Documents
May 11, 2026Shu Wang, Shansong Zhou, Xinyang Wang +3Multi-Hop Question Answering Benchmarks Comparison
HOME-KGQA: A Benchmark Dataset for Multimodal Knowledge Graph Question Answering on Household Daily Activities
May 10, 2026Shusaku Egami, Aoi Ohta, Tomoki Tsujimura +5Knowledge Graph Embeddings Knowledge Graphs
SearchSkill: Teaching LLMs to Use Search Tools with Evolving Skill Banks
May 9, 2026Jinchao Hu, Meizhi Zhong, Kehai Chen +1Agentic Search Multi-Hop Question Answering Benchmarks
MedVIGIL: Evaluating Trustworthy Medical VLMs Under Broken Visual Evidence
May 8, 2026Hanqi Jiang, Junhao Chen, Mingyu Kang +12Medical Visual Question Answering Medical Vision-Language Models
Inference-Time Budget Control for LLM Search Agents
May 7, 2026Zhengru Fang, Senkang Forest Hu, Zhonghao Chang +6Multi-Hop Question Answering Benchmarks Token Budgets

Jun 6, 2026 · cs.AIJ/K move · Enter open · S save

When No Answer Is Correct: Diagnosing Absent Answer Detection for MLLMs in Video Understanding

Yiheng Wang, Yueqian Lin, Lichen Zhu, Yudong Liu+2

Duke University, Durham, North Carolina, USA

Multimodal large language models (MLLMs) have made substantial advancements in video understanding, yet the reliability of their responses remains underexplored. This work presents a diagnostic study of absent answer detection for MLLMs in video understanding, where the correct answer is deliberately excluded from the candidate set and a reliable model is expected to recognize that no valid option exists. We evaluate the absent answer detection behavior under three settings: multiple-choice questions augmented with an ``None of the Above'' option, open-ended generation with a detection instruction, and standard evaluation without any guidance. Across a diverse set of models and benchmarks, we find that MLLMs overwhelmingly select plausible distractors rather than detecting the absent answer. This failure is more pronounced in temporal reasoning tasks and worsens with denser frame sampling. We further explore chain-of-thought prompting as a mitigation strategy and find that while it substantially improves detection rates, performance remains unsatisfactory, suggesting that prompting-based strategies alone are insufficient to fully address this limitation. These findings expose a systematic failure in absent answer detection and highlight the need for explicit detection mechanisms in multimodal systems.

Video Multimodal Large Language Models Video Understanding Multiple-Choice Questions

Open paper Ask about it PDF