Question Answering

Also known as QA

Overview

Question answering asks how systems can find, interpret, and combine information to answer questions, from short factual queries to multi-hop reasoning over documents, conversations, images, video, and structured data. Common approaches include retrieval-augmented generation, fine-tuning, knowledge graphs, tool-using agents, and symbolic methods; evaluations span reading comprehension, open-domain and long-document QA, conversational QA, and specialized domains. Current work also focuses on multilingual and multimodal settings, personalization, and recognizing when to clarify or abstain rather than guess. A central tension is that better retrieval or reasoning does not always produce more reliable answers: systems must still handle missing or conflicting evidence, avoid hallucinations, and balance accuracy, coverage, latency, and cost.

Latest papers

272 papers17 papers in the last four weeks, down 43% on the four weeks before. 0.1% of all new papers.

Apr 8, 2025

Towards Reliable Long-Context Reasoning: Detecting Unanswerable Questions via FactGuard

Despite the success of Large Language Models (LLMs) in long-context tasks, their reliability in recognizing unanswerable questions remains a critical challenge. In information-seeking scenarios, models often suffer from overconfidence and hallucinations when evidence is missing or misleading. In this paper, we propose FACTGUARD, a systematic multi-task workflow for generating evidence-grounded answerable and unanswerable questions. We introduce FACTGUARD-BENCH, a benchmark comprising 25,220 examples with context lengths up to 128K, specifically targeting Lack of Evidence and Misleading Evidence scenarios. Evaluations of eleven representative open-source and proprietary LLMs reveal a significant reliability gap: models struggle to reject unanswerable questions as context scales, with the leading model achieving only 71.62% accuracy. By training with FACTGUARD-BENCH, we improve overall accuracy to 81.17% and significantly enhance models' reasoned rejection capabilities. Our work provides a scalable path toward building more faithful and trustworthy long-context LLMs. Our source is publicly available at https://github.com/biaoliu-kiritsugu/FactGuard.
Jun 15, 2024

QDA-SQL: Questions Enhanced Dialogue Augmentation for Multi-Turn Text-to-SQL

Fine-tuning large language models (LLMs) for specific domain tasks has achieved great success in Text-to-SQL tasks. However, these fine-tuned models often face challenges with multi-turn Text-to-SQL tasks caused by ambiguous or unanswerable questions. It is desired to enhance LLMs to handle multiple types of questions in multi-turn Text-to-SQL tasks. To address this, we propose a novel data augmentation method, called QDA-SQL, which generates multiple types of multi-turn Q&A pairs using LLMs. In QDA-SQL, we introduce a method incorporating validation and correction mechanisms to handle complex multi-turn Text-to-SQL tasks. Experimental results demonstrate that QDA-SQL enables fine-tuned models to exhibit higher performance on SQL statement accuracy and enhances their ability to handle complex, unanswerable questions in multi-turn Text-to-SQL tasks. The generation script and test set are released at https://github.com/mcxiaoxiao/QDA-SQL