Multi-Hop QA

QA: Question Answering

Overview

Multi-hop question answering asks systems to connect several facts or sources, often through intermediate entities or sub-questions, instead of finding an answer in a single passage. Common approaches decompose questions into steps, use iterative retrieval-augmented generation, or follow paths through knowledge graphs, with verification and evidence tracking to keep each step grounded. Benchmarks such as HotpotQA, MuSiQue, and 2WikiMultiHopQA test linked evidence across documents, while newer evaluations extend to long, multimodal, and domain-specific collections. A central challenge is distinguishing failures to find evidence from failures to combine or verify evidence that was retrieved, while controlling the cost of additional searches and reasoning.

Latest papers

241 papers19 papers in the last four weeks, down 30% on the four weeks before. 0.1% of all new papers.

Oct 22, 2024

SG-FSM: A Self-Guiding Zero-Shot Prompting Paradigm for Multi-Hop Question Answering Based on Finite State Machine

Large Language Models with chain-of-thought prompting, such as OpenAI-o1, have shown impressive capabilities in natural language inference tasks. However, Multi-hop Question Answering (MHQA) remains challenging for many existing models due to issues like hallucination, error propagation, and limited context length. To address these challenges and enhance LLMs' performance on MHQA, we propose the Self-Guiding prompting Finite State Machine (SG-FSM), designed to strengthen multi-hop reasoning abilities. Unlike traditional chain-of-thought methods, SG-FSM tackles MHQA by iteratively breaking down complex questions into sub-questions, correcting itself to improve accuracy. It processes one sub-question at a time, dynamically deciding the next step based on the current context and results, functioning much like an automaton. Experiments across various benchmarks demonstrate the effectiveness of our approach, outperforming strong baselines on challenging datasets such as Musique. SG-FSM reduces hallucination, enabling recovery of the correct final answer despite intermediate errors. It also improves adherence to specified output formats, simplifying evaluation significantly.