Organizations: Northeastern University Boston, USA, 02115 · Independent Researcher Milpitas, USA, 95035 · Independent Researcher Austin, USA, 78613 · Washington University in St. Louis St. Louis, USA, 63130 · New York University New York, USA, 10012 · Independent Researcher Santa Clara, USA, 95051
We present DynaRAG, a retrieval-augmented generation (RAG) framework designed to handle both static and time-sensitive information needs through dynamic knowledge integration. Unlike traditional RAG pipelines that rely solely on static corpora, DynaRAG selectively invokes external APIs when retrieved documents are insufficient for answering a query. The system employs an LLM-based reranker to assess document relevance, a sufficiency classifier to determine when fallback is necessary, and Gorilla v2 -- a state-of-the-art API calling model -- for accurate tool invocation. We further enhance robustness by incorporating schema filtering via FAISS to guide API selection. Evaluations on the CRAG benchmark demonstrate that DynaRAG significantly improves accuracy on dynamic questions, while also reducing hallucinations. Our results highlight the importance of dynamic-aware routing and selective tool use in building reliable, real-world question-answering systems.
Figures & tables
Fig. 1: DynaRAG pipeline
Acc.(%)
Hall.(%)
Miss.(%)
LLM Only
28.53
34.95
36.52
Direct RAG
34.23
43.09
22.68
Task 1
29.12
25.33
45.55
Task 2
41.00
22.09
36.91
TABLE I: Accuracy, hallucination, and missing rates for baseline and DynaRAG methods on the CRAG benchmark.