Citation-Enforced RAG for Fiscal Document Intelligence: Cited, Explainable Knowledge Retrieval in Tax Compliance
Organizations: Independent Researcher
Abstract
Tax authorities and public-sector financial agencies rely on large volumes of unstructured and semi-structured fiscal documents - including tax forms, instructions, publications, and jurisdiction-specific guidance - to support compliance analysis and audit workflows. While recent advances in generative AI and retrieval-augmented generation (RAG) have shown promise for document-centric question answering, existing approaches often lack the transparency, citation fidelity, and conservative behaviour required in high-stakes regulatory domains. This paper presents a multimodal, citation-enforced RAG framework for fiscal document intelligence that prioritises explainability and auditability. The framework adopts a source-first ingestion strategy, preserves page-level provenance, enforces citations during generation, and supports abstention when evidence is insufficient. Evaluation on real IRS and state tax documents demonstrates improved citation fidelity, reduced hallucination, and analyst-usable explanations, illustrating a pathway toward trustworthy AI for tax compliance.
Figures & tables
| Source Authority | Document Types | Count (Docs) | Count (Chunks) |
|---|---|---|---|
| IRS (Federal) | Forms, Instructions, Pubs | 145 | 5,210 |
| CA FTB (State) | Forms, Publications, Instructions | 85 | 3,100 |
| NY Tax (State) | Forms, Guidelines | 68 | 2,181 |
| Total | 298 | 10,491 |
| Metric | Definition | Performance (%) |
|---|---|---|
| Citation Support | Cited text fully supports the claim | 94.5% |
| Format Compliance | Citations follow [Doc ID, Page] format | 100.0% |
| Abstention Accuracy | System correctly abstained when no info existed | 88.0% |
| Hallucination Rate | Claims appearing without evidence | 1.8% |
| Usefulness Score | Average Rating (1–5 Scale) | 4.2 / 5.0 |
Document QA
Document question answering uses AI to answer questions from text, tables, images, and structured content in documents.
See all 92 papers