cs.IRAug 24, 2026

Retrieval-Augmented Classification of Environmental Mitigations in Hydropower Licensing Documents

Authors: Hong-Jun Yoon, Tom Ruggles, Joanna Lee, Debjani Singh

Organizations: Computational Sciences and Engineering Division, Oak Ridge National Laboratory, Oak Ridge, Tennessee 37830, USA · Environmental Sciences Division, Oak Ridge National Laboratory, Oak Ridge, Tennessee 37830, USA · Farragut High School, Knoxville, Tennessee 37934

Abstract

Identifying and classifying environmental mitigation obligations in Federal Energy Regulatory Commission hydropower licensing documents is a labor-intensive task requiring deep domain expertise. We formulate this as a multi-label classification problem over a structured 135-category taxonomy and address the central challenge of severe label scarcity: 40 of 135 categories have no training examples, and 26 have fewer than five. A supervised Bidirectional Encoder Representations from Transformers (BERT)-based pipeline, while effective on well-represented categories, achieves F1 of zero on unseen classes regardless of augmentation strategy. We introduce a Retrieval-Augmented Generation (RAG) pipeline that conditions classification on retrieved category definitions, enabling zero-shot generalization across the full label space. We further propose a hybrid system that combines BERT detection with RAG classification, exploiting the high recall of fine-tuned detection and the zero-shot coverage of retrieval-augmented reasoning. Evaluated on the full set of 2017 license documents (5,860 paragraphs, 135 categories), the hybrid achieves a Micro F1 of 0.524, outperforming the BERT-only pipeline (0.477) and the RAG-only pipeline (0.416) across all training-support buckets.

Figures & tables

Explore similar work

CardsList
  1. HIRA: A Human-in-the-Loop Retrieval-Augmented Cascade for Document Classification in Regulated Industries

    Aug 22, 2026Shangxuan Tian, Yanhui Chen, Carlos QueirozText ClassificationRetrieval-Augmented Classification

  2. RAPT: Retrieval-Augmented Post-hoc Thresholding for Multi-Label Classification

    May 15, 2026Lasal Jayawardena, Nirmalie Wiratunga, Ikechukwu Nkisi-Orji +1Document UnderstandingMulti-Label Classification