cs.CLOct 31, 2026

HALO: Hierarchical Evidence Selection and Reinforcement Learning for Allocating Budgeted Label Optimization from Longitudinal Clinical Records

Authors: Huaiyuan Ying, Feiqing Huang, Ryumei Nakada, Katherine P. Liao, Tianxi Cai

Organizations: Department of Statistics and Data Science Tsinghua University Beijing, China · Department of Biostatistics Harvard T.H. Chan School of Public Health Boston, MA, USA · Brigham and Women’s Hospital Harvard Medical School Boston, MA, USA · Harvard T.H. Chan School of Public Health Harvard Medical School Boston, MA, USA

Abstract

Learning from extensive longitudinal clinical records--spanning repeated encounters, evolving conditions, and heterogeneous documentation--under a finite labeling budget requires solving two coupled problems: deciding what evidence to keep and deciding which patients deserve higher-fidelity labels. Prior work on active learning and multi-fidelity label acquisition mainly addresses the second problem, while treating the evidence presented to the acquisition policy as fixed. We present HALO, a Hierarchical Evidence Selection and Reinforcement Learning pipeline for Allocating Budgeted Label Optimization from Longitudinal Clinical Records. This framework jointly learns what to read and what label source to acquire under budget. HALO first selects informative evidence from longitudinal records and then uses a budget-aware policy to allocate free-, silver-, and gold-fidelity label sources. For frozen policies, our theory characterizes asymmetric acquired-label channels and gives a budget-constrained finite-sample gold-risk bound for a common downstream logistic model. In a heart-failure case study, HALO attained the highest MedAlign acquired-label F1 at six of eight target budgets. A downstream classifier trained on HALO-acquired labels attained the highest external MGB F1 at budgets 15-60 and remained within 0.01 of the best comparator at budgets 75-120.

Figures & tables

Explore similar work

CardsList
  1. How Many Labels Are Enough? ALDA: Active Learning Deployment Advisor for Medical Image Classification

    Aug 4, 2026Julia Machnio, Mads Nielsen, Mostafa Mehdipour GhaziLearning Curve PredictionActive Learning

  2. Large Classification-Risk-Optional Label Acquisition

    Sep 6, 2026F. Setoudehtanzangi, Geoffrey J. McLachlanActive LearningMulticlass Classification