cs.LGNov 13, 2026

AdaMenu: Query-Adaptive Menus for Decision Models over Large Label Spaces

Authors: Jiangze Yan, Yi Shen, Jieyun Huang, Wenjing Zhang, Zhaoxiang Liu, Ning Wang, Kai Wang, Shiguo Lian

Organizations: Unicom Data Intelligence, China Unicom · Data Science & Artificial Intelligence Research Institute, China Unicom

Abstract

Decision models such as Jev return probabilities over caller-defined options and are increasingly used for classification. Large label spaces challenge both accuracy and scalability: larger menus can impair decisions, increase input costs, and exceed option limits. Hierarchical classification reduces menu size but introduces serial calls and error propagation. We propose AdaMenu, which builds a compact candidate menu from retrieved labeled examples and makes a single decision-model request. Its candidate labels adapt to the query, and its default setting also adjusts menu size using aggregated retrieval scores. We evaluate AdaMenu with open and closed decision models on four label sets containing up to 1,016 labels. It outperforms TypeSafe's beam-search baseline on all 16 model and label-set pairs where both methods run, improving accuracy by 16.6-34.3 percentage points. Relative to the full menu on the three smaller label sets, accuracy differences range from -0.5 to +7.2 percentage points, while input token usage falls by factors of 3.2-22.9. AdaMenu also runs when option limits exclude the full menu, including settings where the hierarchical baseline is unavailable.

Figures & tables

Explore similar work

CardsList
  1. JevCascade: Readout Stability and Inference-Time Compute Allocation for Prefill-Only Decision Models

    Oct 6, 2026Ran Li, Lei ChenInference-Time Compute AllocationEfficient Language Model Inference

  2. Releasing the Inner Jev: A Simple Recipe for Open Decision Models

    Oct 12, 2026Jonathan Geuter, Andrew Cheng, David Alvarez-MelisSystem One Decision ModelsLLM Decision-Making