cs.AINov 2, 2026

Query-based Submodular Data Selection for Efficient Instruction Tuning

Authors: Zhenghao Zhao, Yasutomo Kawanishi, Huihuo Zheng, Michael E. Papka, Yan Yan

Organizations: University of Illinois Chicago · Ritsumeikan University · Argonne National Laboratory

Abstract

As large language models are fine-tuned for increasingly specialized tasks, their performance depends more on which training examples are selected than on how many. Given a large heterogeneous training pool and a small target set specifying the desired capability, targeted data selection aims to find a compact subset that maximizes downstream performance. Existing methods score each candidate independently against the target and select the top-ranked examples, yet this point-wise strategy ignores inter-example interactions: at tight budgets the selected subset is dominated by near-redundant points that waste capacity on overlapping information. We propose Query-based Submodular functions with Gradient-guided Synthesis (QSGS), which formulates targeted selection as a submodular graph cut over a gradient similarity graph. A modular relevance term pulls selected examples toward the target task, while a pairwise dispersion penalty suppresses intra-subset redundancy. The resulting objective balances target relevance and intra-subset redundancy using the same formulation across different selection budgets. Empirically, the benefit of diversity-aware selection becomes increasingly pronounced as the data budget decreases. To further close coverage gaps that no selection from existing data can bridge, we introduce a gradient-guided synthesis step that identifies under-covered target directions via residual subspace analysis and generates synthetic examples to fill them. Experiments on MMLU, BBH, and TydiQA across Llama-2, Llama-3, and Mistral, show that QSGS at a 0.5% budget matches or exceeds full-data performance on Mistral-7B, outperforms the strongest baseline across all benchmarks, and yields increasing gains as the budget shrinks.

Figures & tables

Appendix figures & tables1 asset

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. A Critical Look at Targeted Instruction Selection: Disentangling What Matters (and What Doesn't)

    Feb 16, 2026Nihal V. Nayak, Paula Rodriguez-Diaz, Neha Hulkund +2Instruction-Tuning Data SelectionTraining Data Selection

  2. An Embarrassingly Simple Data Selection Strategy for Million-Scale Multi-Modal Instruction-Tuning

    Mar 17, 2025Mengyao Lyu, Yan Li, Huasong Zhong +4Instruction-Tuning Data SelectionMultimodal Instruction Tuning