cs.LGAug 14, 2026

Geometric Filtering of LLM-Generated Samples for Few-Shot Text Classification

Authors: Benjamín Schindler, Gonzalo A. Ruz

Organizations: Faculty of Engineering and Sciences Universidad Adolfo Ibáñez Millennium Nucleus for Social Data Science (SODAS) Santiago, Chile · Faculty of Engineering and Sciences Universidad Adolfo Ibáñez Millennium Nucleus for Social Data Science (SODAS) Millennium Nucleus in Data Science for Plant Resilience (PhytoLearning) Santiago, Chile

Abstract

Large language models (LLMs) can generate synthetic training data for text classification, but the quality of generated samples is heterogeneous: some fall in correct class regions of the embedding space while others land in peripheral or cross-class zones. We propose a geometric filtering framework that evaluates each LLM-generated sample by its Euclidean distance to real class examples in a sentence embedding space, selecting only geometrically consistent candidates. A soft weighting mechanism transforms filter scores into sample weights for classifier training. Evaluated across 13 datasets, 5 classifiers, 10 augmentation methods, and over 6,700 configurations, our method achieves +2.61 percentage points (pp) over SMOTE (p<0.0001p<0.0001, Cohen's d=0.95d=0.95, 88.9% win rate). The approach generalizes to named entity recognition (+9.26pp, 100% win rate) without filter modification, and is robust across 5 LLMs from 4 providers. A key finding is that the simplest distance-based filter consistently outperforms complex multi-criteria alternatives.

Figures & tables

Explore similar work

CardsList
  1. GEM: Geometric Entropy Mixing for Optimal LLM Data Curation

    Apr 27, 2026Yue Min, Ziyun Qiao, Ruining Chen +1Language Model PretrainingTraining Data Curation

  2. Label-Centric Knowledge Retrieval for Zero-Shot Text Classification

    Oct 12, 2026Daoping Wu, Dong Wang, Siyu Liu +5Zero-Shot Text ClassificationRetrieval-Augmented Classification