cs.CLNov 17, 2026

Visibility Graph Representations of Word Embeddings for Text Classification

Authors: Elif Dorukbaşı, İlker Türker

Organizations: Department of Computer Engineering, Faculty of Computer and Information Sciences, Karabük University, Karabük, Türkiye

Abstract

Text classifiers depend on representations that expose the distinctions between classes in a form the learning model can use, and a restricted vocabulary changes which representation is most effective. This paper studies natural visibility graphs as an intermediate representation for news topic classification under controlled vocabulary budgets. Word embeddings are averaged into a fixed-length document vector, the vector is read as an ordered numerical series, and its natural visibility graph is passed to a classifier either as an ordered node-degree vector or as an adjacency matrix. On the four-class AG News benchmark, chi-square selection retains 100 to 1,500 words, and the graph inputs are compared with direct embedding-based representations from continuous bag-of-words, skip-gram, GloVe, FastText and BERT. With a fully connected classifier, the degree representation is the most accurate configuration from 700 selected words onward; it reaches its highest accuracy of 91.24% at 1,000 words and exceeds the BERT-based baseline by 0.29 percentage points at 1,500 words. In a separate convolutional comparison, the adjacency input reaches 86.16% at 1,000 words, against 83.12% for the strongest static embedding. The results indicate that visibility-derived features can be competitive once the selected vocabulary provides adequate coverage. We discuss the roles of graph compression, coordinate ordering and classifier choice, and the controls needed to establish the reliability of the small differences observed.

Figures & tables

Explore similar work

CardsList
  1. ModTGCN: Modularity-aware Graph Neural Networks for Text Classification

    Apr 29, 2026Rajarshi Misra, Aditya Sharma, Vinti Agarwal +1Graph Neural NetworksText Classification

  2. Topology-induced Operators Reveal Complementary Graph Representations without Training

    Sep 8, 2026Meng Qin, Jinqiang Cui, Hongwei Zheng +2Graph Representation LearningGraph Embedding

  3. An empirical investigation into the properties of standard word embeddings

    Jul 26, 2026Salomon KabongoText EmbeddingsWord Embeddings