cs.LGNov 8, 2026

When gene summaries reveal the answers: Gene Ontology circularity in gene embedding benchmarks

Authors: Jiawei Wu, Huishu Wang, Junlin Chen, Hongyi Wang

Organizations: Rutgers University · New York University

Abstract

A gene summary can contain the very annotations used to evaluate an embedding of its text. The Alliance of Genome Resources converts Gene Ontology (GO) annotations into sentences, which NCBI Gene displays and GenePT includes in its input. These summaries covered 6,172 of 19,256 human protein-coding genes (32.1%), including 58% of genes with one to ten linked publications. We embedded the same corpus with and without the generated summaries and refitted a function-prediction probe on each version. Among genes with one to ten publications, removal reduced the reported per-gene area under the receiver operating characteristic curve (AUROC) by 0.078 with a linear probe (95% bootstrap interval 0.072-0.084) and by 0.033 with a multilayer perceptron. These estimates use a historical GO scorer that mishandled ties. The original predictions are unavailable for rescoring. A simple TF-IDF encoder also benefited from the summaries, as did models evaluated only on experimental annotations. Replacing generated summaries with UniProt function descriptions recovered much of the lost performance despite little verbatim overlap. UniProt also curates many of the evaluation labels. In mouse and yeast, we found a similar dependence on the source of the description. We introduce GeneProv to compare encoders on matched text and to examine how representation rankings change across GO recovery, non-GO endpoints and co-essentiality.

Figures & tables

Appendix figures & tables15 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. LLMBDC: Language Model for Biological Domains Oriented Clustering of Gene Ontology

    Jul 30, 2026Ximing Ran, Jie Xu, Peng Jin +3ClusteringGenomics

  2. Homo-RAG: Homology-Guided Retrieval-Augmented Generation for Cross-Species Gene Function Prediction

    Aug 26, 2026Azrin SultanaRetrieval-Augmented GenerationLLM-Assisted Annotation

  3. A Pitfall in the Evaluation of Gene Perturbation Models

    Oct 19, 2026George Panagopoulos, Saman Omidi, Tsz Pan Tong +1Single-Cell Perturbation ModelingDifferential Testing