cs.LGJan 23, 2026

What Does a Cosine of 0.8 Mean? Monotone Calibration of Embedding Similarity

Authors: Nicolas Tacheny

Organizations: University of Mons (Mons, Belgium)

Abstract

Text embedding models turn sentences into vectors, and the cosine between two vectors is the usual measure of their similarity. Search, semantic caching and deduplication often accept a pair when this cosine reaches a fixed threshold. When people judge one pair of sentences more similar than another, the cosine usually agrees, but its value means different things for different models, because each model packs its scores into its own narrow range. The same threshold can therefore keep most pairs with one model and few with another. We propose to calibrate the score instead of changing the model. An increasing function fitted on sentence pairs rated by people translates the cosine of each model into the human rating scale and never reverses the order of two pairs. We fit three such functions for six models, ranging from a simple S-shaped curve to a free step function. On new pairs, calibrated scores agree with human ratings and the models agree with one another. One threshold selects pairs of similar quality whatever the model. The scale obtained belongs to the human ratings used to fit it, so its values shift on two datasets rated differently while the models stay comparable.

Figures & tables

Explore similar work

CardsList
  1. What Cosine Similarity of Label Representations Can and Cannot Tell us

    Mar 31, 2026Beatrix M. G. Nielsen, Andreas GrivasRepresentation Geometry in Language Models

  2. Mapping Similarity Spaces across Embedding Models with Synthetic Query Probing

    Aug 6, 2026Marcin Rozmus, Peter van der PuttenText Embedding EvaluationText Embedding Models