Sentence Embeddings

Ask about this topic

Overview

Sentence embeddings represent whole sentences as vectors so systems can compare meaning, retrieve relevant text, group examples, or support classification. Common approaches use contrastive learning on paraphrases, natural language inference pairs, or translated parallel text, alongside distillation and different pooling methods to build or adapt encoders. Models are evaluated on semantic textual similarity, retrieval, inference, and classification benchmarks, with multilingual and domain-specific tests revealing that strong average scores do not guarantee performance in every language or task. A central tension is that single-vector similarity is efficient, but subtle meaning comparisons can require interactions between sentence pairs; robustness, interpretability, and reliable evaluation remain open challenges.

Latest papers

CardsList

35 papers3 papers in the last four weeks, level with the four weeks before. 0.0% of all new papers.

  1. Semantically Rich, Metrically Affect-Blind: A Geometric Blind Spot in Modern Text Embedders

    Oct 23, 2026Mahdi Naser MoghadasiSentence EmbeddingsRepresentation Geometry in Language Models

    BrightMind AI Seattle, WA, USA

  2. Know Yourself and Know Your Neighbour: A Syntactically Informed Self-Supervised Compositional Sentence Representation Learning Framework using a Recursive Hypernetwork

    Oct 12, 2026Vasudevan Nedumpozhimana, John KelleherRepresentation LearningSentence Embeddings

    ADAPT Research Centre Trinity College Dublin, Ireland

  3. From Retrieval to Typed Decisions: Calibrated System One Models from Biomedical Sentence Encoders

    Oct 1, 2026Pritam DekaText ClassificationProbability Calibration

    Queen’s University Belfast Belfast, United Kingdom

  4. Computation Over Geometry: Meaning Identity Is Computed, Not Shipped in the Embeddings

    Sep 23, 2026Jiaqi DengSemantic CorrespondenceCross-Encoder Reranking

    Independent Researcher

  5. TEMPS: Temporal Sentence Embeddings for Temporal Information Retrieval

    Sep 23, 2026Mourad Hassani, Julien Romero, Amel Bouzeghoub +1Sentence EmbeddingsTemporal IR

    SAMOVAR, Télécom SudParis, Institut Polytechnique de Paris, France · Aldebaran Care, France

  6. Improving Cross-Lingual Token Representations by Adding a Pinch of SALT

    Sep 9, 2026Guillem RamírezSentence EmbeddingsCross-Lingual Representation Alignment

    ILCC, University of Edinburgh

  7. Evaluating Multilingual Sentence Embeddings for Translation Error Detection:An English--Greek Contrastive Study

    Aug 28, 2026Eleftherios Kalogeros, Athanasios Ntalakas, Manolis Gergatsoulis +2MT EvaluationSentence Embeddings

    Laboratory on Digital Libraries and Electronic Publishing, Department of Information Science, Ionian University, Ioannou Theotoki 72, 49100 Corfu, Greece · Centre for Literary Translation and Book Policy, Department of Foreign Languages, Translation and Interpreting, Ionian University, Tsirigoti Sq., 49100 Corfu, Greece

  8. KinyaEmbed: Contrastive Sentence Embeddings for Kinyarwanda via Multi-Stage Curriculum Training

    Aug 27, 2026Ireddi Rakshitha, Devavarapu Yashwanth, Ntakirutimana PierreSentence EmbeddingsAfrican Language Processing

    Barclays · Carnegie Mellon University

  9. Where A Small Language Model Helps in Invoice Categorisation, Understood Through Embedding Geometry

    Aug 18, 2026Emma Ceccherini, Daniel Lawson, Anjulika SalhanSmall Language ModelsText Classification

    University of Bristol, U.K. · System Holdings Limited

  10. CDAE: Enhancing Perturbation Robustness in Pretrained Language Models with Contrastive Denoising

    Jul 30, 2026Sina Heydari, Amirreza Abbasi, Mohsen Hooshmand +1Contrastive LearningDenoising Autoencoders

    Department of Computer Science and Information Technology Institude for Advanced Studies in Basic Sciences (IASBS) Zanjan, Iran, 45137-66731

  11. From transcription to semantic corpus analysis: unsupervised learning of sentence representations for ancient languages

    Jul 27, 2026Th{é}otime de la SelleSemantic Textual SimilaritySentence Embeddings

    ISC, HiSoMA, CNRS · Institut des Sources Chrétiennes, HiSoMA, CNRS, Lyon, France

  12. Multilingual Sentence Embeddings for Linguistic-Integrated Reliability Audit

    Jul 20, 2026Ummugul Bezirhan, Ji Yoon Jung, Matthias von DavierSentence EmbeddingsEducational Assessment

    Boston College Chestnut Hill, Massachusetts, USA

  13. Riemannian Geometry for Pre-trained Language Model Embeddings

    Jul 8, 2026Szczepan Konior, Alexandre Quemy, Przemysław Klocek +2Sentence EmbeddingsGeometric Representation Learning

    IBM Automation and AI, Krakow, Poland · Hother, Krakow, Poland · University of Warsaw +1

  14. Beyond Multilingual Averages: MTEB-PT, a Benchmark for Portuguese Sentence Encoders

    Jul 5, 2026Lucas Hideki Takeuchi Okamura, Alexandre Alcoforado, Anna Helena Reali CostaSentence EmbeddingsText Embedding Evaluation

    Escola Politécnica, Universidade de São Paulo, São Paulo, Brazil

  15. Evaluating Document-Tuned Transformer Representations for Person-level Mental Health Assessment

    Jun 19, 2026Aaron Marker, Oscar Kjell, Vasudha Varadarajan +1Sentence EmbeddingsMental Health

    Vanderbilt University · Lund University · Carnegie Mellon University

  16. Aligning Sentence Embeddings to Human Concepts via Sparse Autoencoders

    Jun 19, 2026Wonseok Shin, Songkuk KimText EmbeddingsSentence Embeddings

    Yonsei University

  17. Correlation Is Not Enough: Embedding Human Metadata for Individual Causal Discovery

    Jun 8, 2026Suraj Biswas, Saurabh Gupta, Pritam MukherjeeContrastive LearningSentence Embeddings

    ¹ Assessli Research · ² Dots-In Research, Bengaluru, India

  18. Modeling semantic association in self-paced reading with language model embeddings

    Jun 5, 2026Sara Møller Østergaard, Kenneth Enevoldsen, Afra Alishahi +1Sentence EmbeddingsText Embedding Evaluation

    Department of Computational Cognitive Science, Tilburg University · Center for Humanities Computing, Aarhus University

  19. Principles of Concept Representation in Sentence Encoders

    Jun 5, 2026Isabelle Mohr, John Dujany, Jonathan Souquet +1Sentence EmbeddingsCompositional Reasoning

    Idiap Research Institute · Merck KGaA

  20. When Does Complexity Conditioning Help a Frozen Sentence Embedding? A Controlled Study of Per-Sentence and Pair-Level Difficulty Adaptation

    Jun 2, 2026Suhwan HwangSentence EmbeddingsLearning to Rank

  21. Model-Based Quality Assessment for Massively Multilingual Parallel Data

    May 29, 2026Abdelaziz M. A. Ibrahim, Zihao Li, Jörg Tiedemann +1Sentence EmbeddingsMT Evaluation

    University of Jyväskylä · University of Helsinki · ELLIS Institute Finland +1

  22. Bridging the Gap Between Natural Language and Market Dynamics via High-Dimensional Representation Learning

    May 28, 2026Yujin Jeong, Noelle Jung, Brian Y. C. LeungSentence EmbeddingsTime Series Forecasting

    Mike

  23. Adapting Multilingual Embedding Models to Turkish via Cross-Lingual Tokenizer Surgery and Offline Distillation

    May 28, 2026M. Ali Bayram, Banu Diri, Savaş YıldırımMultilingual Language ModelsSentence Embeddings

    Department of Computer Engineering Yıldız Technical University Istanbul, Turkey · Department of Computer Engineering Istanbul Bilgi University Istanbul, Turkey

  24. Controlled Paraphrase Geometry in Sentence Embedding Space: Local Manifold Modeling and Latent Probing

    May 1, 2026Leonid BedratyukRepresentation LearningNeural Representation Geometry

  25. Lost in State Space: Probing Frozen Mamba Representations

    Apr 30, 2026Bhagyashree Wagh, Akash SinghRepresentation GeometryRepresentation Collapse

    University of Washington · University of Florida

  26. MIPIC: Matryoshka Representation Learning via Self-Distilled Intra-Relational and Progressive Information Chaining

    Apr 27, 2026Phung Gia Huy, Hai An Vu, Minh-Phuc Truong +4Representation LearningSentence Embeddings

    1Hanoi University of Science and Technology · University of Oregon · 3Monash University

  27. Finding Meaning in Embeddings: Concept Separation Curves

    Apr 23, 2026Paul Keuren, Marc Ponsen, Robert Ayoub BagheriSentence EmbeddingsText Embedding Evaluation

    Utrecht University · Statistics Netherlands

  28. FLiP: Towards understanding and interpreting multimodal multilingual sentence embeddings

    Apr 20, 2026Santosh Kesiraju, Bolaji Yusuf, Šimon Sedláček +2Linear ProbingSentence Embeddings

  29. Comparison of Modern Multilingual Text Embedding Techniques for Hate Speech Detection Task

    Apr 16, 2026Evaldas Vaiciukynas, Paulius Danenas, Linas Ablonskis +5Sentence EmbeddingsText Embedding Evaluation

    Department of Information Systems, Faculty of Informatics, Kaunas University of Technology, Kaunas, Lithuania · Centre of Information Systems Design Technologies, Faculty of Informatics, Kaunas University of Technology, Kaunas, Lithuania

  30. ViCLSR: A Supervised Contrastive Learning Framework with Natural Language Inference for Natural Language Understanding Tasks

    Mar 22, 2026Tin Van Huynh, Kiet Van Nguyen, Ngan Luu-Thuy NguyenSentence EmbeddingsSupervised Contrastive Learning

    University of Information Technology, Ho Chi Minh City, Vietnam. · Vietnam National University, Ho Chi Minh City, Vietnam.