Overview

Sentence embeddings represent whole sentences as vectors so systems can compare meaning, retrieve relevant text, group examples, or support classification. Common approaches use contrastive learning on paraphrases, natural language inference pairs, or translated parallel text, alongside distillation and different pooling methods to build or adapt encoders. Models are evaluated on semantic textual similarity, retrieval, inference, and classification benchmarks, with multilingual and domain-specific tests revealing that strong average scores do not guarantee performance in every language or task. A central tension is that single-vector similarity is efficient, but subtle meaning comparisons can require interactions between sentence pairs; robustness, interpretability, and reliable evaluation remain open challenges.

Latest papers

CardsList

41 papers5 papers in the last four weeks, up 25% on the four weeks before. 0.0% of all new papers.

  1. A Comparative Evaluation of BERT-Based and LLM-Based Models for Indic Sentence Similarity

    Nov 14, 2026Aishwarya Gunjal, Kanchan Khemnar, Pawan Poojary +2Semantic Textual SimilaritySentence Embeddings

  2. StaRSE: Compact Russian Sentence Embeddings with a Sign-Coded Static Encoder

    Nov 10, 2026Boris Malashenko, Ivan Jarsky, Egor Soldatov +6Sentence EmbeddingsBinary Quantization

  3. IFRS Compliance Verification: An Open Multi-LLM Benchmark and Content-Conditioned Ensemble Classifier

    Nov 10, 2026Aghoghomena Akasukpe, Li Yang, Xinyao Zhou +2Financial Language Model EvaluationLanguage Model Ensembles

  4. Iterated Integrals as Lexical Fingerprints: Path Signature Embeddings for Lexical Similarity

    Oct 30, 2026Raj Shekhar Singh, Pratham AgarwalSentence EmbeddingsPath Signatures

  5. TEMPS: Temporal Sentence Embeddings for Temporal Information Retrieval

    Sep 23, 2026Mourad Hassani, Julien Romero, Amel Bouzeghoub +1Sentence EmbeddingsTemporal IR

  6. Evaluating Multilingual Sentence Embeddings for Translation Error Detection:An English--Greek Contrastive Study

    Aug 28, 2026Eleftherios Kalogeros, Athanasios Ntalakas, Manolis Gergatsoulis +2MT EvaluationSentence Embeddings

  7. KinyaEmbed: Contrastive Sentence Embeddings for Kinyarwanda via Multi-Stage Curriculum Training

    Aug 27, 2026Ireddi Rakshitha, Devavarapu Yashwanth, Ntakirutimana PierreSentence EmbeddingsAfrican Language Processing

  8. Where A Small Language Model Helps in Invoice Categorisation, Understood Through Embedding Geometry

    Aug 18, 2026Emma Ceccherini, Daniel Lawson, Anjulika SalhanSmall Language ModelsText Classification

  9. CDAE: Enhancing Perturbation Robustness in Pretrained Language Models with Contrastive Denoising

    Jul 30, 2026Sina Heydari, Amirreza Abbasi, Mohsen Hooshmand +1Contrastive LearningDenoising Autoencoders

  10. From transcription to semantic corpus analysis: unsupervised learning of sentence representations for ancient languages

    Jul 27, 2026Th{é}otime de la SelleSemantic Textual SimilaritySentence Embeddings

  11. Multilingual Sentence Embeddings for Linguistic-Integrated Reliability Audit

    Jul 20, 2026Ummugul Bezirhan, Ji Yoon Jung, Matthias von DavierSentence EmbeddingsEducational Assessment

  12. Riemannian Geometry for Pre-trained Language Model Embeddings

    Jul 8, 2026Szczepan Konior, Alexandre Quemy, Przemysław Klocek +2Sentence EmbeddingsGeometric Representation Learning

  13. Beyond Multilingual Averages: MTEB-PT, a Benchmark for Portuguese Sentence Encoders

    Jul 5, 2026Lucas Hideki Takeuchi Okamura, Alexandre Alcoforado, Anna Helena Reali CostaSentence EmbeddingsText Embedding Evaluation

  14. Evaluating Document-Tuned Transformer Representations for Person-level Mental Health Assessment

    Jun 19, 2026Aaron Marker, Oscar Kjell, Vasudha Varadarajan +1Sentence EmbeddingsMental Health

  15. Correlation Is Not Enough: Embedding Human Metadata for Individual Causal Discovery

    Jun 8, 2026Suraj Biswas, Saurabh Gupta, Pritam MukherjeeContrastive LearningSentence Embeddings

  16. Modeling semantic association in self-paced reading with language model embeddings

    Jun 5, 2026Sara Møller Østergaard, Kenneth Enevoldsen, Afra Alishahi +1Sentence EmbeddingsText Embedding Evaluation

  17. Principles of Concept Representation in Sentence Encoders

    Jun 5, 2026Isabelle Mohr, John Dujany, Jonathan Souquet +1Sentence EmbeddingsCompositional Reasoning

  18. Model-Based Quality Assessment for Massively Multilingual Parallel Data

    May 29, 2026Abdelaziz M. A. Ibrahim, Zihao Li, Jörg Tiedemann +1Sentence EmbeddingsMT Evaluation

  19. Adapting Multilingual Embedding Models to Turkish via Cross-Lingual Tokenizer Surgery and Offline Distillation

    May 28, 2026M. Ali Bayram, Banu Diri, Savaş YıldırımMultilingual Language ModelsSentence Embeddings

  20. Lost in State Space: Probing Frozen Mamba Representations

    Apr 30, 2026Bhagyashree Wagh, Akash SinghRepresentation GeometryRepresentation Collapse