Overview

Text embedding evaluation studies whether vectors produced by language models preserve the distinctions needed for tasks such as semantic similarity, search, clustering, and classification. Researchers use broad suites such as MTEB and BEIR alongside domain- and language-specific benchmarks, controlled contrastive tests, and analyses of embedding geometry and robustness. Results show that model rankings often vary with task, language, prompts, data, and similarity metric, so performance on one benchmark may not predict performance elsewhere. A central challenge is ensuring that benchmark scores reflect meaningful distinctions and real deployment needs, including latency, cost, and the value of combining dense embeddings with lexical retrieval.

Latest papers

CardsList

87 papers8 papers in the last four weeks, up 100% on the four weeks before. 0.1% of all new papers.

  1. When the Bill Falls: Reusing the Old Index Defers,Never Avoids, Re-encoding in Complete Embedding-Model Migration

    Nov 16, 2026Nannan Zhao, Jiameng Zhang, Taoyu Zhong +2Text Embedding ModelsText Embedding Evaluation

  2. A Comparative Evaluation of BERT-Based and LLM-Based Models for Indic Sentence Similarity

    Nov 14, 2026Aishwarya Gunjal, Kanchan Khemnar, Pawan Poojary +2Semantic Textual SimilaritySentence Embeddings

  3. Saidzoda-Kazakh-EmbeddingGemma-300M: How Far One Epoch of Generated Questions Takes a Small Kazakh Embedder

    Nov 12, 2026Tohir Saidzoda, Madina Abdusalomzoda, Abubakr Abdullozoda +3Text Embedding ModelsDense Retrieval

  4. Saidzoda-Tajik-EmbeddingGemma-300M: Knowing Every Letter Is Not Reading Tajik

    Nov 8, 2026Tohir Saidzoda, Nekruz Maxudov, Bedil Karimov +5Text Embedding ModelsInformation Retrieval

  5. Balancing hierarchical representation and quantization: A performance trade-off in text embeddings

    Nov 4, 2026Kai Ponel, Marco Polignano, Erasmo Purificato +4Embedding CompressionText Embedding Evaluation

  6. MedHEB: Benchmarking Medical Embeddings Across Heterogeneous Clinical Evidence

    Nov 2, 2026Yingshu Li, Shaoyang Zhou, Zhanyu Wang +6Multimodal IRMultimodal Embedding

  7. TRACE: Training-aware Robustness and Challenge Evaluation for Text-Vision Embedding Models

    Oct 19, 2026Pume Tuchinda, Tinnakit Udsa, Peerat LimkonchotiwatVLM EvaluationVLM Robustness

  8. Beyond Black Boxes: Visual Grounding for Text Embeddings

    Oct 13, 2026Slimane LarabiInformation RetrievalText Embedding Models

  9. Geometric Structure Predicts Per-Example Neighborhood Loss Under PCA Truncation

    Oct 13, 2026Sriram Loganathan, Gokul Anand, Ragavan ArivazhaganText Embedding EvaluationEmbedding Compression

  10. Your Prompt Should Do More: Effects of Retrieval Instructions in Embedding Models

    Oct 7, 2026Amanda Myntti, Jenna Kanerva, Veronika Laippala +1Text Embedding ModelsInformation Retrieval

  11. Semantic Candidate-Job Matching: A Comparative Evaluation of Dense Embedding Models in Hybrid Retrieval

    Sep 20, 2026Sai Yashwant, Siddhartha Jain, Anurag Dubey +2Job-Candidate MatchingText Embedding Models

  12. Embedding Models Measure in Peculiar Ways

    Sep 17, 2026Juri Opitz, Andrianos MichailText EmbeddingsText Embedding Evaluation

  13. Do General NLP Embeddings Capture Ontological Reasoning?

    Aug 31, 2026Hamed Babaei Giglou, Jennifer D'Souza, Sören AuerLogical ReasoningText Embedding Evaluation

  14. Evaluating Multilingual Sentence Embeddings for Translation Error Detection:An English--Greek Contrastive Study

    Aug 28, 2026Eleftherios Kalogeros, Athanasios Ntalakas, Manolis Gergatsoulis +2MT EvaluationSentence Embeddings

  15. Embedding Models for Stance-Aware Argument Retrieval

    Aug 28, 2026Angelo Sparacino, Francesca Toni, Adam DejlComputational ArgumentationText Embedding Models

  16. KinyaEmbed: Contrastive Sentence Embeddings for Kinyarwanda via Multi-Stage Curriculum Training

    Aug 27, 2026Ireddi Rakshitha, Devavarapu Yashwanth, Ntakirutimana PierreSentence EmbeddingsAfrican Language Processing

  17. Dataset Scarcity Limits Robust Evaluation of Multilingual Embedding Models: A Case Study of Slavic Languages

    Aug 25, 2026Ana Gjorgjevikj, Barbara Koroušić Seljak, Tome EftimovMultilingual Language Model EvaluationText Embedding Evaluation

  18. Comparing Chunking and Embedding Strategies for Turkish RAG Systems

    Aug 24, 2026Mustafa Sertaç Türkel, Fatma Nur Korkmaz, Ahmet Tuğrul BayrakRetrieval-Augmented GenerationRAG Evaluation

  19. Lexical Coupling in GUI Element Grounding: Sentence Embeddings Track Labels across Mobile and Web

    Aug 22, 2026Qijia Chen, Giulio JacucciGUI GroundingText Embedding Evaluation

  20. Structuring Semantic Embeddings for Principle Evaluation: A Prototype-Guided Contrastive Learning Approach

    Aug 15, 2026Che Shen, Junwei Su, Lingpeng Kong +1Text Embedding ModelsPrototype Learning

  21. The Embedder's Dilemma: LLMs Are Better, but at What Cost?

    Aug 13, 2026Adnan El Assadi, Niklas Muennighoff, Jinhyuk LeeLLM Inference EfficiencyLLM Evaluation

  22. Calibrating WEAT Against Anisotropy: ZCA Whitening as a Geometric Pre-Processing Step for Embedding Association Tests

    Aug 7, 2026Seitaro Ono, Senna Ross, Jun SaikiNeural Representation GeometryText Embedding Evaluation