Text Embedding Evaluation

Ask about this topic

Momentum

3 papers in the last four weeks, down 25% on the four weeks before. 0.0% of all new papers.

Jul 13Week of Sep 28
View on map

Latest papers 60

All topics
CardsList

  1. Your Prompt Should Do More: Effects of Retrieval Instructions in Embedding Models

    Oct 7, 2026Amanda Myntti, Jenna Kanerva, Veronika Laippala +1Text Embedding ModelsInformation Retrieval

    TurkuNLP University of Turku, Finland · Ellis Institute Finland

  2. A Safe Prototype Is Not a Safety Direction: Reference Dependence and Prompt Confounds in Response-Safety Embeddings

    Oct 1, 2026Sahil KadadekarPrototype-Based ClassificationLLM Evaluation

    New York University

  3. Embedding Models Measure in Peculiar Ways

    Sep 17, 2026Juri Opitz, Andrianos MichailText EmbeddingsText Embedding Evaluation

    Dept. of Computational Linguistics University of Zurich

  4. Where Post-Training Quantization Breaks Text Embedders: A Measured Map Across Four Embedder Families

    Sep 14, 2026Hyojung HanText Embedding EvaluationWeight-Only Quantization

    ThakiCloud

  5. ExecRetrieval: Measuring the Functional-Correctness Gap in Code-Embedding Retrieval

    Sep 1, 2026Aaryan Kapoor, Md Abdullah Al Hafiz KhanText Embedding EvaluationInformation Retrieval

    Kennesaw State University

  6. Do General NLP Embeddings Capture Ontological Reasoning?

    Aug 31, 2026Hamed Babaei Giglou, Jennifer D'Souza, Sören AuerLogical ReasoningText Embedding Evaluation

    TIB Leibniz Information Centre for Science and Technology · Hannover, Lower Saxony, Germany · L3S Research Center, Leibniz University of Hannover

  7. The Embedder's Dilemma: LLMs Are Better, but at What Cost?

    Aug 13, 2026Adnan El Assadi, Niklas Muennighoff, Jinhyuk LeeLLM Inference EfficiencyLLM Evaluation

    Harvard University · Stanford University · Independent Researcher

  8. Similarity Gates Approve Reversals: A Validity Audit of Embedding-Cosine Thresholds in Agent Systems

    Aug 10, 2026Scott E. FriasSemantic Textual SimilarityText Embedding Evaluation

    Eigenforma · Freemind Labs

  9. Calibrating WEAT Against Anisotropy: ZCA Whitening as a Geometric Pre-Processing Step for Embedding Association Tests

    Aug 7, 2026Seitaro Ono, Senna Ross, Jun SaikiNeural Representation GeometryText Embedding Evaluation

    Graduate School of Human and Environmental Studies, Kyoto University, Kyoto, Japan · Brock University, St. Catharines, Ontario, Canada

  10. How Far Do Simple Transformations Translate Across Text Embedding Models?

    Aug 6, 2026Sid Ali Hamideche, Louis-Adrien Dufrène, Quentin Lampin +1Representation LearningText Embedding Evaluation

    Orange Research · Orange

  11. Mapping Similarity Spaces across Embedding Models with Synthetic Query Probing

    Aug 6, 2026Marcin Rozmus, Peter van der PuttenText Embedding EvaluationText Embedding Models

    GenAI Engineering, Pegasystems, Kraków, Poland · AI Lab, Pegasystems, Amsterdam, The Netherlands · LIACS, Leiden University, Leiden, the Netherlands

  12. Do Static Embeddings Add Value to Hybrid Dutch Retrieval?

    Aug 3, 2026António Pereira BarataText EmbeddingsWord Embeddings

  13. Choosing a Text Embedding Model: A Practical Benchmarking and Decision Framework

    Jul 26, 2026Madhav S BaidyaModel SelectionText Embedding Evaluation

    Indian Institute of Technology (BHU) Varanasi

  14. A Comparative Evaluation of Embeddings and LLMs in a Greek Book Publisher Setting - The CUP Dataset

    Jul 23, 2026Katerina Papantoniou, Panagiotis Papadakos, Theodore Patkos +3Text Embedding EvaluationMultilingual IR

    ICS-FORTH Heraklion, Greece · Crete University Press Heraklion, Greece · University of Crete, Computer Science Department, Heraklion, Greece

  15. Multilingual Sentence Embeddings for Linguistic-Integrated Reliability Audit

    Jul 20, 2026Ummugul Bezirhan, Ji Yoon Jung, Matthias von DavierSentence EmbeddingsEducational Assessment

    Boston College Chestnut Hill, Massachusetts, USA

  16. From Text to Parameters: Predicting Item Parameters from Embedding Regularization with Reliability and Design Ceilings

    Jul 8, 2026Shi-Ting Chen, Jinsong ChenText Embedding EvaluationBenchmark Validity

    Faculty of Education, The University of Hong Kong

  17. MTEB-BR: A Text Embedding Benchmark for Brazilian Portuguese

    Jul 6, 2026Tardelli Ronan Coelho StekelText Embedding EvaluationText Embedding Models

    Federal Institute of S˜ao Paulo (IFSP) S˜ao Paulo, Brazil

  18. Beyond Multilingual Averages: MTEB-PT, a Benchmark for Portuguese Sentence Encoders

    Jul 5, 2026Lucas Hideki Takeuchi Okamura, Alexandre Alcoforado, Anna Helena Reali CostaSentence EmbeddingsText Embedding Evaluation

    Escola Politécnica, Universidade de São Paulo, São Paulo, Brazil

  19. ALEE: Any-Language Evaluation of Embeddings via English-Centric Minimal Pairs

    Jun 30, 2026Andrianos Michail, Stylianos Psychias, Michelle Wastl +3Text Embedding EvaluationLow-Resource Language Processing

    Department of Computational Linguistics University of Zurich

  20. STEB: Style Text Embedding Benchmark

    Jun 30, 2026Rafael Rivera Soto, Anna Wegmann, Cristina AggazzottiText EmbeddingsText Embedding Evaluation

    1Johns Hopkins University · 2Utrecht University

  21. SABER-Math: Automated Benchmark for Information Retrieval Evaluation in Mathematics

    Jun 29, 2026Nikolay Georgiev, Maria Drencheva, Kseniia Ibragimova +3Text Embedding EvaluationLLM Reranking

    INSAIT, Sofia University “St. Kliment Ohridski” · ETH Zurich

  22. Anisotropy Decides Cosine vs. Rank Metrics for Text Embeddings

    Jun 28, 2026V. S. Raghu ParupudiSemantic Textual SimilarityNeural Representation Geometry

    University of California, San Diego

  23. A Comparative Study on Affective Cues in Text Embeddings Across Psychological Emotion Theories

    Jun 27, 2026Fabio Ciani, Harald Schweiger, Emilia Parada-Cabaleiro +1Text EmbeddingsText Embedding Evaluation

    Department of Electronics, Information, and Bioengineering, Polytechnic University of Milan · Multimedia Mining and Search Group, Institute of Computational Perception, Johannes Kepler University Linz · Department of Music Pedagogy, Nuremberg University of Music +1

  24. Does My Embedding Reflect That A=BA = B? Evaluating Mathematical Equivalence in Embedding Models

    Jun 22, 2026Jiaying Ye, Samarth Rao, Leo Carlin +9Contrastive LearningText Embedding Evaluation

    University of Washington · Axiom Math, University of Washington · Pacific Northwest National Laboratory

  25. Do LLM Embedding Spaces Recover Expert Structure?

    Jun 22, 2026Yixuan Zhu, Zhenke Duan, Fanghen LiLLM Fine-TuningMental Health

    Zhongnan University of Economics and Law

  26. HAKARI-Bench: A Lightweight Benchmark for Comparing Retrieval Architectures and Efficiency Settings under Unified Conditions

    Jun 22, 2026Yuichi TatenoBenchmark DesignText Embedding Evaluation

  27. Evaluating Document-Tuned Transformer Representations for Person-level Mental Health Assessment

    Jun 19, 2026Aaron Marker, Oscar Kjell, Vasudha Varadarajan +1Sentence EmbeddingsMental Health

    Vanderbilt University · Lund University · Carnegie Mellon University

  28. Examining the Limits of Word2Vec with Toki Pona

    Jun 15, 2026Daniel Zhenhan Huang, Hongchen WuText Embedding EvaluationDistributional Semantics

    Georgia Institute of Technology Atlanta, GA

  29. SkMTEB: Slovak Massive Text Embedding Benchmark and Model Adaptation

    Jun 11, 2026Marek Šuppa, Andrej Ridzik, Daniel Hládek +2Text EmbeddingsWord Embeddings

    Comenius University in Bratislava, Slovakia · Kempelen Institute of Intelligent Technologies, Bratislava, Slovakia · Technical University of Košice, Slovakia +1

  30. Modeling semantic association in self-paced reading with language model embeddings

    Jun 5, 2026Sara Møller Østergaard, Kenneth Enevoldsen, Afra Alishahi +1Sentence EmbeddingsText Embedding Evaluation

    Department of Computational Cognitive Science, Tilburg University · Center for Humanities Computing, Aarhus University

  31. Principles of Concept Representation in Sentence Encoders

    Jun 5, 2026Isabelle Mohr, John Dujany, Jonathan Souquet +1Sentence EmbeddingsCompositional Reasoning

    Idiap Research Institute · Merck KGaA

  32. When Does Complexity Conditioning Help a Frozen Sentence Embedding? A Controlled Study of Per-Sentence and Pair-Level Difficulty Adaptation

    Jun 2, 2026Suhwan HwangSentence EmbeddingsLearning to Rank

  33. SEA-LION-Embedding: Open and Reproducible Text Embeddings for Southeast Asia

    Jun 2, 2026Peerat Limkonchotiwat, Raymond Ng, Sarana Nutanong +1Text EmbeddingsText Embedding Evaluation

    AI Singapore · School of Information Science and Technology, VISTEC

  34. On the Robustness of Multilingual Text Embedding Rankings Across Learning Tasks, Languages, and Benchmark Datasets

    May 29, 2026Ana Gjorgjevikj, Barbara Koroušić Seljak, Tome EftimovMultilingual Language Model EvaluationText Embedding Evaluation

    Computer Systems Department Jožef Stefan Institute Ljubljana, Slovenia

  35. Entity-Collision: A Stratified Protocol for Attributing Retrieval Lift in Agent Memory

    May 28, 2026Youwang DengAgent MemoryText Embedding Evaluation

    Independent Researcher

  36. The Harder Text Embedding Benchmark (HTEB): Beyond One-dimensional Static Robustness

    May 27, 2026Manuel Frank, Haithem AfliText EmbeddingsText Embedding Evaluation

    Department of Computer Science Munster Technological University

  37. Grounding Text Embeddings in Stakeholder Associations

    May 26, 2026Jonathan Rystrøm, Sofie Burgos-Thorsen, Zihao Fu +3Text Embedding EvaluationHuman-in-the-Loop Evaluation

    University of Oxford, UK · Institute for Wicked Problems, Denmark · The Chinese University of Hong Kong, China +2

  38. Benchmarking Patent Embeddings: A Multi-Task Evaluation of 22 Models Across Retrieval, Classification, and Clustering

    May 22, 2026Amirhossein Yousefiramandi, Ciaran CooneyLegal IRClustering

    Clarivate, Intellectual Property Barcelona, Spain 08025

  39. A graph-based analysis of semantic types and coercion in contextualized word embeddings

    May 22, 2026Long Chen, Deniz Ekin YavasText EmbeddingsText Embedding Evaluation

    Heinrich Heine University Düsseldorf

  40. Benchmarking Google Embeddings 2 against Open-Source Models for Multilingual Dense Retrieval and RAG Systems

    May 22, 2026Stefano Cirillo, Domenico Desiato, Giuseppe Polese +1Retrieval-Augmented GenerationText Embedding Evaluation

    University of Salerno · Fisciano, Salerno, Italy · University of Bari +1

  41. One prompt is not enough: Instruction Sensitivity Undermines Embedding Model Evaluation

    May 21, 2026Yevhen Kostiuk, Kenneth EnevoldsenPrompt SensitivityText Embedding Evaluation

    Aarhus University

  42. IdioLink: Retrieving Meaning Beyond Words Across Idiomatic and Literal Expressions

    May 21, 2026Kai Golan Hashiloni, Daniel Fadlon, Lior Livyatan +3Figurative Language UnderstandingSemantic Search

    Data Science Institute, Reichman University, Herzliya, Israel · EfiArazi School of Computer Science, Reichman University, Herzliya, Israel · Vrije Universiteit Amsterdam, The Netherlands

  43. Structure Retention in Embedding Spaces as a Predictor of Benchmark Performance

    May 21, 2026Amanda Myntti, Jenna Kanerva, Veronika Laippala +1Text Embedding EvaluationText Embedding Models

    TurkuNLP, University of Turku, Finland · ELLIS Institute Finland

  44. To MRL or not to MRL: Text Embeddings are Robust to Truncation Without Matryoshka Learning, Except In Heavy Truncation Scenarios

    May 15, 2026Sotaro Takeshita, Yurina Takeshita, Simone Paolo Ponzetto +1Text EmbeddingsRepresentation Learning

    Data and Web Science Group, University of Mannheim, Germany · Independent Researcher · NEC Laboratories Europe, Heidelberg, Germany

  45. Task-Adaptive Embedding Refinement via Test-time LLM Guidance

    May 12, 2026Ariel Gera, Shir Ashury-Tahan, Gal Bloch +2Zero-Shot Text ClassificationLarge Language Model-Guided Optimization

    IBM Research

  46. The Proxy Presumption: From Semantic Embeddings to Valid Social Measures

    May 8, 2026Baishi Li, Ta Yu, Kelvin J. L. Koa +1Text EmbeddingsText Embedding Evaluation

    National University of Singapore · Asian Institute of Digital Finance

  47. Topic Is Not Agenda: A Citation-Community Audit of Text Embeddings

    May 8, 2026Junseon YooText Embedding EvaluationGraph-Based Retrieval

    Pluto Labs

  48. Is Textual Similarity Invariant under Machine Translation? Evidence Based on the Political Manifesto Corpus

    May 1, 2026Daria Boratyn, Damian Brzyski, Albert Leśniak +5Semantic Textual SimilarityText Embedding Evaluation

    aJagiellonian Center for Quantitative Political Science, Jagiellonian University, Kraków, Poland · bAGH University, Kraków, Poland · cJagiellonian Center for Digital Humanities, Jagiellonian University, Kraków, Poland

  49. Why Mean Pooling Works: Quantifying Second-Order Collapse in Text Embeddings

    Apr 30, 2026Tomomasa Hara, Hiroto Kurita, Masaaki Imaizumi +2Text EmbeddingsText Embedding Evaluation

    Tohoku University · The University of Tokyo · Kyoto University +3

  50. SemEval-2026 Task 4: Narrative Story Similarity and Narrative Representation Learning

    Apr 23, 2026Hans Ole Hatzel, Ekaterina Artemova, Haimo Paul Stiemer +2Semantic Textual SimilarityRepresentation Learning

    University of Hamburg1 · Toloka AI2 · German UDS3 +1

  51. Finding Meaning in Embeddings: Concept Separation Curves

    Apr 23, 2026Paul Keuren, Marc Ponsen, Robert Ayoub BagheriSentence EmbeddingsText Embedding Evaluation

    Utrecht University · Statistics Netherlands

  52. TeleEmbedBench: A Multi-Corpus Embedding Benchmark for RAG in Telecommunications

    Apr 20, 2026Pranshav Gajjar, Vijay K ShahText Embedding EvaluationText Embedding Models

    NextG Wireless Lab, North Carolina State University, Raleigh, USA

  53. FLARE: Task-agnostic embedding model evaluation through a normalization process

    Apr 19, 2026Jingzhou Jiang, Yixuan Tang, Yi Yang +1Text Embedding EvaluationText Embedding Models

    The Hong Kong University of Science and Technology

  54. JFinTEB: Japanese Financial Text Embedding Benchmark

    Apr 17, 2026Masahiro Suzuki, Hiroki SakajiText Embedding EvaluationText Embedding Models

    Amova Asset Management Co., Ltd. · Tokyo, Japan · Hokkaido University +1

  55. Comparison of Modern Multilingual Text Embedding Techniques for Hate Speech Detection Task

    Apr 16, 2026Evaldas Vaiciukynas, Paulius Danenas, Linas Ablonskis +5Sentence EmbeddingsText Embedding Evaluation

    Department of Information Systems, Faculty of Informatics, Kaunas University of Technology, Kaunas, Lithuania · Centre of Information Systems Design Technologies, Faculty of Informatics, Kaunas University of Technology, Kaunas, Lithuania

  56. LMEB: Long-horizon Memory Embedding Benchmark

    Mar 13, 2026Xinping Zhao, Xinshuo Hu, Jiaxin Xu +9Text Embedding EvaluationIR Evaluation

    Harbin Institute of Technology (Shenzhen) · Shenzhen Loop Area Institute (SLAI) · Peking University

  57. GRAN-TED: Generating Robust, Aligned, and Nuanced Text Embedding for Diffusion Models

    Dec 17, 2025Bozhou Li, Sihan Yang, Yushuo Guan +6Text Embedding EvaluationT2I Generation

    Peking University · Kling Team, Kuaishou Technology · Xi’an Jiaotong University +1

  58. A Framework for Deductive Semantic Content Analysis at Scale in Science Education Using Text Embeddings

    Aug 27, 2025Jonas Timmann Mjaaland, Markus Fleten Kreutzer, Halvor Tyseng +5Educational TechnologyText Embedding Evaluation

    Center for Interdisciplinary Education, University of Oslo, NO-0316 Oslo, Norway · Laboratory of Atomic and Solid State Physics, Cornell University, Ithaca, NY 14853, USA · Department of Physics, California State University Fullerton, Fullerton, CA 92831, USA +1

  59. ChEmbed: Enhancing Chemical Literature Search Through Domain-Specific Text Embeddings

    Aug 3, 2025Ali Shiraee Kasmaee, Mohammad Khodadad, Mahdi Astaraki +4Text Embedding EvaluationInformation Retrieval

    Department of Computational Science and Engineering, McMaster University, Canada · BASF Canada Inc., Canada · BASF Corporation, USA

  60. Chunk Twice, Embed Once: A Systematic Study of Segmentation and Representation Trade-offs in Chemistry-Aware Retrieval-Augmented Generation

    Jun 13, 2025Mahmoud Amiri, Thomas BocklitzDocument ChunkingText Embedding Evaluation

    Leibniz Institute of Photonic Technology, Albert-Einstein-Strasse 9, 07745 Jena, Germany · Institute of Physical Chemistry and Abbe Center of Photonics, Friedrich Schiller University Jena, Helmholtzweg 4, 07743 Jena, Germany