Text Embedding Models

Ask about this topic

Overview

Text embedding models turn language into vectors so systems can compare texts, retrieve relevant documents, group content, or use text as features in other tasks. Common approaches include contextual transformer encoders trained with contrastive learning, hard negatives, synthetic query–document pairs, and distillation; newer methods also adapt large language models through prompting, reasoning objectives, or test-time refinement. Work spans multilingual and domain-specific retrieval, long-context representation, and efficient deployment through compression, quantization, and smaller student models. A central challenge is that benchmark scores can depend heavily on prompts, datasets, and task type, so stronger general-purpose performance does not guarantee robust results in a particular language or application.

Latest papers

CardsList

126 papers16 papers in the last four weeks, up 100% on the four weeks before. 0.1% of all new papers.

  1. ORPHEAS: A Cross-Lingual Greek-English Embedding Model for Retrieval-Augmented Generation

    Apr 22, 2026Ioannis E. Livieris, Athanasios Koursaris, Alexandra Apostolopoulou +2Retrieval-Augmented GenerationWord Embeddings

    Novelcore, Athens, GR 10436 · Department of Business Administration & Organization Administration, University of Peloponnese, Kalamata„ GR 24100

  2. Linear-Time and Constant-Memory Text Embeddings Based on Recurrent Language Models

    Apr 20, 2026Tobias Grantner, Emanuel Sallinger, Martin FlechlRecurrent Language ModelsMemory-Efficient Inference

    Dynatrace Research · TU Wien · University of Oxford

  3. TeleEmbedBench: A Multi-Corpus Embedding Benchmark for RAG in Telecommunications

    Apr 20, 2026Pranshav Gajjar, Vijay K ShahText Embedding EvaluationText Embedding Models

    NextG Wireless Lab, North Carolina State University, Raleigh, USA

  4. Mira-Embeddings-V1: Domain-Adapted Semantic Reranking for Recruitment via LLM-Synthesized Data

    Apr 20, 2026Zhaohua Liang, Zhilin Wang, Renjie Cao +1Learning to RankSemantic Search

    OpenJobs AI · San Francisico, CA, USA

  5. FLARE: Task-agnostic embedding model evaluation through a normalization process

    Apr 19, 2026Jingzhou Jiang, Yixuan Tang, Yi Yang +1Text Embedding EvaluationText Embedding Models

    The Hong Kong University of Science and Technology

  6. REZE: Representation Regularization for Domain-adaptive Text Embedding Pre-finetuning

    Apr 19, 2026Seungmin Lee, Jeonghwan Lee, Hyunkuk Lim +2Text EmbeddingsRepresentation Learning

    PwC Korea GenAI Team, Seoul, South Korea

  7. JFinTEB: Japanese Financial Text Embedding Benchmark

    Apr 17, 2026Masahiro Suzuki, Hiroki SakajiText Embedding EvaluationText Embedding Models

    Amova Asset Management Co., Ltd. · Tokyo, Japan · Hokkaido University +1

  8. Cognitive-Linguistic Indicators of Depression in Online Communities: Analysed by DistilBERT and Holographic Reduced Representation

    Apr 15, 2026Brian Van SteenDepression DetectionText Embedding Models

    School of Computing, University of Leeds

  9. A comparative study of transformer-based embeddings for topic coherence

    Apr 10, 2026Alex Ding, Tarun Rapaka, Willy Rodriguez +1Topic ModelingText Embedding Models

  10. Evaluation of Embedding-Based and Generative Methods for LLM-Driven Document Classification: Opportunities and Challenges

    Apr 5, 2026Rong Lu, Hao Liu, Song HouEarth ScienceText Classification

  11. Embedding Enhancement via Fine-Tuned Language Models for Learner-Item Cognitive Modeling

    Apr 5, 2026Yuanhao Liu, Zihan Zhou, Kaiying Wu +5Cognitive Diagnostic ModelsComputerized Adaptive Testing

    East China Normal University Shanghai, China · Tencent Inc Shenzhen, China · Shanghai Innovation Institute Shanghai, China

  12. Pooling and Semantic Shift: The Fundamental Challenges in Long Text Embedding and Retrieval

    Mar 22, 2026Hang Gao, Wujiang Xu, Kai Mei +1Text EmbeddingsText Embedding Models

    Rutgers University

  13. F2LLM-v2: Inclusive, Performant, and Efficient Embeddings for a Multilingual World

    Mar 19, 2026Ziyin Zhang, Zihan Liao, Hang Yu +2Text EmbeddingsText Embedding Models

    Ant Group · Shanghai Jiao Tong University

  14. From Topic to Transition Structure: Unsupervised Concept Discovery at Corpus Scale via Predictive Associative Memory

    Mar 19, 2026Jason DuryUnsupervised Visual Concept DiscoveryText Clustering

    Independent Researcher

  15. Embedding World Knowledge into Tabular Models: Towards Best Practices for Embedding Pipeline Design

    Mar 18, 2026Oksana Kolomenko, Ricardo Knauer, Erik RodnerTabular PredictionTabular Representation Learning

    KI-Werkstatt, University of Applied Sciences Berlin HTW Berlin, 10313 Berlin, Germany

  16. Operationalising Cyber Risk Management Using AI: Connecting Cyber Incidents to MITRE ATT&CK Techniques, Security Controls, and Metrics

    Mar 12, 2026Emad Sherif, Iryna Yevseyeva, Vitor Basto-Fernandes +1CybersecurityCyber Threat Intelligence

    Faculty of Technology, Arts and Culture, De Montfort University, Leicester, United Kingdom · Instituto Universitário De Lisboa (ISCTE-IUL), University Institute of Lisbon, ISTAR-IUL, Lisboa, Portugal · Sorbonne Université, CNRS, LIP6, 75005 Paris, France

  17. BTZSC: A Benchmark for Zero-Shot Text Classification Across Cross-Encoders, Embedding Models, Rerankers and LLMs

    Mar 12, 2026Ilias AarabZero-Shot Text ClassificationLLM Evaluation

    European Central Bank, Frankfurt am Main, Germany

  18. LLM2Vec-Gen: Generative Embeddings from Large Language Models

    Mar 11, 2026Parishad BehnamGhader, Vaibhav Adlakha, Fabian David Schmidt +3Text Embedding ModelsSelf-Supervised Pre-Training

    McGill University · Mila–Quebec AI Institute · ServiceNow Research +3

  19. One Model Is Enough: Native Retrieval Embeddings from LLM Agent Hidden States

    Mar 9, 2026Bo JiangAgentic RetrievalText Embedding Models

    Temple University

  20. CONE: Embeddings for Complex Numerical Data Preserving Unit and Variable Semantics

    Mar 5, 2026Gyanendra Shrestha, Anna Pyayt, Michael GubanovNumerical Reasoning in Language ModelsRepresentation Learning

    Florida State University · University of South Florida

  21. World Properties without World Models: Distributional Associations and the Interpretation of Decoding Results from Language Models

    Mar 4, 2026Elan BarenholtzLLM World ModelsWord Embeddings

    Department of Psychology & Center for Complex Systems and Brain Sciences Florida Atlantic University

  22. Bootstrapping Embeddings for Low Resource Languages

    Mar 2, 2026Merve Basoz, Andrew Horne, Mattia OpperText Embedding ModelsLow-Resource Language Processing

    School of Informatics, University of Edinburgh, UK · Edina, University of Edinburgh, UK

  23. Asking the Right Questions: Ontology-Grounded Interpretable Embeddings for Biomedical Text

    Mar 2, 2026Yixuan Tang, Zhenghong Lin, Yandong Sun +3Text EmbeddingsRepresentation Learning

    School of Computing, National University of Singapore

  24. Tracing the Evolution of Word Embedding Techniques in Natural Language Processing

    Feb 27, 2026Minh Anh Nguyen, Kuheli Sai, Minh NguyenWord EmbeddingsText Embedding Models

    Texas Tech University Lubbock, Texas · University of Pittsburgh Pittsburgh, Pennsylvania · Florida Atlantic University Boca Raton, Florida

  25. FinAnchor: Aligned Multi-Model Representations for Financial Prediction

    Feb 24, 2026Zirui He, Huopu Zhang, Yanguang Liu +2Financial ForecastingLanguage Model Ensembles

    New Jersey Institute of Technology · Georgia Institute of Technology · Chinese University of Hong Kong, Shenzhen

  26. Explicit Grammar Semantic Feature Fusion for Robust Text Classification

    Feb 24, 2026Azrin Sultana, Firoz AhmedText ClassificationFeature Fusion

    Department of Computer Science, American International University-Bangladesh, Dhaka-1229, Bangladesh

  27. Predicting Contextual Informativeness for Vocabulary Learning using Deep Learning

    Feb 20, 2026Tao Wu, Adam KapelnerSupervised LearningIn-Context Example Selection

  28. GATech at AbjadGenEval Shared Task: Multilingual Embeddings for Arabic Machine-Generated Text Classification

    Feb 17, 2026Ahmed Khaled KhamisMultilingual Text ClassificationAI-Generated Text Detection

    Georgia Institute of Technology

  29. jina-embeddings-v5-text: Task-Targeted Embedding Distillation

    Feb 17, 2026Mohammad Kalim Akram, Saba Sturua, Nastia Havriushenko +4Text Embedding ModelsKnowledge Distillation

    Jina by Elastic

  30. GRAN-TED: Generating Robust, Aligned, and Nuanced Text Embedding for Diffusion Models

    Dec 17, 2025Bozhou Li, Sihan Yang, Yushuo Guan +6Text Embedding EvaluationT2I Generation

    Peking University · Kling Team, Kuaishou Technology · Xi’an Jiaotong University +1