Dense Retriever
Dense retrieval focuses on efficiently finding relevant information (e.g., documents, passages) from large datasets by representing both queries and data points as dense vectors, enabling fast similarity comparisons. Current research emphasizes improving the accuracy and efficiency of these methods, exploring techniques like contrastive learning, knowledge distillation, and the integration of large language models (LLMs) to enhance retrieval performance, particularly in low-resource or zero-shot scenarios. These advancements are significant for various applications, including question answering, conversational search, and biomedical literature search, by enabling faster and more accurate information access.
Papers
Precise Zero-Shot Dense Retrieval without Relevance Labels
Luyu Gao, Xueguang Ma, Jimmy Lin, Jamie Callan
What Are You Token About? Dense Retrieval as Distributions Over the Vocabulary
Ori Ram, Liat Bezalel, Adi Zicher, Yonatan Belinkov, Jonathan Berant, Amir Globerson
Adam: Dense Retrieval Distillation with Adaptive Dark Examples
Chongyang Tao, Chang Liu, Tao Shen, Can Xu, Xiubo Geng, Binxing Jiao, Daxin Jiang