Training-Free BioNEL-RAG: Advancing Biomedical Entity Linking through Retrieval-Augmented Generation and Large Language Model
Authors: Ziyi Chen, Hui Liu, Ziyang Ling, Ronald X. Xu, Mingzhai Sun
Organizations: School of Biomedical Engineering, Division of Life Sciences and Medicine, University of Science and Technology of China, Hefei, China · Department of Precision Machinery and Precision Instruments, University of Science and Technology of China, Hefei, China
Biomedical Named Entity Linking (BioNEL) is the task of mapping mentions extracted from biomedical texts to canonical entities or concepts in the standardized knowledge base. Although existing methods have achieved remarkable performance in mapping accuracy, most rely on training with domain-specific datasets, which fundamentally limits their cross-domain adaptability. To address this limitation, we propose BioNEL-RAG, a novel training-free framework that combines retrieval-augmented generation (RAG) with large language models (LLMs). Within this framework, the RAG module focuses on retrieving candidate entities, while the large language model module plays the role of selecting the most appropriate candidate for entity normalization, which is based on the analysis of the mention's context, with the aid of its remarkable text comprehension capabilities. Experimental results demonstrate that BioNEL-RAG achieves performance comparable to existing methods without requiring training on subdomain datasets, whereas these methods necessitate fine-tuning on specific subdomains such as genes, diseases, or chemical compounds.
Figures & tables
Fig. 1: The overall frameworks of BioNEL-RAG. BioNEL-RAG is composed of two core components: Retrieval Augmentation, which is responsible for handling the dictionary and building the knowledge base, and Normalization, which processes the mentions to be normalized.
Fig. 2: Prompt Design for biomedical named entity linking task by LLMs.
NCBI-Disease
BC5CDR-Disease
BC5CDR-Chemical
Average
Acc@1
Acc@5
Acc@1
Acc@5
Acc@1
Acc@5
Acc@1
Acc@5
Sieve-Based [ 10 ]
0.847
-
0.841
-
0.907
-
0.865
-
Taggerone [ 11 ]
0.874
-
0.889
-
0.941
-
0.901
-
BNE [ 12 ]
0.877
-
0.906
-
0.958
-
0.913
-
BioBERT Ranking [ 13 ]
0.891
-
0.913
-
0.947
-
0.917
-
BioSYN [ 1 ]
0.911
0.939
0.924
0.958
0.963
0.972
0.933
0.956
TABLE I: Experimental results of models on three biomedical entity normalization datasets, with accuracy(Acc) serving as the evaluation metrics.
BC2GM-Gene
SMM4H-2017
Acc@1
Acc@5
Acc@1
Acc@5
BioBERT ranking
0.753
0.821
0.339
0.423
BioSYN
0.849
0.926
0.555
0.716
SAPBERT-BioSYN
0.905
0.949
0.606
0.765
Ours
0.914
0.949
0.617
0.786
TABLE II: Experimental results of learning-based models and BioNEL-RAG on unseen datasets.