Knowledge Selection
Knowledge selection focuses on efficiently choosing relevant information from vast knowledge sources to improve the performance of language models, particularly in tasks like question answering and dialogue generation. Current research emphasizes developing methods that address knowledge conflicts, improve the accuracy and efficiency of knowledge retrieval (often using graph-based or attention mechanisms), and incorporate diverse knowledge sources, including visual and textual data. These advancements are crucial for mitigating issues like hallucinations and improving the factual accuracy and coherence of AI-generated text, leading to more reliable and effective applications in various domains.
Papers
Steering Knowledge Selection Behaviours in LLMs via SAE-Based Representation Engineering
Yu Zhao, Alessio Devoto, Giwon Hong, Xiaotang Du, Aryo Pradipta Gema, Hongru Wang, Kam-Fai Wong, Pasquale Minervini
Policy-driven Knowledge Selection and Response Generation for Document-grounded Dialogue
Longxuan Ma, Jiapeng Li, Mingda Li, Wei-Nan Zhang, Ting Liu