cs.IROct 11, 2026

KhyontekAI at CheckThat! 2026: Multilingual Dense Retrieval and Cross-Encoder Reranking for Scientific Web Claims

Authors: Bhargab Jyoti Bhuyan, Pritam Deka

Organizations: Computer Science and Engineering Department, School of Engineering, Tezpur University, Assam, India · KhyontekAI, Guwahati, Assam, India

Abstract

Scientific claims shared through social media platforms frequently reference research findings without explicitly linking to the corresponding scientific publications. Automatically retrieving the correct scientific source for such claims is a challenging multilingual retrieval problem involving semantic matching, paraphrasing, noisy social media text, and cross-domain language variation. In this work, we present a multilingual two-stage retrieval framework for CLEF 2026 CheckThat! Task 1 on Source Retrieval for Scientific Web Claims. Our system combines fine-tuned dense retrieval models with cross-encoder reranking for improving multilingual scientific document retrieval. We evaluate multiple transformer-based dense retrieval architectures including multilingual-E5, BGE, and Contriever under different metadata configurations. We further investigate multilingual joint training, retrieval depth analysis, metadata enrichment, and language balancing strategies for improving retrieval effectiveness. Experimental results demonstrate that metadata enrichment consistently improves retrieval effectiveness, while fine-tuned cross-encoder reranking provides additional gains in retrieval precision. Our final multilingual system achieves MRR@5 scores of 0.6222 for English, 0.5112 for German, and 0.6254 for French, with an overall average MRR@5 score of 0.5862.

Figures & tables

Explore similar work

CardsList
  1. DeepSciVerify: Verifying Scientific Claim--Citation Alignment via LLM-Driven Evidence Escalation

    May 26, 2026Shaghayegh Sadeghi, Khashayar Khajavi, Rise Adhikari +1Selective PredictionCitation Verification

  2. Multilingual Fact-Checking at Scale: Fine-Tuned Compact Models vs LLMs

    Jun 7, 2026Pratuat Amatya, Vinay SettyMultilingual Language ModelsLLM Evaluation

  3. ClimateCheck 2026: Scientific Fact-Checking and Disinformation Narrative Classification of Climate-related Claims

    Mar 27, 2026Raia Abu Ahmad, Max Upravitelev, Aida Usmanova +2Scientific Claim VerificationAutomated Fact-Checking