cs.CLOct 21, 2026

Task-Preserving Multilingual Instruction Tuning for Open-Ended QA in WMT 2026 MIST

Authors: Aleix Sant, Jordi Luque, Carlos Escolano

Organizations: Scientific Research, Telefónica Innovación Digital · Universitat Politècnica de Catalunya

Abstract

This paper describes our submission to the WMT 2026 Multilingual Instruction Shared Task. We adapt Qwen3-8B with LoRA using organiser-provided data, EuroAlpaca, a multilingual instruction dataset created through task-preserving localisation, and CrossEuroAlpaca, a cross-lingual augmentation that assigns different source and target languages to instructions, contexts and responses. Our system targets open-ended question answering (QA-OEG) in ten shared-task languages represented in the auxiliary data. Under matched decoding, adaptation improves the mean Gemma-4 judge score on target-language QA-OEG by 7.8% relative to the base model. On an additional evaluation using the Aya Evaluation Suite across all shared-task languages, it yields relative gains of 41.5% in macro-averaged ROUGE-L and 2.9% in BERTScore-F1, with larger improvements in target languages. However, these gains are task- and language-specific. Gemma-4 scores improve for QA-OEG and summarisation in the target languages but decline for context-grounded QA there and across all three tasks in the non-target languages.

Figures & tables

Explore similar work

CardsList
  1. EuroAlpaca: Task-Preserving Localisation of Instruction Data for European Languages

    Sep 4, 2026Aleix Sant, Jordi Luque, Carlos EscolanoInstruction TuningMachine Translation

  2. Which LoRA? An Empirical Study on the Effectiveness of LoRA Techniques During Multilingual Instruction Tuning

    Jun 9, 2026Thamali Wijewardhana, Napoleon H. Reyes, Surangika RanathungaLow-Rank AdaptationCross-Lingual Transfer