cs.CLOct 22, 2025

The Art of Asking: Multilingual Prompt Optimization for Synthetic Data

Authors: David Mora, Viraat Aryabumi, Wei-Yin Ko, Sara Hooker, Julia Kreutzer, Marzieh Fadaee

Organizations: Cohere Labs · Cohere

Abstract

Synthetic data has become a cornerstone for scaling LLMs, yet its benefits for multilingual modeling remain bottlenecked by translation. Translation for data augmentation inherits English-centric framing and style and neglects cultural dimensions, ultimately constraining model generalization. We argue that the overlooked prompt space offers a more powerful lever for improving multilingual performance. We introduce a lightweight framework for prompt-space optimization, where translated prompts are systematically transformed for Naturalness, Cultural Adaptation, and Difficulty Enhancement. Using an off-the-shelf multilingual LLM, we apply these transformations to prompts from 12 languages spanning 7 families. Under identical data conditions, our approach achieves substantial and consistent downstream improvements over the translation-only baseline: +4.7% accuracy on Global-MMLU, +2.4% XCometXL on Flores and +35.3% wins in preferences on mArenaHard. These gains are further corroborated by human preferences on open-ended creative writing. We establish prompt-space optimization as a simple yet powerful paradigm for building multilingual LLMs that are more robust, culturally grounded, and globally capable.

Figures & tables

Appendix figures & tables20 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. No One Fits All: From Fixed Prompting to Learned Routing in Multilingual LLMs

    Apr 18, 2026Wei-Chi Wu, Sheng-Lun Wei, Hen-Hsen Huang +1Multilingual Language Model EvaluationLLM Prompting

  2. LLMs Get Smarter from Targeted Synthetic Multilingual Data

    Aug 16, 2026Ishika Agarwal, Arkajyoti Charaborty, Tanner Sorensen +2Multilingual Language ModelsCross-Lingual Reasoning in Language Models

  3. Translation Asymmetry in LLMs as a Data Augmentation Factor: A Case Study for 6 Romansh Language Varieties

    Mar 26, 2026Jannis Vamvas, Ignacio Pérez Prat, Angela Heldstab +3Dialectal MTMachine Translation