cs.CLNov 14, 2026

Do Rule-Based Tools Help LLMs Translate Endangered Uralic Languages in the Prompt or over MCP?

Authors: Iaroslav Chelombitko, Mika Hämäläinen

Organizations: Metropolia University of Applied Sciences, Helsinki, Finland · Neapolis University Pafos, Paphos, Cyprus

Abstract

Komi-Zyrian, Moksha, Erzya and Udmurt have mature rule-based resources, among them finite-state analysers, constraint grammars and bilingual dictionaries, which language models do not use. We ask whether giving a model access to these resources improves machine translation from the four languages into English, and whether it matters how the access is provided: as analyses computed in advance and written into the prompt, or as tools that the model calls itself through the Model Context Protocol (MCP). We evaluate manually: an expert linguist read every English output of the strongest model under three conditions, 816 sentences in all, accepted or rejected each one, and named the main error in every rejected translation. With the analyses in the prompt, the number of accepted translations rises from 13 to 43 out of 272; with the tools attached it rises to 55. The gain comes from the bilingual dictionary. For Udmurt, whose dictionary has no English side, the prompt-based condition brings no gain at all, while for the other three languages an English gloss reaches the prompt for 74 to 80% of the source words. Tool calling is also much harder to get working than prompt injection. Of 31 open-weight models, 14 never call a tool, 11 of them because they cannot produce a usable call, and half of the calls that are made name a language the toolkit does not support. We release the data set, every model output and all tool-call logs.

Figures & tables

Appendix figures & tables8 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. No One Fits All: From Fixed Prompting to Learned Routing in Multilingual LLMs

    Apr 18, 2026Wei-Chi Wu, Sheng-Lun Wei, Hen-Hsen Huang +1Multilingual Language Model EvaluationLLM Prompting

  2. Out of Parameters, Saved by Syntax: UD-PrMPT for Parser Augmented Low Resource Machine Translation

    Nov 8, 2026Emma Thronson, Abhishek Purushothama, Amir ZeldesMachine TranslationLow-Resource MT

  3. Translate-R1: Cost-Aware Translation Tool Use via Reinforcement Learning

    Jun 5, 2026Pratik Jayarao, Chaitanya Dwivedi, Himanshu Gupta +5RL for Language ModelsLLM Tool Use