cs.CLMar 27, 2026

AMALIA Technical Report: A Fully Open Source Large Language Model for European Portuguese

Authors: Afonso Simplício, Gonçalo Vinagre, Miguel Moura Ramos, Diogo Tavares, Rafael Ferreira, Giuseppe Attanasio, Duarte M. Alves, Inês Calvo, 

Organizations: NOVA School of Science and Technology · NOVA LINCS · Instituto de Telecomunicações · Instituto Superior Técnico, Universidade de Lisboa · 

Abstract

Despite rapid progress in open large language models (LLMs), European Portuguese (pt-PT) remains underrepresented in both training data and native evaluation, with machine-translated benchmarks likely missing the variant's linguistic and cultural nuances. We introduce AMALIA, a fully open LLM that prioritizes pt-PT by using more high-quality pt-PT data during both the mid- and post-training stages. To evaluate pt-PT more faithfully, we release a suite of pt-PT benchmarks that includes translated standard tasks and four new datasets targeting pt-PT generation, linguistic competence, and pt-PT/pt-BR bias. Experiments show that AMALIA matches strong baselines on translated benchmarks while substantially improving performance on pt-PT-specific evaluations, supporting the case for targeted training and native benchmarking for European Portuguese.

Figures & tables

Explore similar work

CardsList
  1. AMALIA-VL: A Native European Portuguese Open-Source Vision and Language Model

    Jun 17, 2026Diogo Glória-Silva, João Cardeira, Manuel Letras da Luz +8Vision-Language ModelsLarge Vision-Language Models

  2. CLARIN-PT-LDB: An Open LLM Leaderboard for Portuguese to assess Language, Culture and Civility

    Mar 13, 2026João Silva, Luís Gomes, António BrancoLLM EvaluationPortuguese Language Models

  3. ALBA: A European Portuguese Benchmark for Evaluating Language and Linguistic Dimensions in Generative LLMs

    Mar 27, 2026Inês Vieira, Inês Calvo, Iago Paulo +6LLM EvaluationLanguage Model Generation Evaluation