cs.LGOct 15, 2026

Poisoning the corpora of protein design systems during pre-training and retrieval

Authors: Charalampos Koilakos, Kimon-Antonios Provatas, Michail Patsakis, Candace SY Chan, Georgios A. Pavlopoulos, Ilias Georgakopoulos-Soares

Organizations: Division of Pharmacology and Toxicology, College of Pharmacy, The University of Texas at Austin, Dell Pediatric Research Institute, Austin, TX, USA. · Department of Computer Science, The University of Texas at Austin · Institute for Fundamental Biomedical Research, BSRC “Alexander Fleming,”16672 Vari, Greece · Division of Biological and Life Sciences, Mohamed bin Zayed University of Artificial Intelligence (MBZUAI), Building 1B, Masdar City, Abu Dhabi, United Arab Emirates.

Abstract

Protein foundation models increasingly support the generation of novel biological sequences, yet their reliance on large public datasets creates opportunities for adversarial manipulation of the material they learn from and retrieve. We investigate two data-only poisoning attacks against protein design systems, targeting the pre-training corpus of autoregressive protein language models and the retrieval corpus of a text-guided protein generator. For the first, we pre-trained ProtGPT2 and ProGen2 variants of 300 million parameters, introducing poisoned protein sequences containing one of two triggers followed by one of three payloads. Across all poisoned runs, both architectures acquired highly reliable trigger-dependent generation under uniform and ramped poisoning schedules. Under ramped exposure, the earliest majority activation occurred after only 200 contaminated examples, while for the uniform schedule earliest activation occurred around 5000 poisoned samples. For the second attack, we inserted records into a retrieval corpus system without modifying its weights or decoding procedure. A single query-aware record captured a top-16 retrieval position for 58% of templated requests and 97% of free-text requests. Conditional on successful poisoned retrieval, 62% of requests produced altered sequences, while 19-21% acquired the inserted domain by profile-HMM homology. A universal query-unaware attack using 1,500 records also achieved substantial retrieval capture and domain transfer. Together, these findings demonstrate that adversarial protein sequence contributions can establish persistent, sequence-specific behaviour during pre-training or redirect protein generation at inference, while leaving ordinary model behaviour largely preserved. Our work establishes the integrity and biological provenance of protein sequence data as critical safeguards for generative protein design systems.

Explore similar work

CardsList
  1. InstructPro2: Natural Language and Biological Grounding Guided De Novo Protein Design

    Oct 14, 2026Charles Novak, Zhenqiao Song, Chuan Li +2Protein DesignProtein Language Models

  2. Two-Stage Fine-Tuning for Protein Sequence Generation with Targeted Amino-Acid Composition

    Jun 26, 2026Violeta Basten-Romero, Rubén Muñoz-Tafalla, Anna María Díaz-Rovira +3Protein Language ModelsProtein Design

  3. Inference-Time Toxicity Mitigation in Protein Language Models

    Mar 4, 2026Manuel Fernández Burda, Santiago Aranguri, Iván Arcuschin Moreno +1Protein Language ModelsInference-Time Language Model Alignment