Overview

Protein language models treat amino-acid sequences as languages, learning representations through objectives such as masked-residue prediction and autoregressive sequence generation. Researchers use these representations for tasks including remote homology, structure and function prediction, and mutation-effect scoring, evaluating them on benchmarks such as SCOPe, FLIP, and ProteinGym; fine-tuning, contrastive learning, and evolutionary or structural signals can further adapt the models. Generative approaches, including diffusion and reinforcement learning, aim to design proteins with desired properties, sometimes conditioning on structures, ligands, or natural-language instructions. A central challenge is balancing scale with efficiency and biological grounding: benchmark gains do not always transfer to new families or experiments, and predicted plausibility, interpretability, and safety require careful validation.

Latest papers

CardsList

74 papers7 papers in the last four weeks, down 42% on the four weeks before. 0.1% of all new papers.

  1. Calpha: Toward Native Biomolecular Intelligence in a General-Purpose Language Model

    Nov 16, 2026Yong Liu, Zhanpeng Shi, Peicong Lin +5Protein Structure PredictionProtein Language Models

  2. HyPLM Technical Report

    Nov 9, 2026Haowei Lin, Cai Zhou, Xiangxin ZhouProtein Language ModelsMasked Language Modeling

  3. recAMPLIFY: Large-Scale Pretraining of Recursive Protein Language Models

    Oct 19, 2026Saurav Jha, Qianli Liao, Robert Vernon +2Protein Language ModelsRecursive Language Models

  4. The Effectiveness and Durability of Pretraining Data Filtering in Protein Language Models

    Oct 19, 2026Aaron Maiwald, Roderick McNeill, Jaeyoung Lee +9Training Data CurationProtein Language Models

  5. Poisoning the corpora of protein design systems during pre-training and retrieval

    Oct 15, 2026Charalampos Koilakos, Kimon-Antonios Provatas, Michail Patsakis +3Data Poisoning AttacksRAG Poisoning Attacks

  6. ProtModernBERT: Compute-Efficient Protein Language Modeling

    Oct 14, 2026Alberto Martínez, Natalia Flechas Manrique, Llorenç Espinosa-Portalés +1Protein Language ModelsEfficient Language Model Training

  7. InstructPro2: Natural Language and Biological Grounding Guided De Novo Protein Design

    Oct 14, 2026Charles Novak, Zhenqiao Song, Chuan Li +2Protein DesignProtein Language Models

  8. ProTok: Unified Protein Tokenization via Modular Multi-Codebook Quantization

    Oct 13, 2026Romain Hardy, Xiaoman Zhang, Pranav RajpurkarProtein Representation LearningProtein Language Models

  9. Linear Fitness Subspace in Protein Language Models Enables Sample-Efficient Directed Evolution

    Oct 6, 2026SiYuan Ma, Canran Xiao, Zikai Xiao +5Protein Fitness PredictionProtein Language Models

  10. Learning Latent Protein Languages for Autoregressive Generation

    Oct 2, 2026Mahdi Pourmirzaei, Farzaneh Esmaili, Amir Ziashahabi +2Protein Structure GenerationProtein Language Models

  11. ORBIT-FMIB: Tracking Order-Resolved Epistatic Information Through ESM-2

    Sep 30, 2026Maryam Rahimimovassagh, Waldemar Karwowski, Ivan Garibay +1Protein Language ModelsProtein Representation Learning

  12. Analysis of Quantized and Efficiently Adapted Protein Language Models

    Sep 30, 2026Ilan Yaniv Zeisler, Sebastian Clancy, Pouriya Bayat +8Protein Language ModelsQuantization-Aware LoRA

  13. LEMON-ZEST: Evolution-Informed Tokenization for Efficient Protein Language Modeling

    Sep 29, 2026Biswajit Banerjee, Claudia Alvarez Carreno, Anton S. PetrovProtein Language ModelsProtein Representation Learning

  14. A General Harness for Protein Foundation Model Fitness Prediction

    Sep 28, 2026Yang Tan, Qijia Tian, Gangyu Sun +5protein mutation effect predictionProtein Fitness Prediction

  15. PFArena: Benchmarking Language Models for Protein Modification

    Sep 24, 2026Yawen Ouyang, Xinbo Zhang, Ziyuan Ma +15Protein Fitness PredictionProtein Language Models

  16. MT-ProtBERT: Multi-task Learning ProtBERT for Intrinsically Disordered Proteins Classification with Scarce Data

    Sep 21, 2026Jian Sun, Kingshuk Ghosh, Lilianna Houston +1Protein Language ModelsMulti-Task Learning

  17. SymFold: Synergizing Evolutionary and Structural Priors for Accurate Protein Inverse Folding

    Sep 1, 2026Handong Wang, Jiaxin Qi, Baisheng Lai +1Protein Language ModelsProtein Design

  18. Learning Task-Specific Antibody Representations via Function-Aware Masking

    Sep 1, 2026Ayan Goel, Thomas A. Walton, Amirali AghazadehMasked Language ModelingProtein Language Models

  19. Interpreting Latent Protein Language Model Features with Geometric Annotations

    Aug 26, 2026Siddharth Setlur, Djordje Mihajlovic, Darrick LeeMechanistic InterpretabilityProtein Language Models

  20. Unlocking Multimodal Protein Language Models at Inference Time

    Aug 26, 2026Yi Zhou, Qipeng Wang, Yunqing Liu +3Inference-Time SearchProtein Language Models

  21. Interpreting Protein Language Model Embeddings via Orthogonal Projection for Protein Fitness Prediction

    Aug 26, 2026Paulo Yanez Sarmiento, Pia Francesca Rissom, Manuel Pfeuffer +6Protein Language ModelsProtein Representation Learning

  22. Off-Manifold Collapse in Guided Protein Language Models

    Aug 19, 2026Shuibai Zhang, Xinchi Liu, Fred Zhangzhi Peng +4Protein Language ModelsLarge Language Model-Guided Optimization

  23. Task- and dataset-specific information in protein language models

    Aug 12, 2026Roman Joeres, Ilya Senatorov, Anastasia Kolchina +2Protein Language ModelsProtein Representation Learning

  24. LC-SEPLM: long-range contact-supervised adaptation for sequence-only protein representation learning

    Jul 24, 2026Chen Wang, Boming Kang, Qinghua CuiProtein Language ModelsProtein Representation Learning