q-bio.QMNov 14, 2026

Generation of protein conformations using a simple inverted transformer

Authors: Luigi Leonardo Palese

Organizations: Department of Translational Biomedicine and Neuroscience - University of Bari ”Aldo Moro”

Abstract

Molecular dynamics is an extremely powerful approach for studying protein behavior, but it requires enormous computational resources to obtain an adequate sampling of possible conformations. Recently, thanks to successes in predicting three-dimensional protein structures, there has been an explosion of research exploring the opportunities offered by deep learning to address the problem of protein conformational landscape. In this work, an artificial intelligence system based on a variant of the Transformer architecture is introduced and applied to the problem of determining the ensemble of three-dimensional structures that a protein can access and their statistical weight. After being trained on a dataset of conformations of a particular protein obtained using classical all-atom molecular dynamics, this neural network is able to directly generate physically plausible protein conformations similar to those obtained both through molecular dynamics and experimentally. The ordered sequence of conformations obtained as output of the neural network rapidly converges towards the most populated regions of the protein's conformational landscape, suggesting that the system may have learned not only the protein's three-dimensional organization but also the thermodynamic weights of the various feasible conformations. These features, combined with its simplicity and low computational load, make this Transformer variant an ideal candidate for the development of systems capable of performing generative molecular dynamics.

Figures & tables

Explore similar work

CardsList
  1. ProtScape: A molecular structure and energy-aware representation for protein conformation generation

    Oct 27, 2024Siddharth Viswanath, Xingzhi Sun, Lucas Lee +9Molecular Dynamics SimulationMolecular Representation Learning

  2. Atomic Trajectory Modeling with State Space Models for Biomolecular Dynamics

    Mar 18, 2026Liang Shi, Jiarui Lu, Junqi Liu +3Molecular Dynamics SimulationState Space Models

  3. Polyformer: a generative framework for thermodynamic modeling of polymeric molecules

    Apr 15, 2026Alessio Valentini, David Pekker, Chungwen Liang +2Protein Conformational Ensemble GenerationProtein Structure Generation