Designing Protein Structures from Natural Language
Organizations: University of Washington · National University of Singapore · Allen Institute for AI (Ai2) · Howard Hughes Medical Institute
Abstract
A central challenge in de novo protein design is generating proteins with desired structural and functional properties. Existing design models typically require a dedicated input representation for each property, limiting the design objectives they support. We develop Prompteina, the first all-atom structure generation model that supports new and broader design objectives specified in natural language, analogous to text-to-image generation. To train Prompteina, we construct Prompteina-Data, a paired text--protein structure dataset of 1.8M structures and 50M+ captions describing global and residue-specific structural and functional properties. We adapt Proteina-Complexa, a pretrained structure generation model, through text-conditioned pretraining and finetuning that aligns residues with their corresponding text. Prompteina outperforms baselines on 15 of 18 structural properties and generates proteins that more closely match descriptions of their intended functions. In binder design, it leads baselines on at least 13 of 20 targets and improves interface confidence by 14% over the strongest baseline. With iterative in silico feedback, Prompteina's gain over non-iterative generation is 57% larger than the next-best baseline on the hardest targets. Finally, we experimentally validate Prompteina designs against GM2A, a target with no reported de novo binders. We identify nine binders, with the strongest at an apparent of 107 nM. These results establish natural language as an effective and powerful conditioning interface for protein structure generation.
Figures & tables
| Sequence similarity ( ) | Structure similarity ( ) | |||
| Method | Unweighted | pLDDT-weighted | Unweighted | pLDDT-weighted |
| Prompteina | 8.46 0.98 | 7.12 0.88 | 7.36 1.04 | 6.20 0.90 |
| Pinal | 7.55 0.79 | 5.98 0.70 | 7.09 0.73 | 5.49 0.68 |
| BioMatrix | 5.73 0.68 | 3.70 0.58 | 4.64 0.63 | 3.20 0.56 |
| Expected top- ipSAE min ( ) | Diversity ( ) | ||||
| Method | Agent | self | MPNN | MPNN-FI | 1 TM sim. |
| Prompteina | ✓ | 0.455 | 0.584 | 0.549 | 0.584 |
| Complexa | ✗ | 0.400 | 0.538 | 0.510 | 0.520 |
| BoltzGen | ✓ | 0.359 | 0.575 | 0.490 | 0.516 |
| BoltzGen | ✗ | 0.376 | 0.577 | 0.493 | 0.399 |
| RFdiffusion3 | ✓ | 0.237 | 0.559 | 0.454 | 0.587 |
| Specification | =8 | 16 | 32 | 64 | Expected top- ipSAE min ( ) |
|---|---|---|---|---|---|
| Prompteina (default: fold + shape + interface) | 0.534 | 0.470 | 0.376 | 0.253 | 0.455 |
| Prompteina (fold + shape) | 0.430 | 0.356 | 0.267 | 0.176 | 0.364 |
| Prompteina (fold only) | 0.412 | 0.336 | 0.250 | 0.164 | 0.362 |
Appendix figures & tables30 assets
Supplementary material from the paper’s appendix.
Appendix
| Corpus | Entries | Captions | Properties |
|---|---|---|---|
| PDB chains | 611K | 19.5M | 59 |
| AFDB monomers | 288.7K | 7.5M | 26 |
| Teddymer chains | 903K | 25.4M | 32 |
| Total | 1.8M | 52.4M | – |
| Property | Claims | % |
|---|---|---|
| Recall | 584 / 597 | 97.8 |
| Precision | 804 / 895 | 89.8 |
| Accuracy | 774 / 809 | 95.7 |
| Stage | Dataset | Trainable | Loss | LR | Steps |
|---|---|---|---|---|---|
| Projector warmup | PDB+AFDB monomers | Text modules, AdaLN | 2.6K | ||
| Continual pretraining (monomers) | PDB+AFDB monomers | All | 816K | ||
| Alignment fine-tuning | PDB+AFDB monomers | Cross-attn /out (late layers), projectors, | 10.2K | ||
| Continual pretraining (binders) | Teddymer+PDB dimers | All | 465K |
| Group | Property | Complete | Linear | No | Cross-attn only | Default noise | Pooled only |
|---|---|---|---|---|---|---|---|
| Fold & topology, accuracy (%) ( ) | |||||||
| CATH class | 92.0 | 87.3 | 51.3 | 86.7 | 68.7 | 68.7 | |
| CATH architecture | 27.0 | 25.9 | 22.2 | 25.0 | 18.7 | 7.5 | |
| Contact order | 29.6 | 36.4 | 28.8 | 28.4 | 31.2 | 33.2 | |
| Internal symmetry | 16.0 | 17.6 | 16.9 | 22.2 | 14.9 | 10.4 | |
| Sheet topology | 48.0 | 50.0 | 70.0 | 70.0 | 66.0 | 62.0 | |
| Property | Natural language | Dedicated CATH label | |||
|---|---|---|---|---|---|
| Complete | Pooled only | 47k (matched) | 98k | 149k | |
| CATH class accuracy (%) | 92.0 | 68.7 | 66.7 | 73.3 | 67.3 |
| CATH architecture accuracy (%) | 27.0 | 7.5 | 8.5 | 9.9 | 9.7 |
| Metric | Before alignment | After alignment |
|---|---|---|
| CATH class accuracy (%) | 94.0 | 96.0 |
| CATH architecture accuracy (%) | 55.5 | 51.1 |
| Disulfide count ( ) | 0.054 | 0.294 |
| Salt bridge count ( ) | 0.566 | 0.663 |
| Ours | Baselines | ||||||
| Property | Prompteina | Chroma | Chroma | Proteina | RFD | Pinal | BioMatrix |
| (text) | (label) | ||||||
| Fold & topology, accuracy (%) ( ) | |||||||
| CATH class | 96.0 | 33.3 | 64.7 | 96.7 | — | 36.0 | 30.7 |
| CATH architecture | 51.1 | 3.7 | 7.5 | 27.5 | — | 5.5 | 2.8 |
| Contact order | 56.0 | 21.2 | — | — | — | 27.6 | 21.6 |
| Experiment | Requested counts | Lengths (aa) | Spearman | Slope | |
|---|---|---|---|---|---|
| Helix | 1–5 | 134–193 | 250 | 0.878 | 1.076 |
| Helix—control | — | 134–193 | 250 | 0.060 | 0.060 |
| Strand | 2–6 | 112–169 | 250 | 0.718 | 0.824 |
| Strand—control | — | 112–169 | 250 | 0.005 | 0.010 |
| Evaluation | Direct | Short-form | Paraphrased | Reordered |
|---|---|---|---|---|
| CATH class accuracy (%) | 100.0 | 100.0 | 95.0 | 96.7 |
| Helix count | 0.953 | 0.942 | 0.912 | 0.934 |
| Class helix (acc. % / ) | 92.5 / 0.734 | 87.5 / 0.652 | 90.8 / 0.729 | 86.7 / 0.694 |
| Baseline | Shared test | Structures | Median scRMSD ( ) | Designable (%) ( ) | ||
| cases | per model | Prompteina | Baseline | Prompteina | Baseline | |
| Complexa | 251 | 2,510 | 0.83 | 3.11 | 79.7 | 29.1 |
| Text-guided models | ||||||
| Chroma (text) | 251 | 2,510 | 0.83 | 14.07 | 79.7 | 2.4 |
| Pinal | 251 | 2,510 | 0.83 | 11.10 | 79.7 | 16.5 |
| BioMatrix | 251 | 2,510 | 0.83 | 15.83 | 79.7 | 7.0 |
| Model / condition | Reference size | Max TM ( ) | Mean novelty ( ) |
|---|---|---|---|
| mean / median | |||
| Complexa | 506,972 | 0.783 / 0.782 | 0.217 |
| Prompteina (conditional) | 780,195 | 0.770 / 0.785 | 0.230 |
| Prompteina (empty prompt) | 780,195 | 0.835 / 0.847 | 0.165 |
| ProTrek seq. sim. ( ) | ||||
|---|---|---|---|---|
| Method | ECOD ann. | Function | Metadata | InterPro |
| Prompteina | 8.46 † 0.98 | 5.96 0.91 | 5.65 0.89 | 5.51 0.94 |
| Pinal | 7.55 0.79 | 6.37 † 0.82 | 6.97 0.85 | 7.52 † 0.72 |
| BioMatrix | 4.73 0.64 | 3.49 0.56 | 4.72 † 0.62 | 5.73 0.68 |
| Target | Format | Slope | Relative slope | Spearman |
|---|---|---|---|---|
| CD45 | Key–value | 0.851 | 1.00 | 0.989 |
| Paraphrased | 0.910 | 1.07 | 0.997 | |
| Reordered | 0.647 | 0.76 | 0.976 | |
| IL-17A | Key–value | 0.808 | 1.00 | 0.997 |
| Paraphrased | 0.933 | 1.15 | 0.996 | |
| Reordered | 0.881 | 1.09 | 0.997 |
| Tool | Returns |
|---|---|
| target_overview() | Chains, residue ranges, sequence, length, PDB identifier |
| secondary_structure() | DSSP assignment per chain |
| surface_residues(min_sasa) | Exposed residues with per-residue SASA |
| neighbors(residue, radius) | Residues within Å, for assembling a contiguous site |
| surface_patches(kind) | Contiguous hydrophobic, polar, or charged patches |
| known_interfaces() | Contact residues from deposited complexes for this target |
| Method | Channel | Coverage |
| RFdiffusion3 | Target hotspots ( select_hotspots ) | 99.9% |
| Non-loop secondary structure ( is_non_loopy ) | 95.3% | |
| Hydrogen-bond acceptors | 17.9% | |
| Hydrogen-bond donors | 0 7.9% | |
| Burial, buried ( select_buried ) | 0 2.2% | |
| Burial, partial ( select_partially_buried ) | 0 1.9% |
| ESMFold2-Fast | ESMFold2 | AF2 | AF3 | |
| Mean F1 across the 46 groups | ||||
| AlphaProteo AF2 filters | 0.232 | 0.222 | 0.398 | 0.375 |
| iPAE 7 Å | 0.350 | 0.304 | 0.404 | 0.394 |
| complex pLDDT 0.90 | 0.235 | 0.223 | 0.419 | 0.385 |
| binder-aligned RMSD 1.5 Å | 0.398 | 0.397 | 0.416 | 0.388 |
| iPAE, fitted threshold | 0.463 | 0.387 | 0.437 | 0.442 |
| Method | Agent | ESMFold2-Fast | AlphaFold3 |
|---|---|---|---|
| Prompteina | ✓ | 0.455 | 0.518 |
| Complexa | ✗ | 0.400 | 0.434 |
| BoltzGen | ✓ | 0.359 | 0.420 |
| BoltzGen | ✗ | 0.376 | 0.404 |
| RFdiffusion3 | ✓ | 0.237 | 0.276 |
| RFdiffusion3 | ✗ | 0.251 | 0.293 |
| Method | Agent | =1 | 2 | 4 | 8 | 16 | 32 | 64 | 128 | 200 | |
|---|---|---|---|---|---|---|---|---|---|---|---|
| self | |||||||||||
| Prompteina | ✓ | 0.647 | 0.620 | 0.580 | 0.534 | 0.470 | 0.376 | 0.253 | 0.149 | 0.101 | 0.455 |
| Complexa | ✗ | 0.571 | 0.543 | 0.501 | 0.455 | 0.402 | 0.333 | 0.240 | 0.144 | 0.096 | 0.400 |
| BoltzGen | ✓ | 0.573 | 0.537 | 0.478 | 0.405 | 0.326 | 0.249 | 0.169 | 0.107 | 0.074 | 0.359 |
| BoltzGen | ✗ | 0.569 | 0.530 | 0.486 | 0.430 | 0.364 | 0.284 | 0.199 | 0.128 | 0.088 | 0.376 |
| RFdiffusion3 | ✓ | 0.475 | 0.425 | 0.355 | 0.258 | 0.161 | 0.093 | 0.051 | 0.026 | 0.017 | 0.237 |
| Method | Agent | Generated | self | MPNN | MPNN-FI |
|---|---|---|---|---|---|
| Prompteina | ✓ | 10 | 8 | 9 | 9 |
| Complexa | ✗ | 7 | 7 | 8 | 8 |
| BoltzGen | ✓ | 6 | 6 | 7 | 6 |
| BoltzGen | ✗ | 7 | 7 | 8 | 7 |
| RFdiffusion3 | ✓ | 5 | 6 | 8 | 6 |
| RFdiffusion3 | ✗ | 6 | 5 | 9 | 6 |
| Prompteina | BoltzGen | RFdiffusion3 | |
| Realized properties | |||
| Buried surface area, p10 (Å 2 ) | 691 | 468 | 400 |
| Buried surface area, median (Å 2 ) | 1020 | 728 | 710 |
| Buried surface area, p90 (Å 2 ) | 1422 | 1073 | 1205 |
| Designs in the top quartile of area | 47% | 11% | 17% |
| ipSAE min across quartiles of buried surface area | |||
| Method | Agent | 16 | 32 | 64 | |
|---|---|---|---|---|---|
| MPNN redesign | |||||
| Prompteina | ✓ | 0.433 | 0.441 | 0.424 | 0.423 |
| Complexa | ✗ | 0.492 | 0.492 | 0.467 | 0.478 |
| BoltzGen | ✓ | 0.480 | 0.486 | 0.496 | 0.496 |
| BoltzGen | ✗ | 0.635 | 0.653 | 0.619 | 0.612 |
| RFdiffusion3 | ✓ | 0.418 | 0.412 | 0.414 | 0.414 |
| Helix fraction | |||||||
| Method | Agent | p10 | p50 | p90 | Mainly | Strand | Respon- |
| helical | segments | siveness | |||||
| Prompteina | ✓ | 0.312 | 0.729 | 0.874 | 45% | 0.7 | 0.127 |
| Complexa | ✗ | 0.278 | 0.565 | 0.777 | 27% | 2.3 | 0.201 |
| BoltzGen | ✓ | 0.664 | 0.823 | 0.880 | 68% | 0.0 | 0.035 |
| BoltzGen | ✗ | 0.163 | 0.406 | 0.764 | 29% | 5.0 | 0.227 |
| Property | Initial | Round 1 | Round 2 |
|---|---|---|---|
| Requested specification | |||
| Topology | Phospholipase A2 | Growth hormone | Growth hormone |
| Helices | 5 | 4 | 5 |
| Interface residues | 22 | 20 | 24 |
| Buried surface area (Å 2 ) | 1600 | 1500 | 1700 |
| Generated structure | |||
| Designs evaluated | |||||
|---|---|---|---|---|---|
| Method | 50 | 100 | 150 | 200 | |
| Prompteina | 1 | 0.000 | 0.060 | 0.114 | 0.119 |
| 8 | 0.000 | 0.121 | 0.167 | 0.181 | |
| BoltzGen | 1 | 0.000 | 0.002 | 0.019 | 0.029 |
| 8 | 0.000 | 0.013 | 0.051 | 0.056 | |
| RFdiffusion3 | 1 | 0.000 | 0.002 | 0.012 | 0.013 |
| Gain over i.i.d. ( ) | Targets | ||||
|---|---|---|---|---|---|
| Method | Hardest 7 | Middle 6 | Easiest 7 | improved | |
| Prompteina | 1 | 0.098 | 0.046 | 0.014 | 17/20 |
| BoltzGen | 1 | 0.051 | 0.042 | 0.012 | 16/20 |
| RFdiffusion3 | 1 | 0.021 | 0.004 | 0.003 | 11/20 |
| Prompteina | 8 | 0.105 | 0.073 | 0.023 | 20/20 |
| BoltzGen | 8 | 0.067 | 0.087 | 0.022 | 20/20 |
| Metric | Binder selection | Non-binder rejection | Final score ( ) |
|---|---|---|---|
| 0.1030 | 0.3527 | 0.0363 [0.0197, 0.0559] | |
| ipSAE min | 0.0956 | 0.2703 | 0.0258 [0.0118, 0.0428] |
| Rank | (nM) | Seq. redesign | Round | iPAE (Å) | pLDDT | RMSD (Å) | ||
|---|---|---|---|---|---|---|---|---|
| 16 | 107 | MPNN | 2 | 5.92 | 0.589 | 0.713 | 0.916 | 2.60 |
| 78 | 144 | MPNN | 3 | 5.95 | 0.425 | 0.665 | 0.910 | 2.82 |
| 17 | 238 | MPNN-FI | 0 | 6.99 | 0.658 | 0.666 | 0.896 | 7.61 |
| 68 | 281 | SolMPNN | 3 | 7.83 | 0.504 | 0.679 | 0.885 | 4.80 |
| 39 | 335 | SolMPNN | 0 | 7.09 | 0.621 | 0.586 | 0.884 | 2.75 |
| 13 | 868 | SolMPNN-FI | 3 | 5.82 | 0.630 | 0.689 | 0.913 | 3.02 |