physics.chem-phNov 3, 2026

A Systematic Comparison of In-Context Learning Strategies for Peptide Property Prediction in Low-Data Regimes

Authors: Jiantao Zhao, Andrei Voinea, Mathijs F. J. Mabesoone

Organizations: Institute for Molecules and Materials, Radboud University, Heyendaalseweg 135, 6525AJ Nijmegen, The Netherlands

Abstract

Peptide sequence-property relationships are often highly non-linear, but can be learned with machine learning models and exploited for the design of new materials and bioactive compounds. Various methods based on transformer architectures have become available for molecular property predictions. These foundation models promise straightforward inference and prediction of properties of new materials through in-context learning. Benchmarks of individual model architectures exist, but a systematic comparison of various foundation models against classical baselines on similar datasets is lacking. Here, we provide a systematic evaluation of the predictive performance of various in-context learning strategies. We compare several large language models, tabular foundation models, and typed decision models against an XGBoost baseline. We evaluate predictive performance on binary and multiclass classification tasks on pH-dependent surface activ-ity, IR spectral signatures, self-assembly, and anti-cancer activities. Our results show that ICL is competitive, yet does not significantly outperform classical baselines, and performance varies between models and tasks. Our findings further suggest that language models use both in context examples and knowledge acquired during pretraining to infer properties of unseen samples. This finding indicates that pretrained models can leverage the existing literature for predictions, but may also bias their predictions towards established sequence-property relationships.

Explore similar work

CardsList
  1. Can Tabular In-Context Learners Generalize to Biomolecular Property Prediction?

    Jun 30, 2026Davy Guan, Lu Zhang, Asiri Wijesinghe +7Tabular Foundation ModelsProtein Fitness Prediction

  2. Tabular foundation models for in-context prediction of molecular properties

    Apr 17, 2026Karim K. Ben Hicham, Jan G. Rittig, Martin Grohe +1Tabular Foundation ModelsMolecular Property Prediction

  3. In-Context Molecular Property Prediction with LLMs: A Blinding Study on Memorization and Knowledge Conflicts

    Mar 26, 2026Matthias Busch, Marius Tacke, Sviatlana V. Lamaka +4LLM EvaluationKnowledge Conflicts in Language Models