Organizations: Rhinovate Technology Co., Ltd., Shenzhen, China · School of Materials Science and Engineering, Peking University, Beijing, China · Department of Computer Science and Engineering, The Chinese University of Hong Kong, Hong Kong, China
We introduce Radial Kernel Attention (RKA) for long-range modeling in polymer machine learning force fields. Existing approaches often rely on local neighbor graphs, which limit communication across polymer chains and their surrounding environments, whereas explicit all-pair attention incurs quadratic computational cost. RKA maps interatomic distances from the cluster centroid to learned radial features and combines their kernelized overlap with content-dependent queries and keys. Factorized aggregation and readout enable global feature exchange at linear complexity in the number of atoms for fixed feature dimensions. To ensure physically consistent predictions, we insert the invariant scalar update between EquiformerV3 local blocks and obtain conservative forces by differentiating the total energy, including its dependence on radial coordinate . Our models are trained on official OPoly26 training set for 12 epochs and evaluated directly after training on the complete official validation set. A matched 5M comparison shows that RKA reduces per-atom energy and force MAEs by 67.4% and 36.3%, respectively. The 20M RKA model attains a total-energy MAE of 15.81 meV (per-atom MAE of 0.1182 meV/atom) and a force MAE of 2.619 meV/Angstrom,improving all three metrics over UMA-S-1.2 and UMA-S-1.2.1 on the same validation structures. RKA provides a compact pathway for information exchange beyond local graph connectivity in polymer machine learning force fields.
Figures & tables
Figure 1: Radial Kernel Attention. A finite structure defines a centroid and node radii. Learned radial features organize content-dependent key–value statistics over the entire structure. Each node reads the shared statistics through its radial features and query, and receives a scalar residual update. The basis curves are schematic, rather than fitted checkpoint values.
Figure 2: RKA in an equivariant atomic potential. Each local block updates the geometric representation. RKA reads its scalar channels and positions, and writes a scalar residual before the next block. The final scalar readout gives atomic energies. Shared elemental references and screened repulsion complete the total energy, whose coordinate derivative defines the forces. Charge/spin conditioning and repulsion are present in both 5M models.
Setting
5M baseline
5M + RKA
20M + RKA
Local layers
4
4
7
Channels
128
128
128
Maximum degree ℓmax
2
2
3
Maximum order mmax
2
2
2
Feed-forward width
256
256
512
Attention heads
4
4
4
Table 1: Configurations of our polymer force fields. The 5M pair shares its local architecture, conditioning, and repulsion. Parameter counts are reported in millions to two decimal places.
Metric
5M baseline
5M + RKA
Reduction
Per-atom energy (meV/atom)
0.4665
0.1521
67.4%
Total energy (meV/structure)
59.44
21.31
64.1%
Forces (meV/Å)
6.632
4.223
36.3%
Table 2: Effect of RKA on the shared 5M backbone. Both models include charge/spin conditioning and screened repulsion, train for 12 epochs, and use the same official validation structures. Lower MAE is better.
Model
Parameters
Energy/atom
Total energy
Forces
(M)
(meV/atom)
(meV/structure)
(meV/Å)
UMA-S-1.2
291.48
0.1329
17.03
3.619
UMA-S-1.2.1
291.48
0.1258
16.09
3.616
20M + RKA
20.62
0.1182
15.81
2.619
Table 3: Complete-model comparison on all 201,865 official validation structures, with no skipped structures. Parameter counts are the reported model totals in millions. All error columns are MAEs; lower is better.
Polyethylene (PE) is one of the most commonly used synthetic polymers. While the synthesis and processing protocols for PE are well established, precise experimental assignment of microscopic structures at atomistic resolution (i.e., the position of each atom) remains largely limited to highly crystalline systems. This gap is often addressed via computer simulations using empirical interatomic potentials, which use approximate but efficient descriptions of interatomic interactions to reach the length and time scales needed to describe macromolecules. These empirical potentials typically perform well for bulk and/or collective properties but face challenges with chemical realism for complex systems, e.g., during reactive processes. In this work, we address this challenge by combining the computational efficiency of a deep potential (DP) machine-learning force field and the chemical realism of first-principles van der Waals (vdW) corrected hybrid density functional theory (DFT) enabled by a SeA high-throughput framework. Using this approach, we study the structure and dynamics of PE oligomers and polymers in an ethylene solvent under common high-pressure (supercritical) radical polymerization conditions. We found that the local solvation environment of radical-containing PE oligomers converges for chain lengths greater than (n~6), suggesting extensibility of our oligomer-trained MLFF to significantly longer polymers. We then confirmed the extensibility of these models to long PE chains by characterizing the molecular weight scaling of single-chain structure and dynamics, which showed classic good solvent behavior. Our PE MLFF retained a consistent level of fidelity and stability across a wide range of thermodynamic state points and chain lengths, at full atomistic resolution, therefore paving the way towards first-principles-based polymer structure and property prediction.
Bharatha K. Gunawardana, Teresa Shah, Bicha Azizova +6
Department of Chemistry, University of North Texas, Denton, TX 76203, USA · Department of Chemical and Biomolecular Engineering, Lehigh University, Bethlehem, PA 18015, USA
Active learning for machine-learning interatomic potentials (MLIPs) must address several challenges to be practical: scaling to large candidate pools, leveraging energy-force supervision, and maintaining robustness when candidate pools are biased relative to the target distribution. In this work, we jointly address these challenges. We first introduce a linearly scaling acquisition framework based on chunked feature-space posterior-variance shortlisting. By avoiding materialisation of the candidate and train set kernels, this approach enables screening of ~200k structures within hours and applies broadly to acquisition strategies that score candidates based on molecular similarity metrics. We then extend the Neural Tangent Kernel (NTK) to a force-aware setting via mixed parameter-coordinate derivatives, yielding a force NTK and a joint energy-force NTK that provide natural similarity metrics for vector-field prediction. We demonstrate the effectiveness of the joint energy-force NTK on the OC20 dataset, where force-aware acquisition is crucial: it achieves the lowest energy and force MAE and RMSE across all metrics and distribution splits. Across T1x, PMechDB, and RGD benchmarks, our force NTK methods remain competitive with established baselines while being significantly more efficient than committee-based approaches. Under a controlled candidate-pool shift case study on T1x, acquisition based on pretrained MLIP embeddings and NTKs remains robust, whereas committee-based methods exhibit higher variance. Overall, these results show that a single pretrained MLIP can enable scalable, force-aware, and distribution-robust active learning for foundation-model fine-tuning.
Eszter Varga-Umbrich, Zachary Weller-Davies, Paul Duckworth +3
InstaDeep, UK · Department of Engineering, University of Cambridge, Cambridge, UK
Machine-learning interatomic potentials (MLIPs) have advanced rapidly, with many top models relying on strong physics-based inductive biases. However, as models scale to larger systems like biomolecules and electrolytes, they struggle to accurately capture long-range (LR) interactions, leading current approaches to rely on explicit physics-based terms or components. In this work, we propose AllScAIP, a straightforward, attention-based, and energy-conserving MLIP model that scales to O(100 million) training samples. It addresses the long-range challenge using an all-to-all node attention component that is data-driven. Extensive ablations reveal that in low-data/small-model regimes, inductive biases improve sample efficiency. However, as data and model size scale, these benefits diminish or even reverse, while all-to-all attention remains critical for capturing LR interactions. Our model achieves state-of-the-art energy/force accuracy on molecular systems, as well as a number of physics-based evaluations (OMol25), while being competitive on materials (OMat24) and catalysts (OC20). Furthermore, it enables stable, long-timescale MD simulations that accurately recover experimental observables, including density and heat of vaporization predictions.
Eric Qu, Brandon M. Wood, Aditi S. Krishnapriyan +1