Emergent Steering Beyond Endpoint Alignment in Chemical Reaction Models
Organizations: University of Notre Dame
Abstract
Machine learning models for chemical reaction prediction are usually evaluated by endpoint accuracy, but endpoint correctness alone does not reveal how a model represents chemical transformation or why it fails. We introduce UniRxnAxis, a unified forward-retrosynthesis framework that models both tasks as direction-conditioned endpoint redistribution in a shared latent space. By aligning source states, transformed states, and encoded target endpoints, UniRxnAxis enables directional auditing of learned latent updates. This shared latent geometry allows the learned displacement (from the encoder source state to the decoder-facing transformed state ) to be decomposed into an endpoint-parallel component and an endpoint-orthogonal residual, which we call emergent steering. Our evaluation shows that emergent steering is functionally important: in retrosynthesis, it recovers most of the model's utility, remains effective under random, shuffled, and prototype controls, and directly affects which bond edits are promoted or suppressed. The residual-over-parallel ordering persists across alignment strengths, after decoder-interface calibration, against angle-matched random axes, and in a second graph-edit architecture, although its magnitude depends on the reference axis and optimization. The decomposition also supports a proxy taxonomy of model-side failures, showing how reaction models can be audited beyond endpoint accuracy.
Figures & tables
| Dir. | Mean | Mean |
|---|---|---|
| Forward | 0.3282 | 0.9322 |
| Retro | 0.6273 | 0.7405 |
| cos | Par. | Res. | Res. Par. | ||||
|---|---|---|---|---|---|---|---|
| 0.001 | .738 | .649 | 18.41 | 55.74 | 60.56 | 14.88 | +37.33 |
| 0.01 | .649 | .734 | 49.69 | 57.96 | 59.62 | 49.39 | +8.27 |
| 0.1 | .741 | .627 | 9.97 | 63.03 | 64.41 | 11.10 | +53.06 |
| 1 | .414 | .869 | 23.21 | 39.92 | 52.99 | 24.97 | +16.71 |
| 10 | .157 | .934 | 11.10 | 28.28 | 49.95 | 11.10 | +17.18 |
| A: boundary crossing | |
|---|---|
| Target edit crosses | 0.5217 |
| Target formed crosses | 0.6054 |
| Wrong non-target crosses | 0.0004 |
| Wrong competitors down | 0.8525 |
| Run | Fixed | Oracle | Oracle-rec. | Selector | Rescue | Break |
|---|---|---|---|---|---|---|
| Retuned fine grid | 0.6441 | 0.6934 | 247 | 0.6529 | 46 ( ) | 2 ( ) |
Appendix figures & tables31 assets
Supplementary material from the paper’s appendix.
Appendix
| State | Definition | Uses GT endpoint? |
|---|---|---|
| Raw encoded source endpoint, | No | |
| Shared attention-style updated state before task adaptation | No | |
| / full | Natural transformed source state, aligned to the encoded target | No |
| Encoded ground-truth endpoint latent | Yes | |
| Endpoint direction used for projection | Yes | |
| Model update displacement | No |
| Top-1 | Edit F1 | Formed F1 | Center F1 | |
|---|---|---|---|---|
| 0 | 0.0997 | 0.4998 | 0.1927 | 0.6046 |
| 0.25 | 0.4590 | 0.8055 | 0.7448 | 0.8819 |
| 0.5 | 0.6369 | 0.8881 | 0.8868 | 0.9420 |
| 1 | 0.6441 | 0.8868 | 0.8868 | 0.9418 |
| 2 | 0.6345 | 0.8852 | 0.8849 | 0.9410 |
| Quantity | Definition |
|---|---|
| Oracle alpha | For each sample, choose the alpha that maximizes official exact-match correctness; ties are broken by edit F1, center F1, distance to , and then alpha value. This is label-available and used only as an upper bound. |
| Oracle-rescuable | A sample that is wrong at but correct for at least one alpha on the grid under the oracle rule. There are 247 such retro test samples. |
| Rescued / broken | Rescued means wrong at and correct after the selector; broken means correct at and wrong after the selector. |
| Reconstruction score | Negative mean rounding error between continuous bond logits and their rounded decoded bond orders over active atom pairs. Higher means the decoded graph is closer to a stable decoder boundary. |
| Predicted-edge margin | The weakest predicted changed-edge strength minus the strongest non-changed competitor strength. Higher means the decoded edit set is more separated from competing edits. |
| Consensus count | Number of alpha values that decode to the same edit signature. Higher means the candidate output is stable across nearby dosage values. |
| Audit family | Latent domain | Notes |
|---|---|---|
| Endpoint role readout | Graph-level pooled | Cached pooled or with linear ridge probes |
| Update-object alignment and endpoint geometry | Graph-level pooled | Uses , , and |
| Stage/component class readout | Graph-level pooled | Encoder stages use raw valid-token pooling; decomposition components use active-target-mask pooling |
| Prototype, nearest-neighbor, subspace, and program-centroid analyses | Graph-level pooled | Class means/centroids are fit in pooled or space |
| Functional state decoding, residual-only, and dosage | Token-level tensor | Constructs , residual-only, or in before decoding |
| Boundary crossing, TER, and | Token/edge-level | Decoder scores are edge-level; directions are token tensors under the active-target mask |
| Metric | Definition / aggregation | Caveat |
|---|---|---|
| Official accuracy | Mean deterministic top-1 exact-match correctness | Not beam search |
| Edit F1 | Sample-level F1 over edited atom pairs / bond edits | Tensor proxy |
| Formed F1 | Sample-level F1 over formed bonds | Empty-set convention follows local implementation |
| Broken F1 | Sample-level F1 over broken bonds | Changed-order edits tracked separately |
| Center F1 | Sample-level F1 over atoms incident to bond edits | Reaction-center proxy |
| Center mass ratio | Residual token-norm mass on center atoms / active mass | Model-side localization |
| Direction | Norm ratio |
|---|---|
| Forward | 0.9307 |
| Retro | 0.6859 |
| State | Effective rank | Participation ratio | Top-1/trace | Mean local ID |
|---|---|---|---|---|
| Forward | 8.21 | 3.07 | 0.5585 | 12.60 |
| Retro | 11.25 | 5.66 | 0.2996 | 13.22 |
| Control | Variant | Edit F1 | Cross |
|---|---|---|---|
| Reference | Full | 0.8868 | 0.5217 |
| Norm-only random | Global norm | 0.5020 | 0.0163 |
| Norm-only random | Per-token norm | 0.5071 | 0.0288 |
| Prototype | Class subspace | aggregate-only | |
| Prototype | Class nearest neighbor | aggregate-only | |
| Prototype | Class mean | aggregate-only | |
| Audit | Implementation family | Latent domain | Protocol / reported quantity |
|---|---|---|---|
| Endpoint performance context | Main endpoint evaluation | Decoded graph output | Reports deterministic top-1 endpoint exact match for the trained joint checkpoint; no latent pooling enters the score. |
| Opposite-endpoint role readout | role probe | Graph-level pooled | Fits linear/ridge role probes on cached pooled or vectors to test whether endpoint role information is readable. |
| Update-object alignment | delta-z analysis | Graph-level pooled | Computes , , , then reports cosine/projection/orthogonal residual geometry. |
| Endpoint geometry | delta-z analysis | Graph-level pooled | Uses the same pooled endpoint vectors to measure distance-to-target, parallel fraction, residual norm share, and related aggregate geometry. |
| Staged decoding | selective ablation | Token-level tensor | Builds , , residual-only, and as tensors under the active-target mask, decodes each with the frozen residual decoder, and reports official/edit/formed/broken/center metrics. |
| Target-encoder oracle | oracle decoding | Token-level tensor | Replaces the transformed endpoint state by before the same frozen decoder to test whether target encoder latents are directly decoder-executable. |
| Audit | Implementation family | Latent domain | Protocol / reported quantity |
|---|---|---|---|
| Norm-matched random controls | selective ablation | Token-level tensor | Replaces by random directions scaled to the same masked norm, decodes the resulting token state, and reports endpoint/edit proxies. |
| Token/sample/class shuffles | shuffle controls | Token-level tensor for decoding | Permutes or substitutes residual token tensors before decoding; graph-level class prototypes may be fit for selection, but the decoded intervention itself is token-level. |
| Class prototype controls | prototype controls | Mixed | Fits class mean/nearest-neighbor/subspace controls in pooled residual space, then evaluates decoded prototype-derived token controls where available. |
| Boundary crossing | bond-boundary audit | Token/edge-level | Evaluates continuous decoder bond scores on selected edges and counts threshold crossings caused by endpoint-parallel versus residual movement. |
| Score delta and TER | bond-boundary audit | Token/edge-level | Computes score changes and target-error reduction on decoder edge scores after decoding counterfactual token states. |
| Directional derivative | decoder-gradient audit | Token/edge-level | Uses masked token-space directions and decoder gradients to measure local alignment for target and competing edges. |
| Audit | Implementation family | Latent domain | Protocol / reported quantity |
|---|---|---|---|
| Encoder-stage class readout | layerwise readout | Graph-level pooled | Pools each encoder layer over raw valid source tokens and fits cross-validated linear reaction-class probes. |
| Component class readout | component readout | Graph-level pooled | Pools , , , , and under the active-target mask before linear probing. |
| Program centroid / atypicality | program centroid | Graph-level pooled | Fits class/family centroids in pooled or residual space and relates distance to residual demand or failure. |
| Atom center mass | node residual audit | Atom/token-level | Computes per-token residual norm mass on active atoms and compares mass on reaction-center atoms against total active mass. |
| Atom gradients and suppress/rescue | atom/gradient audit | Atom/token-level | Uses per-token gradients, residual norms, and atom suppress/rescue interventions; no graph-level latent vector is used for the atom proxy itself. |
| Merged failure taxonomy | failure taxonomy | Mixed derived proxies | Combines decoded state metrics, dosage response, atom center mass, edge competition, and program atypicality into automatic endpoint/latent failure labels. |
| Quantity | Metric | Mean [95% CI] |
| Retro | Official | 0.0405 [0.0350,0.0463] |
| Retro | Official | 0.0997 [0.0913,0.1075] |
| Retro | Official | 0.6441 [0.6305,0.6571] |
| Retro residual-only | Official | 0.6303 [0.6171,0.6437] |
| Forward | Official | 0.8694 [0.8602,0.8784] |
| Forward | Official | 0.8816 [0.8724,0.8902] |
| Family | Quantity | Mean [95% CI] |
| Residual control | True residual official | 0.6441 [0.6301,0.6563] |
| Residual control | Random global-norm r0 official | 0.1029 [0.0949,0.1112] |
| Residual control | Random per-token-norm r0 official | 0.1051 [0.0969,0.1138] |
| Residual control | Token-shuffle r0 official | 0.0839 [0.0765,0.0917] |
| Residual control | Sample-shuffle r0 official | 0.1176 [0.1084,0.1270] |
| Residual control | Same-class shuffle r0 official | 0.1190 [0.1104,0.1280] |
| Family | Quantity | Mean [95% CI] |
| Dosage | official | 0.0997 [0.0917,0.1079] |
| Dosage | official | 0.4590 [0.4452,0.4737] |
| Dosage | official | 0.6369 [0.6231,0.6495] |
| Dosage | official | 0.6441 [0.6303,0.6561] |
| Dosage | official | 0.6345 [0.6209,0.6481] |
| Failure diagonal | Program Program/Parallel | 0.858 [0.810,0.903] |
| Reaction-center localization | ||
| Direction | Metric | Value |
| Retro | center mass | 0.4918 |
| Retro | center mass | 0.3255 |
| Retro | center mass | 0.4075 |
| Retro | Label fraction | 0.1596 |
| Forward | center mass | 0.2340 |
| Correlation | Spearman |
|---|---|
| Distance vs | 0.2161 |
| Distance vs | 0.3754 |
| Distance vs edit F1 | -0.0387 |
| Distance vs center F1 | -0.0492 |
| Distance vs edit gain | -0.0738 |
| Distance vs center gain | -0.0399 |
| Component | Configuration |
|---|---|
| Latent/token dimensions | , atom slots |
| Backbone encoder/decoder | 8 Transformer layers, 8 heads, dropout 0.1 |
| Shared update | , shared parameters, 2 layers, hidden dim 512, 8 heads |
| Direction conditioning | learned embedding , retro=0 and forward=1 |
| Task adapter | direction-conditioned 2-layer attention adapter applied to in the supervised transformation |
| Decoder input | fuse mode, before residual graph decoding |
| Top-1 | Edit F1 | Formed F1 | Center F1 | |
|---|---|---|---|---|
| -1.0 | 0.3843 | 0.4346 | 0.2219 | 0.6276 |
| -0.5 | 0.5482 | 0.7101 | 0.5816 | 0.8242 |
| 0.0 | 0.6303 | 0.8799 | 0.8761 | 0.9371 |
| 0.25 | 0.6415 | 0.8867 | 0.8879 | 0.9416 |
| 0.5 | 0.6423 | 0.8870 | 0.8877 | 0.9413 |
| 1.0 | 0.6441 | 0.8868 | 0.8868 | 0.9418 |
| Variant | Top-1 | Edit F1 | Formed F1 | Center F1 |
|---|---|---|---|---|
| True parallel | 0.6441 | 0.8868 | 0.8868 | 0.9418 |
| Residual-only | 0.6303 | 0.8799 | 0.8761 | 0.9371 |
| Anti-parallel | 0.3843 | 0.4346 | 0.2219 | 0.6276 |
| Random global-norm parallel | 0.6275 | 0.8782 | 0.8733 | 0.9358 |
| Random per-token-norm parallel | 0.6209 | 0.8694 | 0.8598 | 0.9303 |
| Sample-shuffled parallel | 0.6089 | 0.8670 | 0.8593 | 0.9302 |
| Axis | Coarse label | Meaning / typical proxy evidence |
| Endpoint symptom | Refinement / edge-selection | The final decoded graph has local-looking edit errors, such as a wrong competing edge, center mislocalization, or an incomplete final edit. |
| Program | The decoded output appears wrong at a broad reaction-program level, beyond a single final edge choice. | |
| Nonresponsive / collapse | The decoded output barely responds to the residual path, collapses to a scaffold-like output, or remains near an unedited state. | |
| Decoder realization | The latent/bond proxies look plausible, but the discrete decoder still misses exact endpoint realization. | |
| Dosage | Changing the residual magnitude appears to improve the proxy path, suggesting under- or over-application of the residual. | |
| Latent-stage diagnosis | Program / parallel | The program-stage trace is atypical, undercommitted, mislocalized, or poorly anchored before residual refinement. |
| Proxy | |||||
|---|---|---|---|---|---|
| edit F1 | 5007 | 0.0000 | 0.1292 | 0.6667 | 1.0000 |
| center F1 | 5007 | 0.0000 | 0.3077 | 0.8000 | 1.0000 |
| edit F1 | 5007 | 0.4000 | 1.0000 | 1.0000 | 1.0000 |
| center F1 | 5007 | 0.8000 | 1.0000 | 1.0000 | 1.0000 |
| edit-F1 gain | 5007 | 0.0000 | 0.1818 | 0.6000 | 1.0000 |
| center-F1 gain | 5007 | 0.0000 | 0.2000 | 0.5000 | 1.0000 |
| Fine endpoint trigger | Thresholded proxy condition |
|---|---|
| Program-level failure | Low edit F1 or center F1, together with high program atypicality or high family-centroid distance. |
| Center mislocalization | Low center mass ratio, high off-center mass ratio, or a top-3/top-5 residual-center miss. |
| Competing-edge failure | At least two of: low competing-edge suppression, high wrong-edge crossing, high top non-GT edit magnitude, or low edit-score margin. |
| Under-refinement | proxy quality is low, and either best , improves over , or the dosage sweep is monotonic-improving. |
| Overshoot | Dosage response is overshoot, and either best or is worse than a lower dose. |
| Nonresponsive / collapse | Dosage response is nonresponsive, and the stage path remains low, the alpha path is flat, or the alpha-sweep proxy range is unavailable. |
| Fine latent trigger | Thresholded proxy condition |
|---|---|
| Anchor mislocalization | edit F1 or center F1 is very low. This rule is marked limited-support because readout evidence is sparse. |
| Program atypicality | Program atypicality or family-centroid distance is high, and either edit/center F1 is low or residual norm is high. |
| Program undercommitment | At least two gains are low across edit, formed-bond, and center proxies, with low or low quality. |
| Wrong program commitment | edit/center F1 is low, a competing/wrong-edge signal fires, the program proxy or is high, and residual gain remains low. |
| Residual mislocalization | At least two of low center mass, high off-center mass, top-k center miss, or high residual entropy, paired with low center quality or low center mass. |
| Residual misdirection | At least two of low/negative GT-edit derivative, high wrong-edge crossing, low competing-edge suppression, or low target-error reduction, with low or negative residual gain. |
| Displacement dosage | 0 | 0.25 | 0.5 | 1 |
|---|---|---|---|---|
| Top-1 (%) | 10.39 | 48.11 | 62.41 | 64.45 |
| 0 | 0.25 | 0.5 | 0.75 | 1 | 1.25 | 1.5 | 2 | 2.5 | 2.75 | 3 | 4 | 6 | |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Top-1 | 4.05 | 4.59 | 6.55 | 8.59 | 11.10 | 13.40 | 15.20 | 17.74 | 18.99 | 19.53 | 19.29 | 17.52 | 11.72 |
| State | Parallel | Residual | |||
|---|---|---|---|---|---|
| Top-1 (%) | 0.68 | 16.58 | 22.74 | 48.79 | 75.80 |
| Setting | AUC | R@1 |
|---|---|---|
| UniRxnAxis split-aligned (Table 2 ) | .9437 | .4068 |
| Graph2SMILES [ Tu and Coley, 2022 ] | .7764 | .0184 |
| EditRetro [ Han et al., 2024 ] | .9926 | .5866 |
| Dataset | Mean F/R | Mean F/R | ||
|---|---|---|---|---|
| USPTO-50K test | .3282 / .6273 | +.2991 | .9322 / .7405 | .1917 |
| USPTO-MIT train | .2561 / .5503 | +.2942 | .9529 / .7824 | .1705 |
| USPTO-MIT val | .2560 / .5522 | +.2962 | .9531 / .7813 | .1718 |
| USPTO-MIT test | .2566 / .5516 | +.2950 | .9528 / .7812 | .1716 |