Training Chemical Plausibility-Aware Large Language Models for Single-Step Retrosynthesis
Authors: Bogdan Zagribelnyy, Ivan Ilin, Nikita Bondarev, Maksim Kuznetsov, Mathieu Reymond, Vladimir Aladinskiy, Alex Aliper, Alex Zhavoronkov
Organizations: Insilico Medicine AI Limited, Abu Dhabi, UAE · Insilico Medicine Canada Inc., Montreal, Quebec, Canada · Insilico Medicine Hong Kong Ltd., Hong Kong SAR, China
Single-step retrosynthesis is a central component of computer-aided synthesis planning, yet its intrinsically one-to-many nature is poorly captured by single-answer evaluation and benchmarking protocols. To address this, we introduce Top-K prompting as a robust training and inference paradigm to better capture diverse, plausible reaction predictions. We compile CREED-CCV-2+USPTO-XL, an ultra-large-scale dataset of ~45.6 million verified reactions to train the C3LM (Chemistry Constraint-Consistent Language Model). By integrating fine-tuning with ChemCensor-based and novelty-oriented rewards, our model achieves state-of-the-art performance on the OOD URSA-expert-2026 benchmark. Further analysis of reaction uniqueness shows that LLMs and conventional models explore complementary reaction spaces, motivating ensemble-based retrosynthesis systems. Overall, our results establish Top-K, plausibility-aware training as a practical new direction for robust future LLM-based synthesis planning.
Figures & tables
Figure 1: Comparison of representative top-performing models from each model tier, normalized by metric-specific frontier scores.
Figure 2: Data-generation pipeline for the CREED-CCV-2+USPTO-XL training set.
Figure 3: Top-1 → Top-K transition on URSA-expert-2026 (Av. PT-Top-10 CC). Hollow = Top-1 task, filled = Top-K task; line length is the gain Δ=Top-K−Top-1 (right column, sorted).
Model
URSA-expert-2026
USPTO-50K-test-mini
Max
Av. PT-Top-K CC
Max
Av. PT-Top-K CC
@3
@5
@10
@3
@5
@10
Proprietary Foundation Models
Grok-4.1
1.86
1.56
1.31
0.86
3.99
2.61
2.02
1.24
Grok-4.3
1.74
1.41
1.13
0.66
3.99
2.58
1.95
1.15
Gemini 3.1 Pro
1.91
1.69
1.46
1.08
4.32
2.92
2.34
1.59
Table 1: Plausibility-based evaluation in the single-step retrosynthesis Top- K mode. Max : per-target maximum ChemCensor score averaged over TMs. Av. PT-Top-K CC : per-TM average ChemCensor score over top-K unique predictions; ChemCensor v1.1.1, USPTO-full as the source of synthetic precedents. See the full table in Appendix F . Results for recently released models are available at https://dddbench.insilico.com/ .
Figure 4: Intersection between the reactions predicted for the URSA-expert-2026 benchmark set by each LLM and those predicted by MHNreact. Values on the right ( Δ ) show the average per-target difference between the number of reactions unique to the LLM and those unique to MHNreact; positive values indicate more LLM-unique reactions. C3LM-2 : C3LM-LFM2-CREED-CCV+USPTO ; C3LM-3 : C3LM-LFM2-CREED-CCV-2+USPTO-XL ; C3LM-5 : C3LM-LFM2-RFT-CC-NR . See all results in Figure 5 .
Table 2: C3LM family inventory. TD-1 = CREED-CCV + USPTO; TD-2 = CREED-CCV-2 + USPTO-XL. ∗ Trained in prior work ( Zagribelnyy et al., 2026b ) ; its predictions are re-scored under ChemCensor (v1.1.1) for comparison, without retraining.
Model
URSA-expert-2026
USPTO-50K-test-mini
Max
Av. PT-Top-K CC
Max
Av. PT-Top-K CC
@3
@5
@10
@3
@5
@10
Proprietary Foundation Models
Grok-4.1
1.73
1.28
0.92
0.47
4.01
2.29
1.53
0.79
Grok-4.3
1.47
0.86
0.56
0.28
3.06
1.34
0.83
0.41
Gemini 3.1 Pro
1.63
0.92
0.57
0.28
4.00
1.70
1.03
0.51
Appendix
Table 4: Plausibility-based evaluation in the single-step retrosynthesis Top- 1 mode. Max : per-target maximum ChemCensor score averaged over TMs. Av. PT-Top-K CC : per-TM average ChemCensor score over top-K unique predictions; ChemCensor v1.1.1.
Model
Intersection
Unique for Model
Unique for MHNreact
Δ
C3LM-LFM2-CREED-CCV-2+USPTO-XL
5.0
6.8
6.4
+0.4
C3LM-LFM2-RFT-CC-NR
5.0
6.7
6.4
+0.3
C3LM-LFM2-RFT-CC
4.8
6.0
6.6
-0.6
C3LM-LFM2-CREED-CCV+USPTO
3.6
4.0
7.9
-3.9
Gemini 3.1 Pro
5.2
3.5
6.2
-2.7
GPT 5.5
5.2
3.2
6.2
-3.0
Appendix
Table 5: Intersection of predicted reactions for URSA-expert-2026 benchmark set with the reference conventional model MHNreact. Δ is the per-target difference between the number of reactions unique to the model and those unique to MHNreact.
Figure 5: Intersection of reactions predicted by LLMs and the conventional SSRS model MHNreact. Values on the right show the difference between the number of reactions unique to the model and those unique to MHNreact (model − MHNreact). C3LM-1 : C3LM-LFM2-CREED-CCV+USPTO * ; C3LM-2 : C3LM-LFM2-CREED-CCV+USPTO ; C3LM-3 : C3LM-LFM2-CREED-CCV-2+USPTO-XL ; C3LM-4 : C3LM-LFM2-RFT-CC ; C3LM-5 : C3LM-LFM2-RFT-CC-NR .
Figure 6: Intersection of reactions predicted for X404-1768-5005 by C3LM-LFM2-CREED-CCV-2+USPTO-XL and MHNreact.
Model
URSA-expert-2026
USPTO-50K-test-mini
Max
Av. PT-Top-K CC
Max
Av. PT-Top-K CC
@3
@5
@10
@3
@5
@10
Proprietary Foundation Models
Grok-4.1
2.17
1.81
1.54
1.06
4.13
2.84
2.27
1.46
Grok-4.3
2.02
1.62
1.32
0.82
4.14
2.81
2.19
1.35
Gemini 3.1 Pro
2.20
1.93
1.68
1.29
4.42
3.12
2.56
1.83
Appendix
Table 6: Plausibility-based evaluation in the single-step retrosynthesis Top- K mode. Max : per-target maximum ChemCensor score averaged over TMs. Av. PT-Top-K CC : per-TM average ChemCensor score over top-K unique predictions; ChemCensor v1.1.1, ChemCensor-U2P2 reference database (USPTO-full ∪ Pistachio Q3 2023) .
Model
URSA-expert-2026
USPTO-50K-test-mini
Max
Av. PT-Top-K CC
Max
Av. PT-Top-K CC
@3
@5
@10
@3
@5
@10
Proprietary Foundation Models
Grok-4.1
1.90
1.59
1.33
0.88
4.04
2.71
2.13
1.33
Grok-4.3
1.80
1.45
1.16
0.69
4.02
2.65
2.03
1.22
Gemini 3.1 Pro
1.96
1.72
1.49
1.11
4.35
2.97
2.42
1.66
Appendix
Table 7: Plausibility-based evaluation in the single-step retrosynthesis Top- K mode. Max : per-target maximum ChemCensor score averaged over TMs. Av. PT-Top-K CC : per-TM average ChemCensor score over top-K unique predictions; ChemCensor v0.5.2.
Figure 7: Distribution of the number of reactant sets for products from USPTO-50K-test-mini. For each product, all reference reactant sets were retrieved by matching it against USPTO-full.
Synthesis planning aiming to find pathways of reactions for a target molecule is one of the most important and challenging tasks in drug discovery. Recent progress has produced both specialized deep-learning retrosynthesis systems and general-purpose large language models, but objective comparison remains difficult due to the lack of flexible, chemically interpretable benchmarking protocols. In the current study, we are introducing the URSA (Utilitarian RetroSynthesis Assessment) evaluation framework that provides the opportunity to benchmark the synthetic routes not only from a formal perspective, such as convergence to commercially available starting materials, but also from a chemical plausibility perspective, mimicking the way expert chemists evaluate the reactions and routes. The study covers a comprehensive evaluation of both conventional end-to-end retrosynthesis solutions and LLMs for the synthesis planning task on a set of novel, diverse target molecules with undisclosed synthetic routes, which represent realistic tasks in the daily drug design routine. We find that while LLMs can support high-level strategic planning, they currently underperform specialized retrosynthesis models in reliably solving synthesis planning tasks.
Bogdan Zagribelnyy, Ivan Ilin, Nikita Bondarev +7
Insilico Medicine AI Limited, Masdar City, Abu Dhabi, UAE · Independent researcher · Insilico Medicine Canada Inc., Montreal, Quebec, Canada +1
Retrosynthesis prediction aims to identify reactants that can synthesize a given product molecule. Although molecular large language models (LLMs) have recently shown promising results, most existing methods either generate reactants directly or provide only generic product-level analysis, without explicitly reasoning about bond-disconnection strategies that justify specific reactant choices. This paper proposes RetroReasoner, a retrosynthetic reasoning model that captures chemists' strategic disconnection-based thinking. RetroReasoner is trained with supervised fine-tuning and reinforcement learning. For supervised fine-tuning, SyntheticRetro generates structured disconnection rationales paired with reactant predictions. For reinforcement learning, a round-trip reward evaluates predicted reactants by passing them through a forward synthesis model and rewarding predictions that reconstruct the original product. RetroReasoner can also be applied to multi-step retrosynthetic planning by incorporating it into a parallelized Monte Carlo tree search framework, reducing search time while increasing the number and diversity of valid synthetic pathways. Experimental results show that RetroReasoner outperforms prior baselines, including not only molecular LLMs but also retrosynthesis-specific expert models, and generates a broader range of feasible reactant proposals, especially for challenging reaction instances. The code is available at https://github.com/KU-AGI/RetroReasoner.
Hanbum Ko, Chanhui Lee, Ye Rin Kim +4
Department of Artificial Intelligence, Korea University · Materials Intelligence Lab, LG AI Research · Department of Statistics, Korea University
Multi-step retrosynthesis planning is often considered solved once a route to purchasable starting materials is found, but such a route should also be practical in real-world chemistry. Recent LLM-based planners formulate this process as sequential decision-making over an AND-OR graph, yet typically expand a single molecule per turn and are optimized for solvability alone, leaving alternative routes uncompared across the multiple objectives that determine practicality before the search budget is committed. We introduce RetroPlanner, an LLM-based planner that jointly compares multiple routes to steer the search toward higher synthesizability, as measured by reaction plausibility, round-trip consistency, and starting-material price. RetroPlanner is trained to reason over chemical evidence: structural progress from the target molecule, bond changes and reaction classes, where candidate routes diverge from one another, and how they rank across multiple objectives. Experiments on multi-step retrosynthesis benchmarks demonstrate that RetroPlanner recovers more alternative routes than prior LLM-based planners while improving synthetic route quality and maintaining a high success rate.
Ye Rin Kim, Yongjun Jeong, Seongjun Yun +4
Korea University, Department of Artificial Intelligence · Korea University, Department of Statistics