Large Language Models (LLMs) have significantly advanced molecular discovery, but existing multimodal molecular architectures fundamentally rely on autoregressive (AR) backbones. This strict left-to-right inductive bias is sub-optimal for generating chemically valid molecules, as it struggles to account for non-local global constraints (e.g., ring closures) and often accumulates structural errors during sequential generation. To address these limitations, we propose MolDA (Molecular language model with masked Diffusion with mAsking), a novel multimodal framework that replaces the conventional AR backbone with a discrete Large Language Diffusion Model. MolDA extracts comprehensive structural representations using a hybrid graph encoder, which captures both local and global topologies, and aligns them into the language token space via a Q-Former. Furthermore, we mathematically reformulate Molecular Structure Preference Optimization specifically for the masked diffusion. Through bidirectional iterative denoising, MolDA ensures global structural coherence, chemical validity, and robust reasoning across molecule generation, captioning, and property prediction.
Figures & tables
Figure 1: MolDA architecture overview. A hybrid graph encoder (GINE + TokenGT) produces structural representations, the Q-Former maps them into the language model token space, and LLaDA generates the response through iterative denoising with low-confidence remasking.
Generation
Captioning
Regression
Classification
Model
Exact ↑
MACCS ↑
R-1 ↑
METEOR ↑
LogD ↓
HOMO ↓
HIV ↑
SIDER ↑
MolT5-Large
.331
.868
.539
.480
-
-
-
-
Mol-LLM
.415
.873
.570
.471
0.981
.004
.774
.743
Galactica
.000
.178
.105
.065
2.534
.230
.550
.533
LlaSMol
.253
.827
.494
.426
1.582
.982
.685
.622
ChemDFM
.421
.891
.377
.301
5.886
.183
.551
.540
Table 1: Molecular understanding results on ChEBI-20 (Generation, Captioning) and MoleculeNet (Property Prediction). Best results are bolded , second best are underlined .
Forward Synthesis
Retrosynthesis
Reagent Prediction
Model
Exact ↑
MACCS ↑
Exact ↑
MACCS ↑
Exact ↑
MACCS ↑
Mol-LLM
.904
.985
.512
.887
.134
.535
Galactica
.000
.215
.000
.283
.000
.134
LlaSMol
.038
.676
.026
.650
.000
.200
ChemDFM
.302
.808
.080
.769
.000
.229
3D-MoLM
.000
.639
.000
.810
.000
.175
Table 2: Reaction prediction results on Mol-Instructions. Best results are bolded , second best are underlined .
Bridging molecular structures and natural language is essential for controllable design. Autoregressive models struggle with long-range dependencies, while standard diffusion processes apply uniform corruption across positions, which can distort structurally informative tokens. We present BiMol-Diff, a unified diffusion framework for the paired tasks of text-conditioned molecule generation and molecule captioning. Our key component is a token-aware noise schedule that assigns position-dependent corruption based on token recovery difficulty, preserving harder-to-recover substructures during the forward process. On ChEBI-20 and M3-20M, BiMol-Diff improves molecule reconstruction with a 15.4% relative gain in Exact Match and achieves strong captioning results, attaining best BLEU and BERTScore among compared baselines. These results indicate token-aware noising improves fidelity in molecular structure-language modelling.
The increasing variety of molecular data creates a need for generative models that can flexibly incorporate heterogeneous constraints across modalities. However, existing SMILES-based diffusion models are typically designed for a fixed conditioning modality, and introducing new constraints often requires retraining the model. To address this limitation, we propose Cross-Modality Controlled Molecule Generation with Diffusion Language Model (CMCM-DLM), a modular framework that extends a pre-trained diffusion model to support heterogeneous molecular constraints without retraining the backbone. We demonstrate CMCM-DLM using two complementary modalities: molecular structure and chemical properties. Specifically, a Structure Control Module (SCM) guides early diffusion steps to establish the molecular scaffold, while a Property Control Module (PCM) subsequently steers generation toward target chemical properties. This staged design enables flexible integration of different molecular constraints within a unified generative framework. Experiments on multiple datasets demonstrate effective cross-modal controllability and strong adaptability, highlighting the potential of CMCM-DLM for heterogeneous molecular data modeling and data-driven drug discovery.
Goal-directed molecular generation requires satisfying heterogeneous constraints such as protein--ligand compatibility and multi-objective drug-like properties, yet existing methods often optimize these constraints in isolation, failing to reconcile conflicting objectives (e.g., affinity vs. safety), and struggle to navigate the non-differentiable chemical space without compromising structural validity. To address these challenges, we propose CAGenMol, a condition-aware discrete diffusion framework over molecular sequences that formulates molecular design as conditional denoising guided by heterogeneous structural and property signals. By coupling discrete diffusion with reinforcement learning, the model aligns the generation trajectory with non-differentiable objectives while preserving chemical validity and diversity. The non-autoregressive nature of diffusion language model further enables iterative refinement of molecular fragments at inference time. Experiments on structure-conditioned, property-conditioned, and dual-conditioned benchmarks demonstrate consistent improvements over state-of-the-art methods in binding affinity, drug-likeness, and success rate, highlighting the effectiveness of our framework.
Yanting Li, Zhuoyang Jiang, Enyan Dai +3
The Hong Kong University of Science and Technology (Guangzhou) · Jinan University, Guangzhou