cs.AIApr 6, 2026

MolDA: Molecular Understanding and Generation via Large Language Diffusion Model

Authors: Seohyeon Shin, HanJun Choi, Jun-Hyung Park, Hong Kook Kim, Mansu Kim

Organizations: Gwangju Institute of Science and Technology, Gwangju, South Korea · Hankuk University of Foreign Studies, Seoul, South Korea

Abstract

Large Language Models (LLMs) have significantly advanced molecular discovery, but existing multimodal molecular architectures fundamentally rely on autoregressive (AR) backbones. This strict left-to-right inductive bias is sub-optimal for generating chemically valid molecules, as it struggles to account for non-local global constraints (e.g., ring closures) and often accumulates structural errors during sequential generation. To address these limitations, we propose MolDA (Molecular language model with masked Diffusion with mAsking), a novel multimodal framework that replaces the conventional AR backbone with a discrete Large Language Diffusion Model. MolDA extracts comprehensive structural representations using a hybrid graph encoder, which captures both local and global topologies, and aligns them into the language token space via a Q-Former. Furthermore, we mathematically reformulate Molecular Structure Preference Optimization specifically for the masked diffusion. Through bidirectional iterative denoising, MolDA ensures global structural coherence, chemical validity, and robust reasoning across molecule generation, captioning, and property prediction.

Figures & tables

Explore similar work

CardsList
  1. BiMol-Diff: A Unified Diffusion Framework for Molecular Generation and Captioning

    Apr 27, 2026Aditya Hemant Shahane, Anuj Kumar Sirohi, Devansh Arora +3Diffusion SamplingMolecular Generation

  2. Cross-Modality Controlled Molecule Generation with Diffusion Language Model

    Aug 20, 2025Yunzhe Zhang, Yifei Wang, Khanh Vinh Nguyen +1Diffusion Model GuidanceMultimodal Generation

  3. CAGenMol: Condition-Aware Diffusion Language Model for Goal-Directed Molecular Generation

    Apr 13, 2026Yanting Li, Zhuoyang Jiang, Enyan Dai +3Molecular GenerationMolecular Optimization