cs.CVMay 11, 2026

MolSight: Molecular Property Prediction with Images

Authors: Aaditya Baranwal, Akshaj Gupta, Yogesh S Rawat, Shruti Vyas

Organizations: University of Central Florida, Orlando, Florida, USA · Birla Institute of Technology and Science, Pilani, Rajasthan, India

Abstract

Every molecule ever synthesised can be drawn as a 2D skeletal diagram, yet in modern property prediction this universally available representation has received less focus in favour of molecular graphs, 3D conformers, or billion-parameter language models, each imposing its own computational and data-engineering overhead. We present MolSight\textbf{MolSight}, the first systematic large-scale study of vision-based Molecular Property Prediction (MPP). Using 10 vision architectures, 7 pre-training strategies, and 2 M2\,M molecule images, we evaluate performance across 10 downstream tasks spanning physical-property regression, drug-discovery classification, and quantum-chemistry prediction. To account for the wide variation in structural complexity across pre-training molecules, we further propose a chemistry-informed curriculum\textbf{chemistry-informed curriculum}: five structural complexity descriptors partition the corpus into five tiers of increasing chemical difficulty, consistently outperforming non-curriculum baselines. We show that a single rendered bond-line image, processed by a vision encoder, is sufficient for competitive molecular property prediction, i.e. chemical insight from sight alone\textit{chemical insight from sight alone}. The best curriculum-trained configuration achieves the top result on 5 of 10\textbf{5 of 10} benchmarks and top two on all 10\textbf{all 10}, at \textbf{\textit{80×\times lower}} FLOPs than the nearest multi-modal competitor.

Explore similar work

CardsList