MolSight: Molecular Property Prediction with Images
Not on the map. Why?
Abstract (arXiv)
Every molecule ever synthesised can be drawn as a 2D skeletal diagram, yet in modern property prediction this universally available representation has received less focus in favour of molecular graphs, 3D conformers, or billion-parameter language models, each imposing its own computational and data-engineering overhead. We present MolSight, the first systematic large-scale study of vision-based Molecular Property Prediction (MPP). Using 10 vision architectures, 7 pre-training strategies, and 2,M molecule images, we evaluate performance across 10 downstream tasks spanning physical-property regression, drug-discovery classification, and quantum-chemistry prediction. To account for the wide variation in structural complexity across pre-training molecules, we further propose a chemistry-informed curriculum: five structural complexity descriptors partition the corpus into five tiers of increasing chemical difficulty, consistently outperforming non-curriculum baselines. We show that a single rendered bond-line image, processed by a vision encoder, is sufficient for competitive molecular property prediction, i.e. textitchemical insight from sight alone. The best curriculum-trained configuration achieves the top result on 5 of 10 benchmarks and top two on all 10, at textbftextit80× lower FLOPs than the nearest multi-modal competitor.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 24 of its 39 references that are in the map. First posted on arXiv 11 May 2026.
Builds on
24 of 39 references.
References · 24
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,049
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,733
- 2017Neural Message Passing for Quantum Chemistrycited by 3,487
- 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,109
- 2017MoleculeNet: A Benchmark for Molecular Machine Learningcited by 1,051
- 2025Janus-Pro: Unified Multimodal Understanding and Generation with Data and Model Scalingcited by 812
- 2023EVA-CLIP: Improved Training Techniques for CLIP at Scalecited by 798
- 2022Recipe for a General, Powerful, Scalable Graph Transformercited by 713
- 2019Analyzing Learned Molecular Representations for Property Predictioncited by 375
- 2020ChemBERTa: Large-Scale Self-Supervised Pretraining for Molecular Property Predictioncited by 337
12 more
- 2024Long-CLIP: Unlocking the Long-Text Capability of CLIPcited by 300
- 2021Pre-training Molecular Graph Representation with 3D Geometrycited by 248
- 2016SoundNet: Learning Sound Representations from Unlabeled Videocited by 247
- 2022Translation between Molecules and Natural Languagecited by 177
- 20213D Infomax improves GNNs for Molecular Property Predictioncited by 146
- 2022SELFIES and the future of molecular string representationscited by 76
- 2023A Group Symmetric Stochastic Differential Equation Model for Molecule Multi-modal Pretrainingcited by 32
- 2024CRKD: Enhanced Camera-Radar Object Detection with Cross-modality Knowledge Distillationcited by 28
- 2023Multimodal Molecular Pretraining via Modality Blendingcited by 21
- 2024COSMOS: Cross-Modality Self-Distillation for Vision Language Pre-trainingcited by 15
- 2025MolVision: Molecular Property Prediction with Vision Language Modelscited by 5
- 2026ChemPro: A Progressive Chemistry Benchmark for Large Language Modelscited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.