Beyond Sequence: Impact of Geometric Context for RNA Property Prediction
Not on the map. Why?
Abstract (arXiv)
Accurate prediction of RNA properties, such as stability and interactions, is crucial for advancing our understanding of biological processes and developing RNA-based therapeutics. RNA structures can be represented as 1D sequences, 2D topological graphs, or 3D all-atom models, each offering different insights into its function. Existing works predominantly focus on 1D sequence-based models, which overlook the geometric context provided by 2D and 3D geometries. This study presents the first systematic evaluation of incorporating explicit 2D and 3D geometric information into RNA property prediction, considering not only performance but also real-world challenges such as limited data availability, partial labeling, sequencing noise, and computational efficiency. To this end, we introduce a newly curated set of RNA datasets with enhanced 2D and 3D structural annotations, providing a resource for model evaluation on RNA data. Our findings reveal that models with explicit geometry encoding generally outperform sequence-based models, with an average prediction RMSE reduction of around 12% across all various RNA tasks and excelling in low-data and partial labeling regimes, underscoring the value of explicitly incorporating geometric context. On the other hand, geometry-unaware sequence-based models are more robust under sequencing noise but often require around 2-5× training data to match the performance of geometry-aware models. Our study offers further insights into the trade-offs between different RNA representations in practical applications and addresses a significant gap in evaluating deep learning models for RNA tasks.
Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Builds on 30 of its 95 references that are in the map. First posted on arXiv 15 Oct 2024.
Builds on
30 of 95 references.
References · 30
- 2017Attention Is All You Needcited by 59,932
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
- 2017Graph Attention Networkscited by 8,854
- 2018How Powerful are Graph Neural Networks?cited by 4,355
- 2019Optuna: A Next-generation Hyperparameter Optimization Frameworkcited by 2,455
- 2019Fast Graph Representation Learning with PyTorch Geometriccited by 2,414
- 2016Convolutional Neural Networks on Graphs with Fast Localized Spectral Filteringcited by 2,085
- 2021E(n) Equivariant Graph Neural Networkscited by 951
- 2018Tensor field networks: Rotation- and translation-equivariant neural networks for 3D point cloudscited by 735
- 2022Recipe for a General, Powerful, Scalable Graph Transformercited by 702
- 2021E(3)-Equivariant Graph Neural Networks for Data-Efficient and Accurate Interatomic Potentialscited by 701
- 2017SchNet: A continuous-filter convolutional neural network for modeling quantum interactionscited by 569
18 more
- 2020Directional Message Passing for Molecular Graphscited by 556
- 2020Masked Label Prediction: Unified Message Passing Model for Semi-Supervised Classificationcited by 500
- 2022MACE: Higher Order Equivariant Message Passing Neural Networks for Fast and Accurate Force Fieldscited by 467
- 2020Learning from Protein Structure with Geometric Vector Perceptronscited by 308
- 2022How Powerful are Spectral Graph Neural Networkscited by 169
- 2019SMILES Transformer: Pre-trained Molecular Fingerprint for Low Data Drug Discoverycited by 89
- 2023On the Expressive Power of Geometric Graph Neural Networkscited by 89
- 2023FAENet: Frame Averaging Equivariant GNN for Materials Modelingcited by 72
- 2022Geometrically Equivariant Graph Neural Networks: A Surveycited by 55
- 2022KPGT: Knowledge-Guided Pre-training of Graph Transformer for Molecular Property Predictioncited by 31
- 2024RiNALMo: General-Purpose RNA Language Models Can Generalize Well on Structure Prediction Taskscited by 31
- 2023A Survey on Spectral Graph Neural Networkscited by 26
- 2020RNA Secondary Structure Prediction By Learning Unrolled Algorithmscited by 24
- 2018Spectral Multigraph Networks for Discovering and Fusing Relationships in Moleculescited by 9
- 2021Deep learning models for predicting RNA degradation via dual crowdsourcingcited by 8
- 2022Probabilistic Transformer: Modelling Ambiguities and Distributions for RNA Folding and Molecule Designcited by 7
- 2023Shape-aware Graph Spectral Learningcited by 6
- 2024SE(3)-Hyena Operator for Scalable Equivariant Learningcited by 6
Built on by
Citing papers per year: 2024: 1; 2025: 7.
8 papers.
- 2024HELM: Hierarchical Encoding for mRNA Language Modelingcited by 9
- 2025DualEquiNet: A Dual-Space Hierarchical Equivariant Network for Large Biomoleculescited by 5
- 2025Geometric Hyena Networks for Large-scale Equivariant Learningcited by 4
- 2025UniZyme: A Unified Protein Cleavage Site Predictor Enhanced with Enzyme Active-Site Knowledgecited by 3
- 2025A Comprehensive Benchmark for RNA 3D Structure-Function Modelingcited by 1
- 2025Equi-mRNA: Protein Translation Equivariant Encoding for mRNA Language Modelscited by 1
- 2025Property-Isometric Variational Autoencoders for Sequence Modeling and Designcited by 0
- 2025HyperHELM: Hyperbolic Hierarchy Encoding for mRNA Language Modelingcited by 0
- 2025HyperHELM: Hyperbolic Hierarchy Encoding for mRNA Language Modeling29 Sep 2025
- 2025Property-Isometric Variational Autoencoders for Sequence Modeling and Design16 Sep 2025
- 2025Equi-mRNA: Protein Translation Equivariant Encoding for mRNA Language Models20 Aug 2025
- 2025DualEquiNet: A Dual-Space Hierarchical Equivariant Network for Large Biomolecules10 Jun 2025
- 2025Geometric Hyena Networks for Large-scale Equivariant Learning28 May 2025
- 2025A Comprehensive Benchmark for RNA 3D Structure-Function Modeling27 Mar 2025
- 2025UniZyme: A Unified Protein Cleavage Site Predictor Enhanced with Enzyme Active-Site Knowledge10 Feb 2025
- 2024HELM: Hierarchical Encoding for mRNA Language Modeling16 Oct 2024