mlsanityData to 7 Oct 2026

Beyond Sequence: Impact of Geometric Context for RNA Property Prediction

arXiv 2410.11933 ↗First posted 15 Oct 2024q-bio.QM cs.AI cs.LGcited by 8

Not on the map. Why?

Abstract (arXiv)

Accurate prediction of RNA properties, such as stability and interactions, is crucial for advancing our understanding of biological processes and developing RNA-based therapeutics. RNA structures can be represented as 1D sequences, 2D topological graphs, or 3D all-atom models, each offering different insights into its function. Existing works predominantly focus on 1D sequence-based models, which overlook the geometric context provided by 2D and 3D geometries. This study presents the first systematic evaluation of incorporating explicit 2D and 3D geometric information into RNA property prediction, considering not only performance but also real-world challenges such as limited data availability, partial labeling, sequencing noise, and computational efficiency. To this end, we introduce a newly curated set of RNA datasets with enhanced 2D and 3D structural annotations, providing a resource for model evaluation on RNA data. Our findings reveal that models with explicit geometry encoding generally outperform sequence-based models, with an average prediction RMSE reduction of around 12% across all various RNA tasks and excelling in low-data and partial labeling regimes, underscoring the value of explicitly incorporating geometric context. On the other hand, geometry-unaware sequence-based models are more robust under sequencing noise but often require around 2-5× training data to match the performance of geometry-aware models. Our study offers further insights into the trade-offs between different RNA representations in practical applications and addresses a significant gap in evaluating deep learning models for RNA tasks.

Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Builds on 30 of its 95 references that are in the map. First posted on arXiv 15 Oct 2024.

Builds on

30 of 95 references.

References · 30

  1. 2017Attention Is All You Needcited by 59,932
  2. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
  3. 2017Graph Attention Networkscited by 8,854
  4. 2018How Powerful are Graph Neural Networks?cited by 4,355
  5. 2019Optuna: A Next-generation Hyperparameter Optimization Frameworkcited by 2,455
  6. 2019Fast Graph Representation Learning with PyTorch Geometriccited by 2,414
  7. 2016Convolutional Neural Networks on Graphs with Fast Localized Spectral Filteringcited by 2,085
  8. 2021E(n) Equivariant Graph Neural Networkscited by 951
  9. 2018Tensor field networks: Rotation- and translation-equivariant neural networks for 3D point cloudscited by 735
  10. 2022Recipe for a General, Powerful, Scalable Graph Transformercited by 702
  11. 2021E(3)-Equivariant Graph Neural Networks for Data-Efficient and Accurate Interatomic Potentialscited by 701
  12. 2017SchNet: A continuous-filter convolutional neural network for modeling quantum interactionscited by 569
18 more
  1. 2020Directional Message Passing for Molecular Graphscited by 556
  2. 2020Masked Label Prediction: Unified Message Passing Model for Semi-Supervised Classificationcited by 500
  3. 2022MACE: Higher Order Equivariant Message Passing Neural Networks for Fast and Accurate Force Fieldscited by 467
  4. 2020Learning from Protein Structure with Geometric Vector Perceptronscited by 308
  5. 2022How Powerful are Spectral Graph Neural Networkscited by 169
  6. 2019SMILES Transformer: Pre-trained Molecular Fingerprint for Low Data Drug Discoverycited by 89
  7. 2023On the Expressive Power of Geometric Graph Neural Networkscited by 89
  8. 2023FAENet: Frame Averaging Equivariant GNN for Materials Modelingcited by 72
  9. 2022Geometrically Equivariant Graph Neural Networks: A Surveycited by 55
  10. 2022KPGT: Knowledge-Guided Pre-training of Graph Transformer for Molecular Property Predictioncited by 31
  11. 2024RiNALMo: General-Purpose RNA Language Models Can Generalize Well on Structure Prediction Taskscited by 31
  12. 2023A Survey on Spectral Graph Neural Networkscited by 26
  13. 2020RNA Secondary Structure Prediction By Learning Unrolled Algorithmscited by 24
  14. 2018Spectral Multigraph Networks for Discovering and Fusing Relationships in Moleculescited by 9
  15. 2021Deep learning models for predicting RNA degradation via dual crowdsourcingcited by 8
  16. 2022Probabilistic Transformer: Modelling Ambiguities and Distributions for RNA Folding and Molecule Designcited by 7
  17. 2023Shape-aware Graph Spectral Learningcited by 6
  18. 2024SE(3)-Hyena Operator for Scalable Equivariant Learningcited by 6

Built on by

Cited by year

Citing papers per year: 2024: 1; 2025: 7.

8 papers.