mlsanityData to 14 Oct 2026

Learning to Retrieve for Environmental Knowledge Discovery: An Augmentation-Adaptive Self-Supervised Learning Framework

arXiv 2509.14563 ↗First posted 18 Sep 2025cs.LGcited by 2

Not on the map. Why?

Abstract (arXiv)

The discovery of environmental knowledge depends on labeled task-specific data, but is often constrained by the high cost of data collection. Existing machine learning approaches usually struggle to generalize in data-sparse or atypical conditions. To this end, we propose an Augmentation-Adaptive Self-Supervised Learning (A2SL) framework, which retrieves relevant observational samples to enhance modeling of the target ecosystem. Specifically, we introduce a multi-level pairwise learning loss to train a scenario encoder that captures varying degrees of similarity among scenarios. These learned similarities drive a retrieval mechanism that supplements a target scenario with relevant data from different locations or time periods. Furthermore, to better handle variable scenarios, particularly under atypical or extreme conditions where traditional models struggle, we design an augmentation-adaptive mechanism that selectively enhances these scenarios through targeted data augmentation. Using freshwater ecosystems as a case study, we evaluate A2SL in modeling water temperature and dissolved oxygen dynamics in real-world lakes. Experimental results show that A2SL significantly improves predictive accuracy and enhances robustness in data-scarce and atypical scenarios. Although this study focuses on freshwater ecosystems, the A2SL framework offers a broadly applicable solution in various scientific domains.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 21 of its 55 references that are in the map. First posted on arXiv 18 Sep 2025.

Builds on

21 of 55 references.

References · 21

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
  3. 2022TimesNet: Temporal 2D-Variation Modeling for General Time Series Analysiscited by 1,058
  4. 2023iTransformer: Inverted Transformers Are Effective for Time Series Forecastingcited by 931
  5. 2024TimeMixer: Decomposable Multiscale Mixing for Time Series Forecastingcited by 346
  6. 2024Graph Retrieval-Augmented Generation: A Surveycited by 324
  7. 2023TSMixer: An All-MLP Architecture for Time Series Forecastingcited by 240
  8. 2023Neural General Circulation Models for Weather and Climatecited by 239
  9. 2016Theory-guided Data Science: A New Paradigm for Scientific Discovery from Datacited by 171
  10. 2020Integrating Scientific Knowledge with Machine Learning for Engineering and Environmental Systemscited by 164
  11. 2019Towards Learning Universal, Regional, and Local Hydrological Behaviors via Machine-Learning Applied to Large-Sample Datasetscited by 69
  12. 2017A trans-disciplinary review of deep learning research for water resources scientistscited by 47
9 more
  1. 2025Ask in Any Modality: A Comprehensive Survey on Multimodal Retrieval-Augmented Generationcited by 42
  2. 2020Predicting Water Temperature Dynamics of Unmonitored Lakes with Meta Transfer Learningcited by 15
  3. 2025Physics-Guided Foundation Model for Scientific Discovery: An Application to Aquatic Sciencecited by 12
  4. 2024Adaptive Process-Guided Learning: An Application in Predicting Lake DO Concentrationscited by 9
  5. 2024Combining Satellite and Weather Data for Crop Type Mapping: An Inverse Modelling Approachcited by 5
  6. 2024A Unified Framework for Forward and Inverse Problems in Subsurface Imaging using Latent Space Translationscited by 5
  7. 2025RAG for Geoscience: What We Expect, Gaps and Opportunitiescited by 5
  8. 2025Foundation Models for Environmental Science: A Survey of Emerging Frontierscited by 4
  9. 2025A Survey of Foundation Models for Environmental Sciencecited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 2.

2 papers.