mlsanityData to 14 Oct 2026

FREE: The Foundational Semantic Recognition for Modeling Environmental Ecosystems

arXiv 2311.10255 ↗First posted 17 Nov 2023cs.LG q-bio.PEcited by 8

Not on the map. Why?

Abstract (arXiv)

Modeling environmental ecosystems is critical for the sustainability of our planet, but is extremely challenging due to the complex underlying processes driven by interactions amongst a large number of physical variables. As many variables are difficult to measure at large scales, existing works often utilize a combination of observable features and locally available measurements or modeled values as input to build models for a specific study region and time period. This raises a fundamental question in advancing the modeling of environmental ecosystems: how to build a general framework for modeling the complex relationships among diverse environmental variables over space and time? In this paper, we introduce a framework, FREE, that enables the use of varying features and available information to train a universal model. The core idea is to map available environmental data into a text space and then convert the traditional predictive modeling task in environmental science to a semantic recognition problem. Our evaluation on two societally important real-world applications, stream water temperature prediction and crop yield prediction, demonstrates the superiority of FREE over multiple baselines, even in data-sparse scenarios.

Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Builds on 17 of its 74 references that are in the map. First posted on arXiv 17 Nov 2023.

Builds on

17 of 74 references.

References · 17

  1. 2017Attention Is All You Needcited by 60,361
  2. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
  3. 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,326
  4. 2019DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lightercited by 4,307
  5. 2022OPT: Open Pre-trained Transformer Language Modelscited by 3,512
  6. 2022Language Models are Realistic Tabular Data Generatorscited by 294
  7. 2019Tackling Climate Change with Machine Learningcited by 265
  8. 2017Physics-guided Neural Networks (PGNN): An Application in Lake Temperature Modelingcited by 131
  9. 2023On the Opportunities and Challenges of Foundation Models for Geospatial Artificial Intelligencecited by 88
  10. 2020Combining data assimilation and machine learning to emulate a dynamical model from sparse and noisy observations: a case study with the Lorenz 96 modelcited by 74
  11. 2020Physics-Guided Machine Learning for Scientific Discovery: An Application in Simulating Lake Temperature Profilescited by 59
  12. 2021A GNN-RNN Approach for Harnessing Geospatial and Temporal Information: Application to Crop Yield Predictioncited by 28
5 more
  1. 2020Physics Guided Machine Learning Methods for Hydrologycited by 17
  2. 2020Predicting Water Temperature Dynamics of Unmonitored Lakes with Meta Transfer Learningcited by 15
  3. 2020HydroNets: Leveraging River Structure for Hydrologic Modelingcited by 14
  4. 2021Heterogeneous Stream-reservoir Graph Networks with Data Assimilationcited by 9
  5. 2022Modeling Reservoir Release Using Pseudo-Prospective Learning and Physical Simulations to Predict Water Temperaturecited by 2

Built on by

Cited by year

Citing papers per year: 2024: 4; 2025: 4.

8 papers.