mlsanityData to 14 Oct 2026

Unified machine learning tasks and datasets for enhancing renewable energy

arXiv 2311.06876 ↗First posted 12 Nov 2023cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Multi-tasking machine learning (ML) models exhibit prediction abilities in domains with little to no training data available (few-shot and zero-shot learning). Over-parameterized ML models are further capable of zero-loss training and near-optimal generalization performance. An open research question is, how these novel paradigms contribute to solving tasks related to enhancing the renewable energy transition and mitigating climate change. A collection of unified ML tasks and datasets from this domain can largely facilitate the development and empirical testing of such models, but is currently missing. Here, we introduce the ETT-17 (Energy Transition Tasks-17), a collection of 17 datasets from six different application domains related to enhancing renewable energy, including out-of-distribution validation and testing data. We unify all tasks and datasets, such that they can be solved using a single multi-tasking ML model. We further analyse the dimensions of each dataset; investigate what they require for designing over-parameterized models; introduce a set of dataset scores that describe important properties of each task and dataset; and provide performance benchmarks.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 25 of its 35 references that are in the map. First posted on arXiv 12 Nov 2023.

Builds on

25 of 35 references.

References · 25

  1. 2017Attention Is All You Needcited by 60,361
  2. 2020Language Models are Few-Shot Learnerscited by 32,419
  3. 2021On the Opportunities and Risks of Foundation Modelscited by 4,033
  4. 2016Understanding deep learning requires rethinking generalizationcited by 1,674
  5. 2021Decision Transformer: Reinforcement Learning via Sequence Modelingcited by 1,546
  6. 2021Multitask Prompted Training Enables Zero-Shot Task Generalizationcited by 1,470
  7. 2020WILDS: A Benchmark of in-the-Wild Distribution Shiftscited by 1,375
  8. 2018Reconciling modern machine learning practice and the bias-variance trade-offcited by 927
  9. 2022A Generalist Agentcited by 808
  10. 2021Offline Reinforcement Learning as One Big Sequence Modeling Problemcited by 644
  11. 2019Tackling Climate Change with Machine Learningcited by 265
  12. 2020The Open Catalyst 2020 (OC20) Dataset and Community Challengescited by 246
13 more
  1. 2022Online Decision Transformercited by 196
  2. 2021Pretrained Transformers as Universal Computation Enginescited by 162
  3. 2021A Universal Law of Robustness via Isoperimetrycited by 151
  4. 2021Generalized Decision Transformer for Offline Hindsight Information Matchingcited by 106
  5. 2022The Open Catalyst 2022 (OC22) Dataset and Challenges for Oxide Electrocatalystscited by 95
  6. 2022Can Wikipedia Help Offline Reinforcement Learning?cited by 77
  7. 2019Overparameterized Neural Networks Implement Associative Memorycited by 45
  8. 2020An Introduction to Electrocatalyst Design using Machine Learning for Renewable Energy Storagecited by 45
  9. 2021ClimART: A Benchmark Dataset for Emulating Atmospheric Radiative Transfer in Weather and Climate Modelscited by 21
  10. 2022SDWPF: A Dataset for Spatial Dynamic Wind Power Forecasting Challenge at KDD Cup 2022cited by 21
  11. 2020Enhanced spatio-temporal electric load forecasts using less data with active deep learningcited by 4
  12. 2022AutoML for Climate Change: A Call to Actioncited by 3
  13. 2023Modelling and Optimization Based Control for Demand Response in Active Distribution Networkscited by 1

Built on by

Not cited yet.