mlsanityData to 13 Oct 2026

Target Concept Tuning Improves Extreme Weather Forecasting

arXiv 2603.19325 ↗First posted 17 Mar 2026cs.LG cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Deep learning models for meteorological forecasting often fail in rare but high-impact events such as typhoons, where relevant data is scarce. Existing fine-tuning methods typically face a trade-off between overlooking these extreme events and overfitting them at the expense of overall performance. We propose TaCT, an interpretable concept-gated fine-tuning framework that solves the aforementioned issue by selective model improvement: models are adapted specifically for failure cases while preserving performance in common scenarios. To this end, TaCT automatically discovers failure-related internal concepts using Sparse Autoencoders and counterfactual analysis, and updates parameters only when the corresponding concepts are activated, rather than applying uniform adaptation. Experiments show consistent improvements in typhoon forecasting across different regions without degrading other meteorological variables. The identified concepts correspond to physically meaningful circulation patterns, revealing model biases and supporting trustworthy adaptation in scientific forecasting tasks. The code is available at https://anonymous.4open.science/r/Concept-Gated-Fine-tune-62AC.

Key facts. No citing papers in the map yet (data through 13 Oct 2026). Builds on 16 of its 39 references that are in the map. First posted on arXiv 17 Mar 2026.

Builds on

16 of 39 references.

References · 16

  1. 2019Parameter-Efficient Transfer Learning for NLPcited by 4,213
  2. 2021Prefix-Tuning: Optimizing Continuous Prompts for Generationcited by 3,898
  3. 2021The Power of Scale for Parameter-Efficient Prompt Tuningcited by 3,785
  4. 2022Locating and Editing Factual Associations in GPTcited by 2,650
  5. 2017Interpretability Beyond Feature Attribution: Quantitative Testing with Concept Activation Vectors (TCAV)cited by 1,316
  6. 2023Representation Engineering: A Top-Down Approach to AI Transparencycited by 1,286
  7. 2021Editing Factual Knowledge in Language Modelscited by 551
  8. 2024Scaling and evaluating sparse autoencoderscited by 544
  9. 2020MAD-X: An Adapter-Based Framework for Multi-Task Cross-Lingual Transfercited by 443
  10. 2023FuXi: A cascade machine learning forecasting system for 15-day global weather forecastcited by 240
  11. 2023WeatherBench 2: A benchmark for the next generation of data-driven global weather modelscited by 234
  12. 2023Linearity of Relation Decoding in Transformer Language Modelscited by 195
4 more
  1. 2020Explaining NLP Models via Minimal Contrastive Editing (MiCE)cited by 105
  2. 2023Aligning Large Language Models with Human Preferences through Representation Engineeringcited by 71
  3. 2023Emergent Modularity in Pre-trained Transformerscited by 37
  4. 2025Deep Learning and Foundation Models for Weather Prediction: A Surveycited by 15

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Towards mechanistic understanding in a data-driven weather model: internal activations reveal interpretable physical features
  2. 2025ClimateLLM: Efficient Weather Forecasting via Frequency-Aware Large Language Models
  3. 2026Beyond Linear Superposition: Discovering Climate Features in AI Weather Models with KAN-SAE
  4. 2025ClimaEmpact: Domain-Aligned Small Language Models and Datasets for Extreme Weather Analytics
  5. 2026Demystifying Data-Driven Probabilistic Medium-Range Weather Forecasting
  6. 2026Aurora-X: Built for Extreme Time Series Forecasting
  7. 2026Phys-Diff: A Physics-Inspired Latent Diffusion Model for Tropical Cyclone Forecasting
  8. 2026SAE-Xplainers: Rule-Based Feature Interpretation for Extreme Earth Events