mlsanityData to 7 Oct 2026

DYNA-PRUNER: Input-Adaptive Data-Model Co-Pruning for Efficient and Scalable Spatio-Temporal Media Prediction

arXiv 2606.15346 ↗First posted 13 Jun 2026cs.CV cs.LG cs.MMcited by 0

Not on the map. Why?

Abstract (arXiv)

Spatio-temporal prediction supports radar/satellite nowcasting and city-scale traffic monitoring, but modern models are often too expensive for real-time deployment. This stems from a mismatch between dense computation and strong input-dependent redundancy (e.g., calm seas or clear skies). To enable automated, resource-aware architecture optimization in scalable media analysis, we propose Dyna-Pruner, an end-to-end framework for input-dependent co-pruning of data and model structure. A shared-importance synchronization mechanism generates coupled masks that prune redundant regions and their corresponding computational units (e.g., convolutional filters), yielding per-sample sparse sub-networks at inference time. Experiments on WeatherBench, SEVIR, and TaxiBJ show seamless integration with CNN, RNN, and Transformer backbones, reducing FLOPs by up to 70% and achieving a 2.5× speedup on NVIDIA Jetson AGX Orin with negligible accuracy loss (<1%).

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 26 of its 39 references that are in the map. First posted on arXiv 13 Jun 2026.

Builds on

26 of 39 references.

References · 26

  1. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  2. 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
  3. 2020Fourier Neural Operator for Parametric Partial Differential Equationscited by 2,806
  4. 2015Convolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcastingcited by 1,428
  5. 2017Spatio-Temporal Graph Convolutional Networks: A Deep Learning Framework for Traffic Forecastingcited by 1,125
  6. 2016Deep Spatio-Temporal Residual Networks for Citywide Crowd Flows Predictioncited by 330
  7. 2023WeatherBench 2: A benchmark for the next generation of data-driven global weather modelscited by 227
  8. 2019Understanding Straight-Through Estimator in Training Activation Quantized Neural Netscited by 225
  9. 2023Convolutional Neural Operators for robust and accurate learning of PDEscited by 207
  10. 2021PredRNN: A Recurrent Neural Network for Spatiotemporal Predictive Learningcited by 181
  11. 2022SimVP: Simpler yet Better Video Predictioncited by 181
  12. 2020PhyGeoNet: Physics-Informed Geometry-Adaptive Convolutional Neural Networks for Solving Parameterized Steady-State PDEs on Irregular Domaincited by 173
14 more
  1. 2022Earthformer: Exploring Space-Time Transformers for Earth System Forecastingcited by 146
  2. 2024DPOT: Auto-Regressive Denoising Operator Transformer for Large-Scale PDE Pre-Trainingcited by 137
  3. 2022Convolutional Neural Networks on Graphs with Chebyshev Approximation, Revisitedcited by 87
  4. 2022Temporal Attention Unit: Towards Efficient Spatiotemporal Predictive Learningcited by 84
  5. 2025Frequency-Aligned Knowledge Distillation for Lightweight Spatiotemporal Forecastingcited by 53
  6. 2023PastNet: Introducing Physical Inductive Biases for Spatio-temporal Video Predictioncited by 44
  7. 2025SepPrune: Structured Pruning for Efficient Deep Speech Separationcited by 31
  8. 2025OneForecast: A Universal Framework for Global and Regional Weather Forecastingcited by 30
  9. 2024Pruning then Reweighting: Towards Data-Efficient Training of Diffusion Modelscited by 17
  10. 2024DIVE: Taming DINO for Subject-Driven Video Editingcited by 17
  11. 2023Less is More: Data Pruning for Faster Adversarial Trainingcited by 13
  12. 2024Two Heads Are Better Than One: Boosting Graph Sparse Training via Semantic and Topological Awarenesscited by 10
  13. 2024DynST: Dynamic Sparse Training for Resource-Constrained Spatio-Temporal Forecastingcited by 7
  14. 2026MagicFight: Personalized Martial Arts Combat Video Generationcited by 4

Built on by

Not cited yet.