mlsanityData to 14 Oct 2026

Temporal FiLM: Capturing Long-Range Sequence Dependencies with Feature-Wise Modulations

arXiv 1909.06628 ↗First posted 14 Sep 2019cs.LG stat.MLcited by 36

Not on the map. Why?

Abstract (arXiv)

Learning representations that accurately capture long-range dependencies in sequential inputs -- including text, audio, and genomic data -- is a key problem in deep learning. Feed-forward convolutional models capture only feature interactions within finite receptive fields while recurrent architectures can be slow and difficult to train due to vanishing gradients. Here, we propose Temporal Feature-Wise Linear Modulation (TFiLM) -- a novel architectural component inspired by adaptive batch normalization and its extensions -- that uses a recurrent neural network to alter the activations of a convolutional model. This approach expands the receptive field of convolutional sequence models with minimal computational overhead. Empirically, we find that TFiLM significantly improves the learning speed and accuracy of feed-forward neural networks on a range of generative and discriminative learning tasks, including text classification and audio super-resolution

Key facts. Cited by 36 papers in the map (data through 14 Oct 2026). First posted on arXiv 14 Sep 2019.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2021: 8; 2022: 6; 2023: 2; 2024: 9; 2025: 7; 2026: 4.

36 papers.

Sort:

By area:

  1. 2023A Survey on Audio Diffusion Models: Text To Speech Synthesis and Enhancement in Generative AIcited by 68
  2. 2021NU-Wave: A Diffusion Probabilistic Model for Neural Audio Upsamplingcited by 50
  3. 2022HiFi++: a Unified Framework for Bandwidth Extension and Speech Enhancementcited by 49
  4. 2022NU-Wave 2: A General Neural Audio Upsampling Model for Various Sampling Ratescited by 36
  5. 2022Analysing Diffusion-based Generative Approaches versus Discriminative Approaches for Speech Restorationcited by 34
  6. 2022CMGAN: Conformer-Based Metric-GAN for Monaural Speech Enhancementcited by 23
  7. 2024T-FOLEY: A Controllable Waveform-Domain Diffusion Model for Temporal-Event-Guided Foley Sound Synthesiscited by 19
  8. 2024Prompt-guided Precise Audio Editing with Diffusion Modelscited by 18
  9. 2025FLowHigh: Towards Efficient and High-Quality Audio Super-Resolution with Single-Step Flow Matchingcited by 18
  10. 2022AERO: Audio Super Resolution in the Spectral Domaincited by 17
  11. 2021Catch-A-Waveform: Learning to Generate Audio from a Single Short Examplecited by 15
  12. 2021Autoregressive Quantile Flows for Predictive Uncertainty Estimationcited by 15
24 more
  1. 2022Modelling black-box audio effects with time-varying feature modulationcited by 11
  2. 2024TRAMBA: A Hybrid Transformer and Mamba Architecture for Practical Audio and Bone Conduction Speech Super Resolution and Enhancement on Mobile and Wearable Platformscited by 11
  3. 2021Node-wise Localization of Graph Neural Networkscited by 10
  4. 2021Self-Attention for Audio Super-Resolutioncited by 9
  5. 2021Learning Continuous Representation of Audio for Arbitrary Scale Super Resolutioncited by 9
  6. 2021TUNet: A Block-online Bandwidth Extension Model based on Transformers and Self-supervised Pretrainingcited by 8
  7. 2023UnDiff: Unsupervised Voice Restoration with Unconditional Diffusion Modelcited by 7
  8. 2025VoiceBridge: General Speech Restoration with One-step Latent Bridge Modelscited by 4
  9. 2024CleanUMamba: A Compact Mamba Network for Speech Denoising using Channel Pruningcited by 2
  10. 2025Meta-learning Structure-Preserving Dynamicscited by 2
  11. 2025Fast 2DGS: Efficient Image Representation with Deep Gaussian Priorcited by 2
  12. 2024Sines, Transient, Noise Neural Modeling of Piano Notescited by 1
  13. 2024Context-Conditioned Spatio-Temporal Predictive Learning for Reliable V2V Channel Predictioncited by 1
  14. 2026CodecFlow: Efficient Bandwidth Extension via Conditional Flow Matching in Neural Codec Latent Spacecited by 1
  15. 2021Audio Spectral Enhancement: Leveraging Autoencoders for Low Latency Reconstruction of Long, Lossy Audio Sequencescited by 0
  16. 2024Speech Bandwidth Expansion Via High Fidelity Generative Adversarial Networkscited by 0
  17. 2024Modeling Time-Dependent Responses of Optical Compressors with Selective State Space Modelscited by 0
  18. 2024Evaluating Neural Networks Architectures for Spring Reverb Modellingcited by 0
  19. 2025Neural Spectral Band Generation for Audio Codingcited by 0
  20. 2025SUBARU: A Practical Approach to Power Saving in Hearables Using SUB-Nyquist Audio Resolution Upsamplingcited by 0
  21. 2025STDiff: A State Transition Diffusion Framework for Time Series Imputation in Industrial Systemscited by 0
  22. 2026SL-S4Wave: Self-Supervised Learning of Physiological Waveforms with Structured State Space Modelscited by 0
  23. 2026Behaviour-Conditioned Neural Processes for Adaptive Residential Short-Term Load Forecastingcited by 0
  24. 2026P2Flow: Phoneme-aware Progressive Flow Matching for Extreme Speech Super-Resolutioncited by 0