mlsanityData to 7 Oct 2026

SwinUNet3D -- A Hierarchical Architecture for Deep Traffic Prediction using Shifted Window Transformers

arXiv 2201.06390 ↗First posted 17 Jan 2022cs.CVcited by 3

Not on the map. Why?

Abstract (arXiv)

Traffic forecasting is an important element of mobility management, an important key that drives the logistics industry. Over the years, lots of work have been done in Traffic forecasting using time series as well as spatiotemporal dynamic forecasting. In this paper, we explore the use of vision transformer in a UNet setting. We completely remove all convolution-based building blocks in UNet, while using 3D shifted window transformer in both encoder and decoder branches. In addition, we experiment with the use of feature mixing just before patch encoding to control the inter-relationship of the feature while avoiding contraction of the depth dimension of our spatiotemporal input. The proposed network is tested on the data provided by Traffic Map Movie Forecasting Challenge 2021(Traffic4cast2021), held in the competition track of Neural Information Processing Systems (NeurIPS). Traffic4cast2021 task is to predict an hour (6 frames) of traffic conditions (volume and average speed)from one hour of given traffic state (12 frames averaged in 5 minutes time span). Source code is available online at https://github.com/bojesomo/Traffic4Cast2021-SwinUNet3D.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 24 of its 30 references that are in the map. First posted on arXiv 17 Jan 2022.

Builds on

24 of 30 references.

References · 24

  1. 2017Attention Is All You Needcited by 59,932
  2. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  3. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  4. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  5. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
  6. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
  7. 2016Layer Normalizationcited by 5,579
  8. 2021SegFormer: Simple and Efficient Design for Semantic Segmentation with Transformerscited by 2,923
  9. 2021Pyramid Vision Transformer: A Versatile Backbone for Dense Prediction without Convolutionscited by 1,960
  10. 2021Vision Transformers for Dense Predictioncited by 1,789
  11. 2021Swin-Unet: Unet-like Pure Transformer for Medical Image Segmentationcited by 1,218
  12. 2021Video Swin Transformercited by 1,090
12 more
  1. 2018Multi-Task Learning as Multi-Objective Optimizationcited by 809
  2. 2021CoAtNet: Marrying Convolution and Attention for All Data Sizescited by 566
  3. 2021CSWin Transformer: A General Vision Transformer Backbone with Cross-Shaped Windowscited by 526
  4. 2017LinkNet: Exploiting Encoder Representations for Efficient Semantic Segmentationcited by 212
  5. 2019Attention in Natural Language Processingcited by 100
  6. 2021ResT: An Efficient Transformer for Visual Recognitioncited by 79
  7. 2019CrevNet: Conditionally Reversible Video Predictioncited by 15
  8. 2020Utilizing UNet for the future traffic map prediction task Traffic4cast challenge 2020cited by 12
  9. 2021Unified Spatio-Temporal Modeling for Traffic Forecasting using Graph Neural Networkcited by 8
  10. 2019Traffic map prediction using UNet based deep convolutional neural networkcited by 7
  11. 2020Towards Good Practices of U-Net for Traffic Forecastingcited by 4
  12. 2020Traffic flow prediction using Deep Sedenion Networkscited by 3

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2022: 2; 2023: 0; 2024: 0; 2025: 0; 2026: 1.

3 papers.

  1. 2022Traffic4cast at NeurIPS 2021 -- Temporal and Spatial Few-Shot Transfer Learning in Gridded Geo-Spatial Processescited by 15
  2. 2022A Novel Transformer Network with Shifted Window Cross-Attention for Spatiotemporal Weather Forecastingcited by 5
  3. 2026A Road-Conditioned Traffic Movie Prediction Network with Spatiotemporal and Structure-Consistent Learningcited by 0