mlsanityData to 14 Oct 2026

Translating Human Mobility Forecasting through Natural Language Generation

arXiv 2112.11481 ↗First posted 13 Dec 2021cs.CL cs.AIcited by 10

Not on the map. Why?

Abstract (arXiv)

Existing human mobility forecasting models follow the standard design of the time-series prediction model which takes a series of numerical values as input to generate a numerical value as a prediction. Although treating this as a regression problem seems straightforward, incorporating various contextual information such as the semantic category information of each Place-of-Interest (POI) is a necessary step, and often the bottleneck, in designing an effective mobility prediction model. As opposed to the typical approach, we treat forecasting as a translation problem and propose a novel forecasting through a language generation pipeline. The paper aims to address the human mobility forecasting problem as a language translation task in a sequence-to-sequence manner. A mobility-to-language template is first introduced to describe the numerical mobility data as natural language sentences. The core intuition of the human mobility forecasting translation task is to convert the input mobility description sentences into a future mobility description from which the prediction target can be obtained. Under this pipeline, a two-branch network, SHIFT (Translating Human Mobility Forecasting), is designed. Specifically, it consists of one main branch for language generation and one auxiliary branch to directly learn mobility patterns. During the training, we develop a momentum mode for better connecting and training the two branches. Extensive experiments on three real-world datasets demonstrate that the proposed SHIFT is effective and presents a new revolutionary approach to forecasting human mobility.

Key facts. Cited by 10 papers in the map (data through 14 Oct 2026). Builds on 17 of its 36 references that are in the map. First posted on arXiv 13 Dec 2021.

Builds on

17 of 36 references.

References · 17

  1. 2017Attention Is All You Needcited by 60,361
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  3. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  4. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  5. 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,513
  6. 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,893
  7. 2014Neural Machine Translation by Jointly Learning to Align and Translatecited by 4,548
  8. 2014Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modelingcited by 2,367
  9. 2020Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecastingcited by 2,169
  10. 2021Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series Forecastingcited by 1,676
  11. 2020Reformer: The Efficient Transformercited by 1,668
  12. 2021ViViT: A Video Vision Transformercited by 1,620
5 more
  1. 2019Enhancing the Locality and Breaking the Memory Bottleneck of Transformer on Time Series Forecastingcited by 607
  2. 2016Deep Spatio-Temporal Residual Networks for Citywide Crowd Flows Predictioncited by 333
  3. 2021STAN: Spatio-Temporal Attention Network for Next Location Recommendationcited by 102
  4. 2021Exploring Self-Supervised Representation Ensembles for COVID-19 Cough Classificationcited by 16
  5. 2020TERMCast: Temporal Relation Modeling for Effective Urban Flow Forecastingcited by 10

Built on by

Cited by year

Citing papers per year: 2022: 1; 2023: 4; 2024: 5.

10 papers.