mlsanityData to 7 Oct 2026

Peeking into the Future: Predicting Future Person Activities and Locations in Videos

arXiv 1902.03748 ↗First posted 11 Feb 2019cs.CVcited by 112

Not on the map. Why?

Abstract (arXiv)

Deciphering human behaviors to predict their future paths/trajectories and what they would do from videos is important in many applications. Motivated by this idea, this paper studies predicting a pedestrian's future path jointly with future activities. We propose an end-to-end, multi-task learning system utilizing rich visual features about human behavioral information and interaction with their surroundings. To facilitate the training, the network is learned with an auxiliary task of predicting future location in which the activity will happen. Experimental results demonstrate our state-of-the-art performance over two public benchmarks on future trajectory prediction. Moreover, our method is able to produce meaningful future activity prediction in addition to the path. The result provides the first empirical evidence that joint modeling of paths and activities benefits future path prediction.

Key facts. Cited by 112 papers in the map (data through 7 Oct 2026). First posted on arXiv 11 Feb 2019.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2019: 1; 2020: 0; 2021: 33; 2022: 31; 2023: 19; 2024: 16; 2025: 9; 2026: 3.

112 papers.

Sort:

By area:

  1. 2022Joint Hand Motion and Interaction Hotspots Prediction from Egocentric Videoscited by 110
  2. 2021SGCN:Sparse Graph Convolution Network for Pedestrian Trajectory Predictioncited by 97
  3. 2022Remember Intentions: Retrospective-Memory-based Trajectory Predictioncited by 86
  4. 2021Object-Region Video Transformerscited by 73
  5. 2022Human Trajectory Prediction via Neural Social Physicscited by 66
  6. 2021Stepwise Goal-Driven Networks for Trajectory Predictioncited by 62
  7. 2021Trajectory Prediction with Latent Belief Energy-Based Modelcited by 60
  8. 2022Adaptive Trajectory Prediction via Transferable GNNcited by 51
  9. 2021Three Steps to Multimodal Trajectory Prediction: Modality Clustering, Classification and Synthesiscited by 46
  10. 2022Non-Probability Sampling Network for Stochastic Human Trajectory Predictioncited by 46
  11. 2019Imitation Learning for Human Pose Predictioncited by 44
  12. 2021Interpretable Social Anchors for Human Trajectory Forecasting in Crowdscited by 44
38 more
  1. 2022Learning Pedestrian Group Representations for Multi-modal Trajectory Predictioncited by 44
  2. 2021AGENT: A Benchmark for Core Psychological Reasoningcited by 42
  3. 2021A Dynamic Spatial-temporal Attention Network for Early Anticipation of Traffic Accidentscited by 42
  4. 2021Human Trajectory Prediction via Counterfactual Analysiscited by 42
  5. 2023EigenTrajectory: Low-Rank Descriptors for Multi-Modal Trajectory Forecastingcited by 41
  6. 2021Learning to Anticipate Egocentric Actions by Imaginationcited by 40
  7. 2022Graph-based Spatial Transformer with Memory Replay for Multi-future Pedestrian Trajectory Predictioncited by 36
  8. 2021Spatio-Temporal Graph Dual-Attention Network for Multi-Agent Prediction and Trackingcited by 35
  9. 2024SingularTrajectory: Universal Trajectory Predictor Using Diffusion Modelcited by 35
  10. 2023Social-Transmotion: Promptable Human Trajectory Predictioncited by 33
  11. 2024Can Language Beat Numerical Regression? Language-Based Multimodal Trajectory Predictioncited by 31
  12. 2021Personalized Trajectory Prediction via Distribution Discriminationcited by 30
  13. 2021Investigating Pose Representations and Motion Contexts Modeling for 3D Motion Predictioncited by 30
  14. 2022Rethinking Learning Approaches for Long-Term Action Anticipationcited by 29
  15. 2023SocialCircle: Learning the Angle-based Social Interaction Representation for Pedestrian Trajectory Predictioncited by 27
  16. 2022SMEMO: Social Memory for Trajectory Forecastingcited by 26
  17. 2022Is an Object-Centric Video Representation Beneficial for Transfer?cited by 24
  18. 2022PedFormer: Pedestrian Behavior Prediction via Cross-Modal Attention Modulation and Gated Multitask Learningcited by 23
  19. 2021SlowFast Rolling-Unrolling LSTMs for Action Anticipation in Egocentric Videoscited by 20
  20. 2021MSN: Multi-Style Network for Trajectory Predictioncited by 19
  21. 2021SSAGCN: Social Soft Attention Graph Convolution Network for Pedestrian Trajectory Predictioncited by 19
  22. 2022LatentFormer: Multi-Agent Transformer-Based Interaction Modeling and Trajectory Predictioncited by 19
  23. 2022CSCNet: Contextual Semantic Consistency Network for Trajectory Prediction in Crowded Spacescited by 18
  24. 2021Unlimited Neighborhood Interaction for Heterogeneous Trajectory Predictioncited by 17
  25. 2021Collaborative Uncertainty in Multi-Agent Trajectory Forecastingcited by 17
  26. 2021Egocentric Human Trajectory Forecasting with a Wearable Camera and Multi-Modal Fusioncited by 17
  27. 2023Ancilia: Scalable Intelligent Video Surveillance for the Artificial Intelligence of Thingscited by 17
  28. 2021Euro-PVI: Pedestrian Vehicle Interactions in Dense Urban Centerscited by 16
  29. 2022Social Interpretable Tree for Pedestrian Trajectory Predictioncited by 16
  30. 2023Synchronize Feature Extracting and Matching: A Single Branch Framework for 3D Object Trackingcited by 16
  31. 2022Action-based Contrastive Learning for Trajectory Predictioncited by 15
  32. 2022Forecasting Human Trajectory from Scene Historycited by 14
  33. 2022PromptonomyViT: Multi-Task Prompt Learning Improves Video Transformers using Synthetic Scene Datacited by 14
  34. 2023Another Vertical View: A Hierarchical Network for Heterogeneous Trajectory Prediction via Spectrumscited by 14
  35. 2022Collaborative Uncertainty Benefits Multi-Agent Multi-Modal Trajectory Forecastingcited by 13
  36. 2022STGlow: A Flow-based Generative Framework with Dual Graphormer for Pedestrian Trajectory Predictioncited by 13
  37. 2023Uncertainty-Aware Pedestrian Trajectory Prediction via Distributional Diffusioncited by 13
  38. 2022Safety-compliant Generative Adversarial Networks for Human Trajectory Forecastingcited by 12

50 most cited of 112 All 112 (JSON)