Representing Spatial Trajectories as Distributions
Not on the map. Why?
Abstract (arXiv)
We introduce a representation learning framework for spatial trajectories. We represent partial observations of trajectories as probability distributions in a learned latent space, which characterize the uncertainty about unobserved parts of the trajectory. Our framework allows us to obtain samples from a trajectory for any continuous point in time, both interpolating and extrapolating. Our flexible approach supports directly modifying specific attributes of a trajectory, such as its pace, as well as combining different partial observations into single representations. Experiments show our method's advantage over baselines in prediction tasks.
Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Builds on 42 of its 73 references that are in the map. First posted on arXiv 4 Oct 2022.
Builds on
42 of 73 references.
References · 42
- 2017Attention Is All You Needcited by 60,361
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
- 2020Implicit Neural Representations with Periodic Activation Functionscited by 2,238
- 2020Fourier Features Let Networks Learn High Frequency Functions in Low Dimensional Domainscited by 2,200
- 2021Is Space-Time Attention All You Need for Video Understanding?cited by 1,620
- 2021ViViT: A Video Vision Transformercited by 1,620
- 2020D-NeRF: Neural Radiance Fields for Dynamic Scenescited by 1,465
- 2018Spatial Temporal Graph Convolutional Networks for Skeleton-Based Action Recognitioncited by 1,209
- 2018OpenPose: Realtime Multi-Person 2D Pose Estimation using Part Affinity Fieldscited by 1,162
- 2014Semi-Supervised Learning with Deep Generative Modelscited by 496
- 2020Space-time Neural Irradiance Fields for Free-Viewpoint Videocited by 414
30 more
- 2020Spatiotemporal Contrastive Video Representation Learningcited by 372
- 2015A Recurrent Latent Variable Model for Sequential Datacited by 362
- 2017On human motion prediction using recurrent neural networkscited by 338
- 2021GRAND: Graph Neural Diffusioncited by 258
- 2020FineGym: A Hierarchical Video Dataset for Fine-grained Action Understandingcited by 234
- 2019Multiple Futures Predictioncited by 178
- 2019Video Representation Learning by Dense Predictive Codingcited by 175
- 2020Contrastive Learning of General-Purpose Audio Representationscited by 169
- 2021VideoMoCo: Contrastive Video Representation Learning with Temporally Adversarial Examplescited by 154
- 2018Sequential Attend, Infer, Repeat: Generative Modelling of Moving Objectscited by 128
- 2016An End-to-End Spatio-Temporal Attention Model for Human Action Recognition from Skeleton Datacited by 126
- 2018Learning to Decompose and Disentangle Representations for Video Predictioncited by 121
- 2020BoxE: A Box Embedding Model for Knowledge Base Completioncited by 105
- 2017Deep representation learning for human motion prediction and classificationcited by 98
- 2018Learning to score the figure skating sports videoscited by 73
- 2018Probabilistic Embedding of Knowledge Graphs with Box Lattice Measurescited by 64
- 2018Propagation Networks for Model-Based Control Under Partial Observationcited by 64
- 2020DSDNet: Deep Structured self-Driving Networkcited by 62
- 2021Learning the Predictability of the Futurecited by 49
- 2017Unsupervised Learning of Semantic Audio Representationscited by 44
- 2021Modeling Fine-Grained Entity Types with Box Embeddingscited by 36
- 2020Improving Local Identifiability in Probabilistic Box Embeddingscited by 35
- 2022Probabilistic Representations for Video Contrastive Learningcited by 34
- 2020Unsupervised Contrastive Learning of Sound Event Representationscited by 32
- 2019Stochastic Prediction of Multi-Agent Interactions from Partial Observationscited by 26
- 2022Revealing Occlusions with 4D Neural Fieldscited by 17
- 2020Predicting Visual Overlap of Images Through Interpretable Non-Metric Box Embeddingscited by 16
- 2019Can Unconditional Language Models Recover Arbitrary Sentences?cited by 15
- 2021Box Embeddings: An open-source library for representation learning using geometric structurescited by 9
- 2019Prediction of Human Full-Body Movements with Motion Optimization and Recurrent Neural Networkscited by 2
Built on by
Citing papers per year: 2023: 3; 2024: 1; 2025: 0; 2026: 1.
5 papers.
- 2023Holistic Representation Learning for Multitask Trajectory Anomaly Detectioncited by 15
- 2023Continuous Intermediate Token Learning with Implicit Motion Manifold for Keyframe Based Motion Interpolationcited by 12
- 2023TimewarpVAE: Simultaneous Time-Warping and Representation Learning of Trajectoriescited by 1
- 2024Temporal Dynamics Decoupling with Inverse Processing for Enhancing Human Motion Predictioncited by 0
- 2026Schr"odinger's Cat: Probabilistic Representation and Prediction of Potential Scene Kinematicscited by 0
- 2026Schr"odinger's Cat: Probabilistic Representation and Prediction of Potential Scene Kinematics28 Jul 2026
- 2024Temporal Dynamics Decoupling with Inverse Processing for Enhancing Human Motion Prediction31 Dec 2024
- 2023Holistic Representation Learning for Multitask Trajectory Anomaly Detection3 Nov 2023
- 2023TimewarpVAE: Simultaneous Time-Warping and Representation Learning of Trajectories24 Oct 2023
- 2023Continuous Intermediate Token Learning with Implicit Motion Manifold for Keyframe Based Motion Interpolation27 Mar 2023