Accurate and Diverse Sampling of Sequences based on a "Best of Many" Sample Objective
Not on the map. Why?
Abstract (arXiv)
For autonomous agents to successfully operate in the real world, anticipation of future events and states of their environment is a key competence. This problem has been formalized as a sequence extrapolation problem, where a number of observations are used to predict the sequence into the future. Real-world scenarios demand a model of uncertainty of such predictions, as predictions become increasingly uncertain -- in particular on long time horizons. While impressive results have been shown on point estimates, scenarios that induce multi-modal distributions over future sequences remain challenging. Our work addresses these challenges in a Gaussian Latent Variable model for sequence prediction. Our core contribution is a "Best of Many" sample objective that leads to more accurate and more diverse predictions that better capture the true variations in real-world sequence data. Beyond our analysis of improved model fit, our models also empirically outperform prior work on three diverse tasks ranging from traffic scenes to weather data.
Key facts. Cited by 56 papers in the map (data through 7 Oct 2026). First posted on arXiv 20 Jun 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2020: 1; 2021: 9; 2022: 17; 2023: 12; 2024: 3; 2025: 8; 2026: 6.
56 papers.
Sort:
By area:
- 2023InterDiff: Generating 3D Human-Object Interactions with Physics-Informed Diffusioncited by 181
- 2023CG-HOI: Contact-Guided 3D Human-Object Interaction Generationcited by 137
- 2022BeLFusion: Latent Diffusion for Behavior-Driven Human Motion Predictioncited by 82
- 2023HumanMAC: Masked Motion Completion for Human Motion Predictioncited by 81
- 2021Generating Smooth Pose Sequences for Diverse Human Motion Predictioncited by 66
- 2021MG-GAN: A Multi-Generator Model Preventing Out-of-Distribution Samples in Pedestrian Trajectory Predictioncited by 61
- 2021The Wanderings of Odysseus in 3D Scenescited by 59
- 2024THOR: Text to Human-Object Interaction Diffusion via Relation Interventioncited by 46
- 2021Divide-and-Conquer for Lane-Aware Diverse Trajectory Predictioncited by 37
- 2023Diverse Human Motion Prediction Guided by Multi-Level Spatial-Temporal Anchorscited by 34
- 2022A generic diffusion-based approach for 3D human pose prediction in the wildcited by 33
- 2022Diverse Human Motion Prediction via Gumbel-Softmax Sampling from an Auxiliary Spacecited by 32
38 more
- 2023FEND: A Future Enhanced Distribution-Aware Contrastive Learning Framework for Long-tail Trajectory Predictioncited by 31
- 2022Motron: Multimodal Probabilistic Human Motion Forecastingcited by 30
- 2022Forecasting from LiDAR via Future Object Detectioncited by 28
- 2022Human Joint Kinematics Diffusion-Refinement for Stochastic Motion Predictioncited by 28
- 2022Quo Vadis: Is Trajectory Forecasting the Key Towards Long-Term Multi-Object Tracking?cited by 28
- 2023Stochastic Multi-Person 3D Motion Forecastingcited by 28
- 2023CoMusion: Towards Consistent Stochastic Human Motion Prediction via Motion Diffusioncited by 21
- 2021Diverse Video Generation using a Gaussian Process Triggercited by 17
- 2021Euro-PVI: Pedestrian Vehicle Interactions in Dense Urban Centerscited by 16
- 2022HiT-DVAE: Human Motion Generation via Hierarchical Transformer Dynamical VAEcited by 16
- 2023TransFusion: A Practical and Effective Transformer-based Diffusion Model for 3D Human Motion Predictioncited by 16
- 2022Action-based Contrastive Learning for Trajectory Predictioncited by 15
- 2021TrajeVAE: Controllable Human Motion Generation from Trajectoriescited by 14
- 2022Hierarchical Latent Structure for Multi-Modal Vehicle Trajectory Forecastingcited by 14
- 2024Learning Semantic Latent Directions for Accurate and Controllable Human Motion Predictioncited by 14
- 2022RAP: Risk-Aware Prediction for Robust Planningcited by 12
- 2025Nonisotropic Gaussian Diffusion for Realistic 3D Human Motion Predictioncited by 12
- 2023R-U-SURE? Uncertainty-Aware Code Suggestions By Maximizing Utility Across Random User Intentscited by 10
- 2026A Frame is Worth One Token: Efficient Generative World Modeling with Delta Tokenscited by 9
- 2020Learning from Demonstration with Weakly Supervised Disentanglementcited by 8
- 2023Diverse Multimedia Layout Generation with Multi Choice Learningcited by 8
- 2024MotionWavelet: Human Motion Prediction via Wavelet Manifold Learningcited by 8
- 2022Context-Aware Scene Prediction Network (CASPNet)cited by 7
- 2022Learning Forward Dynamics Model and Informed Trajectory Sampler for Safe Quadruped Navigationcited by 6
- 2022Learning Disentangled Representations for Controllable Human Motion Predictioncited by 5
- 2023CASPNet++: Joint Multi-Agent Motion Predictioncited by 4
- 2025CacheFlow: Fast Human Motion Prediction by Cached Normalizing Flowcited by 4
- 2021Maneuver-Aware Pooling for Vehicle Trajectory Predictioncited by 3
- 2022B'ezier Curve Gaussian Processescited by 3
- 2025Uncertainty-aware Probabilistic 3D Human Motion Forecasting via Invertible Networkscited by 2
- 2021Maneuver-based Anchor Trajectory Hypotheses at Roundaboutscited by 1
- 2023Manifold Contrastive Learning with Variational Lie Group Operatorscited by 1
- 2025MObyGaze: a film dataset of multimodal objectification densely annotated by expertscited by 1
- 2025HumanCM: One Step Human Motion Predictioncited by 1
- 2022Unified Simulation, Perception, and Generation of Human Behaviorcited by 0
- 2022Leveraging Trajectory Prediction for Pedestrian Video Anomaly Detectioncited by 0
- 2025Robust Planning for Autonomous Driving via Mixed Adversarial Diffusion Predictionscited by 0
- 2025Latent Guided Sampling for Combinatorial Optimizationcited by 0
50 most cited of 56 All 56 (JSON)
- 2026DeltaWAM: Change-Centric Visual Foresight via Delta Tokens for an Efficient World-Action Model27 Sep 2026
- 2026Gaussian-Mixture Latent Flow for Stochastic 3D Human Motion Prediction21 Aug 2026
- 2026Where Will They Go? Modelling Multimodal Pedestrian Manoeuvres from Ego-centric Videos17 Jun 2026
- 2026Mode-as-Sequence: Translating Multimodal Motion Prediction into Unified Sequential Mode Modeling21 May 2026
- 2026A Frame is Worth One Token: Efficient Generative World Modeling with Delta Tokens6 Apr 2026
- 2026KHMP: Frequency-Domain Kalman Refinement for High-Fidelity Human Motion Prediction22 Mar 2026
- 2025HumanCM: One Step Human Motion Prediction19 Oct 2025
- 2025Uncertainty-aware Probabilistic 3D Human Motion Forecasting via Invertible Networks19 Jul 2025
- 2025Stochastic Human Motion Prediction with Memory of Action Transition and Action Characteristic5 Jul 2025
- 2025Latent Guided Sampling for Combinatorial Optimization4 Jun 2025
- 2025MObyGaze: a film dataset of multimodal objectification densely annotated by experts28 May 2025
- 2025CacheFlow: Fast Human Motion Prediction by Cached Normalizing Flow19 May 2025
38 more
- 2025Robust Planning for Autonomous Driving via Mixed Adversarial Diffusion Predictions18 May 2025
- 2025Nonisotropic Gaussian Diffusion for Realistic 3D Human Motion Prediction10 Jan 2025
- 2024MotionWavelet: Human Motion Prediction via Wavelet Manifold Learning25 Nov 2024
- 2024Learning Semantic Latent Directions for Accurate and Controllable Human Motion Prediction16 Jul 2024
- 2024THOR: Text to Human-Object Interaction Diffusion via Relation Intervention17 Mar 2024
- 2023CG-HOI: Contact-Guided 3D Human-Object Interaction Generation27 Nov 2023
- 2023InterDiff: Generating 3D Human-Object Interactions with Physics-Informed Diffusion31 Aug 2023
- 2023CASPNet++: Joint Multi-Agent Motion Prediction15 Aug 2023
- 2023TransFusion: A Practical and Effective Transformer-based Diffusion Model for 3D Human Motion Prediction30 Jul 2023
- 2023Manifold Contrastive Learning with Variational Lie Group Operators23 Jun 2023
- 2023Stochastic Multi-Person 3D Motion Forecasting8 Jun 2023
- 2023CoMusion: Towards Consistent Stochastic Human Motion Prediction via Motion Diffusion21 May 2023
- 2023FEND: A Future Enhanced Distribution-Aware Contrastive Learning Framework for Long-tail Trajectory Prediction29 Mar 2023
- 2023R-U-SURE? Uncertainty-Aware Code Suggestions By Maximizing Utility Across Random User Intents1 Mar 2023
- 2023Diverse Human Motion Prediction Guided by Multi-Level Spatial-Temporal Anchors9 Feb 2023
- 2023HumanMAC: Masked Motion Completion for Human Motion Prediction7 Feb 2023
- 2023Diverse Multimedia Layout Generation with Multi Choice Learning16 Jan 2023
- 2022BeLFusion: Latent Diffusion for Behavior-Driven Human Motion Prediction25 Nov 2022
- 2022Quo Vadis: Is Trajectory Forecasting the Key Towards Long-Term Multi-Object Tracking?14 Oct 2022
- 2022Human Joint Kinematics Diffusion-Refinement for Stochastic Motion Prediction12 Oct 2022
- 2022A generic diffusion-based approach for 3D human pose prediction in the wild11 Oct 2022
- 2022RAP: Risk-Aware Prediction for Robust Planning4 Oct 2022
- 2022Action-based Contrastive Learning for Trajectory Prediction18 Jul 2022
- 2022Diverse Human Motion Prediction via Gumbel-Softmax Sampling from an Auxiliary Space15 Jul 2022
- 2022Hierarchical Latent Structure for Multi-Modal Vehicle Trajectory Forecasting11 Jul 2022
- 2022Leveraging Trajectory Prediction for Pedestrian Video Anomaly Detection5 Jul 2022
- 2022Learning Disentangled Representations for Controllable Human Motion Prediction4 Jul 2022
- 2022B'ezier Curve Gaussian Processes3 May 2022
- 2022Unified Simulation, Perception, and Generation of Human Behavior28 Apr 2022
- 2022Learning Forward Dynamics Model and Informed Trajectory Sampler for Safe Quadruped Navigation19 Apr 2022
- 2022HiT-DVAE: Human Motion Generation via Hierarchical Transformer Dynamical VAE4 Apr 2022
- 2022Forecasting from LiDAR via Future Object Detection30 Mar 2022
- 2022Motron: Multimodal Probabilistic Human Motion Forecasting8 Mar 2022
- 2022Context-Aware Scene Prediction Network (CASPNet)18 Jan 2022
- 2021The Wanderings of Odysseus in 3D Scenes16 Dec 2021
- 2021MG-GAN: A Multi-Generator Model Preventing Out-of-Distribution Samples in Pedestrian Trajectory Prediction20 Aug 2021
- 2021Generating Smooth Pose Sequences for Diverse Human Motion Prediction19 Aug 2021
- 2021Diverse Video Generation using a Gaussian Process Trigger9 Jul 2021
50 newest of 56 All 56 (JSON)
- 2022BeLFusion: Latent Diffusion for Behavior-Driven Human Motion Predictioncited by 82
- 2024THOR: Text to Human-Object Interaction Diffusion via Relation Interventioncited by 46
- 2022A generic diffusion-based approach for 3D human pose prediction in the wildcited by 33
- 2023TransFusion: A Practical and Effective Transformer-based Diffusion Model for 3D Human Motion Predictioncited by 16
- 2024Learning Semantic Latent Directions for Accurate and Controllable Human Motion Predictioncited by 14
- 2024MotionWavelet: Human Motion Prediction via Wavelet Manifold Learningcited by 8
- 2025HumanCM: One Step Human Motion Predictioncited by 1
- 2025Robust Planning for Autonomous Driving via Mixed Adversarial Diffusion Predictionscited by 0
- 2025HumanCM: One Step Human Motion Prediction19 Oct 2025
- 2025Robust Planning for Autonomous Driving via Mixed Adversarial Diffusion Predictions18 May 2025
- 2024MotionWavelet: Human Motion Prediction via Wavelet Manifold Learning25 Nov 2024
- 2024Learning Semantic Latent Directions for Accurate and Controllable Human Motion Prediction16 Jul 2024
- 2024THOR: Text to Human-Object Interaction Diffusion via Relation Intervention17 Mar 2024
- 2023TransFusion: A Practical and Effective Transformer-based Diffusion Model for 3D Human Motion Prediction30 Jul 2023
- 2022BeLFusion: Latent Diffusion for Behavior-Driven Human Motion Prediction25 Nov 2022
- 2022A generic diffusion-based approach for 3D human pose prediction in the wild11 Oct 2022
- 2023InterDiff: Generating 3D Human-Object Interactions with Physics-Informed Diffusioncited by 181
- 2023CG-HOI: Contact-Guided 3D Human-Object Interaction Generationcited by 137
- 2023HumanMAC: Masked Motion Completion for Human Motion Predictioncited by 81
- 2021Generating Smooth Pose Sequences for Diverse Human Motion Predictioncited by 66
- 2021MG-GAN: A Multi-Generator Model Preventing Out-of-Distribution Samples in Pedestrian Trajectory Predictioncited by 61
- 2021The Wanderings of Odysseus in 3D Scenescited by 59
- 2021Divide-and-Conquer for Lane-Aware Diverse Trajectory Predictioncited by 37
- 2023Diverse Human Motion Prediction Guided by Multi-Level Spatial-Temporal Anchorscited by 34
- 2022Diverse Human Motion Prediction via Gumbel-Softmax Sampling from an Auxiliary Spacecited by 32
- 2023FEND: A Future Enhanced Distribution-Aware Contrastive Learning Framework for Long-tail Trajectory Predictioncited by 31
- 2022Motron: Multimodal Probabilistic Human Motion Forecastingcited by 30
- 2022Forecasting from LiDAR via Future Object Detectioncited by 28
12 most cited of 45 All 45 (JSON)
- 2026Gaussian-Mixture Latent Flow for Stochastic 3D Human Motion Prediction21 Aug 2026
- 2026Where Will They Go? Modelling Multimodal Pedestrian Manoeuvres from Ego-centric Videos17 Jun 2026
- 2026Mode-as-Sequence: Translating Multimodal Motion Prediction into Unified Sequential Mode Modeling21 May 2026
- 2026KHMP: Frequency-Domain Kalman Refinement for High-Fidelity Human Motion Prediction22 Mar 2026
- 2025Uncertainty-aware Probabilistic 3D Human Motion Forecasting via Invertible Networks19 Jul 2025
- 2025Stochastic Human Motion Prediction with Memory of Action Transition and Action Characteristic5 Jul 2025
- 2025Latent Guided Sampling for Combinatorial Optimization4 Jun 2025
- 2025MObyGaze: a film dataset of multimodal objectification densely annotated by experts28 May 2025
- 2025CacheFlow: Fast Human Motion Prediction by Cached Normalizing Flow19 May 2025
- 2025Nonisotropic Gaussian Diffusion for Realistic 3D Human Motion Prediction10 Jan 2025
- 2023CG-HOI: Contact-Guided 3D Human-Object Interaction Generation27 Nov 2023
- 2023InterDiff: Generating 3D Human-Object Interactions with Physics-Informed Diffusion31 Aug 2023
12 newest of 45 All 45 (JSON)