mlsanityData to 7 Oct 2026

PlayGen-MoG: Framework for Diverse Multi-Agent Play Generation via Mixture-of-Gaussians Trajectory Prediction

arXiv 2604.02447 ↗First posted 2 Apr 2026cs.CV cs.AI cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Multi-agent trajectory generation in team sports requires models that capture both the diversity of possible plays and realistic spatial coordination between players on plays. Standard generative approaches such as Conditional Variational Autoencoders (CVAE) and diffusion models struggle with this task, exhibiting posterior collapse or convergence to the dataset mean. Moreover, most trajectory prediction methods operate in a forecasting regime that requires multiple frames of observed history, limiting their use for play design where only the initial formation is available. We present PlayGen-MoG, an extensible framework for formation-conditioned play generation that addresses these challenges through three design choices: 1/ a Mixture-of-Gaussians (MoG) output head with shared mixture weights across all agents, where a single set of weights selects a play scenario that couples all players' trajectories, 2/ relative spatial attention that encodes pairwise player positions and distances as learned attention biases, and 3/ non-autoregressive prediction of absolute displacements from the initial formation, eliminating cumulative error drift and removing the dependence on observed trajectory history, enabling realistic play generation from a single static formation alone. On American football tracking data, PlayGen-MoG achieves 1.68 yard ADE and 3.98 yard FDE while maintaining full utilization of all 8 mixture components with entropy of 2.06 out of 2.08, and qualitatively confirming diverse generation without mode collapse.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 13 of its 20 references that are in the map. First posted on arXiv 2 Apr 2026.

Builds on

13 of 20 references.

References · 13

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018Self-Attention with Relative Position Representationscited by 1,112
  3. 2018Social GAN: Socially Acceptable Trajectories with Generative Adversarial Networkscited by 687
  4. 2017Non-Autoregressive Neural Machine Translationcited by 457
  5. 2021AgentFormer: Agent-Aware Transformers for Socio-Temporal Multi-Agent Forecastingcited by 327
  6. 2018Multimodal Trajectory Predictions for Autonomous Driving using Deep Convolutional Networkscited by 289
  7. 2021MultiPath++: Efficient Information Fusion and Trajectory Aggregation for Behavior Predictioncited by 246
  8. 2020Spatio-Temporal Graph Transformer Networks for Pedestrian Trajectory Predictioncited by 218
  9. 2022Stochastic Trajectory Prediction via Motion Indeterminacy Diffusioncited by 184
  10. 2021Scene Transformer: A unified architecture for predicting multiple agent trajectoriescited by 165
  11. 2023Leapfrog Diffusion Model for Stochastic Trajectory Predictioncited by 129
  12. 2017Coordinated Multi-Agent Imitation Learningcited by 70
1 more
  1. 2018Generating Multi-Agent Trajectories using Programmatic Weak Supervisioncited by 46

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026GenTac: Generative Modeling and Forecasting of Soccer Tactics
  2. 2026TacticGen: Grounding Adaptable and Scalable Generation of Football Tactics
  3. 2024Learning Group Interactions and Semantic Intentions for Multi-Object Trajectory Prediction
  4. 2024Sports-Traj: A Unified Trajectory Generation Model for Multi-Agent Movement in Sports
  5. 2023PlayBest: Professional Basketball Player Behavior Synthesis via Planning with Diffusion
  6. 2025Generative World Models of Tasks: LLM-Driven Hierarchical Scaffolding for Embodied Agents
  7. 2026Multiplayer Interactive World Models with Representation Autoencoders
  8. 2026Monte Carlo Pass Search: Using Trajectory Generation for 3D Counterfactual Pass Evaluation in Football