InsTraj: Instructing Diffusion Models with Travel Intentions to Generate Real-world Trajectories
On the map: Diffusion models → Diffusion and flow policies for robotics
Abstract (arXiv)
The generation of realistic and controllable GPS trajectories is a fundamental task for applications in urban planning, mobility simulation, and privacy-preserving data sharing. However, existing methods face a two-fold challenge: they lack the deep semantic understanding to interpret complex user travel intent, and struggle to handle complex constraints while maintaining the realistic diversity inherent in human behavior. To resolve this, we introduce InsTraj, a novel framework that instructs diffusion models to generate high-fidelity trajectories directly from natural language descriptions. Specifically, InsTraj first utilizes a powerful large language model to decipher unstructured travel intentions formed in natural language, thereby creating rich semantic blueprints and bridging the representation gap between intentions and trajectories. Subsequently, we proposed a multimodal trajectory diffusion transformer that can integrate semantic guidance to generate high-fidelity and instruction-faithful trajectories that adhere to fine-grained user intent. Comprehensive experiments on real-world datasets demonstrate that InsTraj significantly outperforms state-of-the-art methods in generating trajectories that are realistic, diverse, and semantically faithful to the input instructions.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Diffusion and flow policies for robotics, one of 14 directions in Diffusion models. Builds on 18 of its 38 references that are in the map. First posted on arXiv 5 Apr 2026.
Builds on
18 of 38 references.
Closest ancestors · 2
Same direction, newest first
- 2024Noise Matters: Diffusion Model-based Urban Mobility Generation with Collaborative Noise Priors6 Dec
- 2024ControlTraj: Controllable Trajectory Generation with Topology-Constrained Diffusion Model23 Apr
Other references · 16
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
- 2021SimCSE: Simple Contrastive Learning of Sentence Embeddingscited by 2,168
- 2022Make-A-Video: Text-to-Video Generation without Text-Video Datacited by 1,725
- 2020DiffWave: A Versatile Diffusion Model for Audio Synthesiscited by 1,339
- 2024LLM2Vec: Large Language Models Are Secretly Powerful Text Encoderscited by 396
- 2019Controllable Text-to-Image Generationcited by 187
- 2020A Survey on Deep Learning for Human Mobilitycited by 87
- 2024Controllable Generation with Text-to-Image Diffusion Models: A Surveycited by 82
- 2022The Creativity of Text-to-Image Generationcited by 73
4 more
- 2024Diff-RNTraj: A Structure-aware Diffusion Model for Road Network-constrained Trajectory Generationcited by 28
- 2018Learning to Route with Sparse Trajectory Sets---Extended Versioncited by 14
- 2025Holistic Semantic Representation for Navigational Trajectory Generationcited by 7
- 2025One Fits All: General Mobility Trajectory Modeling via Masked Conditional Diffusioncited by 5
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Plan-to-Synthesis: Cross-City Human Mobility Generation via Semantic Latent Flow Matching
- 2026TrajDLM: Topology-Aware Block Diffusion Language Model for Trajectory Generation
- 2024Mobility-LLM: Learning Visiting Intentions and Travel Preferences from Human Mobility Data with Large Language Models
- 2025MoveGPT: Scaling Mobility Foundation Models with Spatially-Aware Mixture of Experts
- 2025MoveFM-R: Advancing Mobility Foundation Models via Language-driven Semantic Reasoning
- 2026MobiDiff: Semantic-Aware Multi-Channel Discrete Diffusion for Human Mobility Data Generation
- 2023DiffTraj: Generating GPS Trajectory with Diffusion Probabilistic Model
- 2024LIMP: Large Language Model Enhanced Intent-aware Mobility Prediction