Data to 14 Oct 2026

Elastic Decision Transformer

arXiv 2307.02484 ↗First posted 5 Jul 2023cs.LG cs.AIcited by 67

Not on the map. Why?

Cited by 44 in Offline RL and imitation learning from data, but placed by its own abstract, which didn’t fit.

Abstract (arXiv)

This paper introduces Elastic Decision Transformer (EDT), a significant advancement over the existing Decision Transformer (DT) and its variants. Although DT purports to generate an optimal trajectory, empirical evidence suggests it struggles with trajectory stitching, a process involving the generation of an optimal or near-optimal trajectory from the best parts of a set of sub-optimal trajectories. The proposed EDT differentiates itself by facilitating trajectory stitching during action inference at test time, achieved by adjusting the history length maintained in DT. Further, the EDT optimizes the trajectory by retaining a longer history when the previous trajectory is optimal and a shorter one when it is sub-optimal, enabling it to "stitch" with a more optimal trajectory. Extensive experimentation demonstrates EDT's ability to bridge the performance gap between DT-based and Q Learning-based approaches. In particular, the EDT outperforms Q Learning-based methods in a multi-task regime on the D4RL locomotion benchmark and Atari games. Videos are available at: https://kristery.github.io/edt/

Key facts. Cited by 67 papers in the map (data through 14 Oct 2026). Builds on 44 of its 63 references that are in the map. First posted on arXiv 5 Jul 2023.

Builds on

44 of 63 references.

References · 44

2017Attention Is All You Needcited by 60,361
2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
2020Language Models are Few-Shot Learnerscited by 32,419
2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
2019The Curious Case of Neural Text Degenerationcited by 2,916
2020Offline Reinforcement Learning: Tutorial, Review, and Perspectives on Open Problemscited by 1,920
2020Conservative Q-Learning for Offline Reinforcement Learningcited by 1,809
2021Decision Transformer: Reinforcement Learning via Sequence Modelingcited by 1,546
2020D4RL: Datasets for Deep Data-Driven Reinforcement Learningcited by 1,427
2021Offline Reinforcement Learning with Implicit Q-Learningcited by 1,293
2018Off-Policy Deep Reinforcement Learning without Explorationcited by 1,241

32 more

2022Planning with Diffusion for Flexible Behavior Synthesiscited by 1,061
2019Stabilizing Off-Policy Q-Learning via Bootstrapping Error Reductioncited by 840
2019Advantage-Weighted Regression: Simple and Scalable Off-Policy Reinforcement Learningcited by 782
2020AWAC: Accelerating Online Reinforcement Learning with Offline Datasetscited by 671
2019Behavior Regularized Offline Reinforcement Learningcited by 662
2021Offline Reinforcement Learning as One Big Sequence Modeling Problemcited by 644
2020MOReL : Model-Based Offline Reinforcement Learningcited by 590
2022Diffusion Policies as an Expressive Policy Class for Offline Reinforcement Learningcited by 562
2022Is Conditional Generative Modeling all you need for Decision-Making?cited by 516
2019Model-Based Reinforcement Learning for Ataricited by 502
2021Mastering Visual Continuous Control: Improved Data-Augmented Reinforcement Learningcited by 372
2023IDQL: Implicit Q-Learning as an Actor-Critic Method with Diffusion Policiescited by 325
2020Agent57: Outperforming the Atari Human Benchmarkcited by 303
2020Critic Regularized Regressioncited by 275
2018Multi-Goal Reinforcement Learning: Challenging Robotics Environments and Request for Researchcited by 260
2022Multi-Game Decision Transformerscited by 214
2022Online Decision Transformercited by 196
2021Reinforcement learning based recommender systems: A surveycited by 188
2022Offline Reinforcement Learning via High-Fidelity Generative Behavior Modelingcited by 182
2023AdaptDiffuser: Diffusion Models as Adaptive Self-evolving Plannerscited by 149
2022Prompting Decision Transformer for Few-Shot Policy Generalizationcited by 146
2020Model-Based Offline Planningcited by 129
2022Q-learning Decision Transformer: Leveraging Dynamic Programming for Conditional Sequence Modelling in Offline RLcited by 103
2020Offline Meta-Reinforcement Learning with Advantage Weightingcited by 93
2021S4RL: Surprisingly Simple Self-Supervision for Offline Reinforcement Learningcited by 85
2018Generative Adversarial User Model for Reinforcement Learning Based Recommendation Systemcited by 64
2022A Policy-Guided Imitation Approach for Offline Reinforcement Learningcited by 59
2022Learning Generalizable Dexterous Manipulation from Human Grasp Affordancecited by 51
2023Hyper-Decision Transformer for Efficient Online Policy Adaptationcited by 33
2022Model-based Trajectory Stitching for Improved Offline Reinforcement Learningcited by 15
2022BATS: Best Action Trajectory Stitchingcited by 10
2021Offline reinforcement learning with uncertainty for treatment strategies in sepsiscited by 9

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2023: 5; 2024: 23; 2025: 20; 2026: 19.

67 papers.

Sort:

By area:

2025π*0.6: a VLA That Learns From Experiencecited by 303
2025Generative Trajectory Stitching through Diffusion Compositioncited by 41
2024Q-value Regularized Transformer for Offline Reinforcement Learningcited by 29
2025A Survey on Autonomy-Induced Security Risks in Large Model-Based Agentscited by 29
2023ACT: Empowering Decision Transformer with Dynamic Programming via Advantage Conditioningcited by 25
2024Reinformer: Max-Return Sequence Modeling for Offline RLcited by 25
2026GigaBrain-0.5M*: a VLA That Learns From World Model-Based Reinforcement Learningcited by 24
2024TOP-ERL: Transformer-based Off-Policy Episodic Reinforcement Learningcited by 19
2024Meta-DT: Offline Meta-RL as Conditional Sequence Modeling with World Model Disentanglementcited by 17
2024Decision Mamba: A Multi-Grained State Space Model with Self-Evolution Regularization for Offline RLcited by 15
2023Rethinking Decision Transformer via Hierarchical Reinforcement Learningcited by 14
2024Scaling Offline Model-Based RL via Jointly-Optimized World-Action Model Pretrainingcited by 14

38 more

2023Free from Bellman Completeness: Trajectory Stitching via Model-based Return-conditioned Supervised Learningcited by 13
2023Efficient Planning with Latent Diffusioncited by 12
2026chi0: Resource-Aware Robust Manipulation via Taming Distributional Inconsistenciescited by 12
2023Uncertainty-Aware Decision Transformer for Stochastic Driving Environmentscited by 8
2024Reinforcement Learning Gradients as Vitamin for Online Finetuning Decision Transformerscited by 8
2024Adaptive Q-Aid for Conditional Supervised Learning in Offline Reinforcement Learningcited by 7
2024Is Mamba Compatible with Trajectory Optimization in Offline Reinforcement Learning?cited by 7
2024Tackling Data Corruption in Offline Reinforcement Learning via Sequence Modelingcited by 7
2024Pre-trained Language Models Improve the Few-shot Prompt Ability of Decision Transformercited by 6
2024Grounded Answers for Multi-agent Decision-making Problem through Generative World Modelcited by 6
2024Understanding the Training and Generalization of Pretrained Transformer for Sequential Decision Makingcited by 5
2025Behavioral Exploration: Learning to Explore via In-Context Adaptationcited by 5
2024Adversarially Robust Decision Transformercited by 4
2024Q-value Regularized Decision ConvFormer for Offline Reinforcement Learningcited by 4
2024Goal-Conditioned Data Augmentation for Offline Reinforcement Learningcited by 4
2024Return-Aligned Decision Transformercited by 3
2025Accelerating Multi-modal LLM Gaming Performance via Input Prediction and Mishit Correctioncited by 3
2024Physics-informed Imitative Reinforcement Learning for Real-world Drivingcited by 2
2025Adaptive Neighborhood-Constrained Q Learning for Offline Reinforcement Learningcited by 2
2026ELSA3D: Elastic Semantic Anchoring for Unified 3D Understanding and Generationcited by 2
2024NeuralSolver: Learning Algorithms For Consistent and Efficient Extrapolation Across General Taskscited by 1
2024State-Constrained Offline Reinforcement Learningcited by 1
2025DRDT3: Diffusion-Refined Decision Test-Time Training Modelcited by 1
2025Decision SpikeFormer: Spike-Driven Transformer for Decision Makingcited by 1
2025Taming OOD Actions for Offline Reinforcement Learning: An Advantage-Based Approachcited by 1
2025Beyond the Known: Decision Making with Counterfactual Reasoning Decision Transformercited by 1
2025How to Provably Improve Return Conditioned Supervised Learning?cited by 1
2025ZeroShotOpt: Towards Zero-Shot Pretrained Models for Efficient Black-Box Optimizationcited by 1
2026Decoupling Return-to-Go for Efficient Decision Transformercited by 1
2026Compositional Transduction with Latent Analogies for Offline Goal-Conditioned Reinforcement Learningcited by 1
2024Multi-State-Action Tokenisation in Decision Transformers for Multi-Discrete Action Spacescited by 0
2024Decision MetaMamba: Enhancing Selective SSM in Offline RL with Heterogeneous Sequence Mixingcited by 0
2024Are Expressive Models Truly Necessary for Offline RL?cited by 0
2025GNN-DT: Graph Neural Network Enhanced Decision Transformer for Efficient Optimization in Dynamic Environmentscited by 0
2025Diverse Transformer Decoding for Offline Reinforcement Learning Using Financial Algorithmic Approachescited by 0
2025Target Return Optimizer for Multi-Game Decision Transformercited by 0
2025Toward Explainable Offline RL: Analyzing Representations in Intrinsically Motivated Decision Transformerscited by 0
2025Decision Transformer-Based Drone Trajectory Planning with Dynamic Safety-Efficiency Trade-Offscited by 0

50 most cited of 67 All 67 (JSON)

Similar, not cited

Close in wording, no citation either way