# Decision transformers and sequence modeling

Area: [Offline RL and imitation learning from data](https://mlsanity.com/offlinerl/index.md). HTML: https://mlsanity.com/offlinerl/decision-transformers-and-sequence-modeling/

## Key facts

- Decision transformers and sequence modeling: 205 papers on arXiv since 2019 (data through 14 Oct 2026).
- 108 of its 205 mapped papers (53%) cite “Decision Transformer: Reinforcement Learning via Sequence Modeling” (2021, arXiv 2106.01345).
- 64 of its 205 mapped papers (31%) cite “Offline Reinforcement Learning as One Big Sequence Modeling Problem” (2021, arXiv 2106.02039).
- 6 new papers 17 Sep–14 Oct.

## Most cited here

- [Decision Transformer: Reinforcement Learning via Sequence Modeling](https://mlsanity.com/paper/2106.01345/) (2021), cited by 108 papers here
- [Offline Reinforcement Learning as One Big Sequence Modeling Problem](https://mlsanity.com/paper/2106.02039/) (2021), cited by 64 papers here
- [Online Decision Transformer](https://mlsanity.com/paper/2202.05607/) (2022), cited by 34 papers here
- [Q-learning Decision Transformer: Leveraging Dynamic Programming for Conditional Sequence Modelling in Offline RL](https://mlsanity.com/paper/2209.03993/) (2022), cited by 32 papers here
- [Multi-Game Decision Transformers](https://mlsanity.com/paper/2205.15241/) (2022), cited by 31 papers here
- [Generalized Decision Transformer for Offline Hindsight Information Matching](https://mlsanity.com/paper/2111.10364/) (2021), cited by 30 papers here
- [Prompting Decision Transformer for Few-Shot Policy Generalization](https://mlsanity.com/paper/2206.13499/) (2022), cited by 28 papers here
- [Offline Meta-Reinforcement Learning with Advantage Weighting](https://mlsanity.com/paper/2008.06043/) (2020), cited by 21 papers here
- [You Can't Count on Luck: Why Decision Transformers and RvS Fail in Stochastic Environments](https://mlsanity.com/paper/2205.15967/) (2022), cited by 15 papers here
- [Decision ConvFormer: Local Filtering in MetaFormer is Sufficient for Decision Making](https://mlsanity.com/paper/2310.03022/) (2023), cited by 15 papers here

## New (17 Sep–14 Oct)

- [Pessimistic Latent Task-aware Optimization for Robust Offline Meta-Reinforcement Learning](https://mlsanity.com/paper/2610.15428/) (2026-10-11)
- [Decision Titan: Test-Time Training for Long-Term Memory in Offline Reinforcement Learning](https://mlsanity.com/paper/2610.01513/) (2026-10-01)
- [Q-learning Penalized Transformer for Safe Offline Reinforcement Learning](https://mlsanity.com/paper/2609.34426/) (2026-09-29)
- [Trust Guided Decision Transformer](https://mlsanity.com/paper/2609.31586/) (2026-09-25)
- [Offline Reinforcement Learning for Distribution-Grid Protection](https://mlsanity.com/paper/2609.24703/) (2026-09-21)
- [Learning Control Policies from Heterogeneous Multi-Horizon Time Series in Battery Energy Management Systems](https://mlsanity.com/paper/2609.22546/) (2026-09-18)