Hierarchical Neuro-Symbolic Decision Transformer
On the map: Offline RL and imitation learning from data → Decision transformers and sequence modeling
Abstract (arXiv)
We present a hierarchical neuro-symbolic control framework that tightly couples a classical symbolic planner with a transformer-based policy to address long-horizon decision-making under uncertainty. At the high level, the planner assembles an interpretable sequence of operators that guarantees logical coherence with task constraints, while at the low level each operator is rendered as a sub-goal token that conditions a decision transformer to generate fine-grained actions directly from raw observations. This bidirectional interface preserves the combinatorial efficiency and explainability of symbolic reasoning without sacrificing the adaptability of deep sequence models, and it permits a principled analysis that tracks how approximation errors from both planning and execution accumulate across the hierarchy. Empirical studies in stochastic grid-world domains demonstrate that the proposed method consistently surpasses purely symbolic, purely neural and existing hierarchical baselines in both success and efficiency, highlighting its robustness for sequential tasks.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Decision transformers and sequence modeling, one of 13 directions in Offline RL and imitation learning from data. Builds on 14 of its 32 references that are in the map. First posted on arXiv 10 Mar 2025.
Builds on
14 of 32 references.
Closest ancestors · 2
Same direction, newest first
- 2022You Can't Count on Luck: Why Decision Transformers and RvS Fail in Stochastic Environments31 May
- 2021Decision Transformer: Reinforcement Learning via Sequence Modeling2 Jun
Other references · 12
- 2017Attention Is All You Needcited by 60,361
- 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,718
- 2020MOReL : Model-Based Offline Reinforcement Learningcited by 590
- 2017A Semantic Loss Function for Deep Learning with Symbolic Knowledgecited by 270
- 2021Symbolic Knowledge Distillation: from General Language Models to Commonsense Modelscited by 270
- 2020Neurosymbolic AI: The 3rd Wavecited by 255
- 2018PDDLStream: Integrating Symbolic Planners and Blackbox Samplers via Optimistic Adaptive Planningcited by 150
- 2019Planning with Goal-Conditioned Policiescited by 149
- 2018SDRL: Interpretable and Data-efficient Deep Reinforcement Learning Leveraging Symbolic Planningcited by 78
- 2023Scallop: A Language for Neurosymbolic Programmingcited by 63
- 2025Multi-Scale Conformal Prediction: A Theoretical Framework with Coverage Guaranteescited by 3
- 2020Vision-Based Autonomous Driving: A Model Learning Approachcited by 2
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2025A Neuro-Symbolic Framework for Reasoning under Perceptual Uncertainty: Bridging Continuous Perception and Discrete Symbolic Planning
- 2025LOOP: A Plug-and-Play Neuro-Symbolic Framework for Enhancing Planning in Autonomous Systems
- 2024Fast and Accurate Task Planning using Neuro-Symbolic Language Models and Multi-level Goal Decomposition
- 2025Toward Deployable Multi-Robot Collaboration via a Symbolically-Guided Decision Transformer
- 2024VisualPredicator: Learning Abstract World Models with Neuro-Symbolic Predicates for Robot Planning
- 2025Bridging Symbolic Control and Neural Reasoning in LLM Agents -- The Structured Cognitive Loop
- 2026Neuro-Symbolic Drive: Rule-Grounded Faithful Reasoning for Driving VLAs
- 2023Neuro-Symbolic Reasoning Shortcuts: Mitigation Strategies and their Limitations