GRAIL: Goal Recognition Alignment through Imitation Learning
On the map: Offline RL and imitation learning from data → Imitation learning methods
Abstract (arXiv)
Understanding an agent's goals from its behavior is fundamental to aligning AI systems with human intentions. Existing goal recognition methods typically rely on an optimal goal-oriented policy representation, which may differ from the actor's true behavior and hinder the accurate recognition of their goal. To address this gap, this paper introduces Goal Recognition Alignment through Imitation Learning (GRAIL), which leverages imitation learning and inverse reinforcement learning to learn one goal-directed policy for each candidate goal directly from (potentially suboptimal) demonstration trajectories. By scoring an observed partial trajectory with each learned goal-directed policy in a single forward pass, GRAIL retains the one-shot inference capability of classical goal recognition while leveraging learned policies that can capture suboptimal and systematically biased behavior. Across the evaluated domains, GRAIL increases the F1-score by more than 0.5 under systematically biased optimal behavior, achieves gains of approximately 0.1-0.3 under suboptimal behavior, and yields improvements of up to 0.4 under noisy optimal trajectories, while remaining competitive in fully optimal settings. This work contributes toward scalable and robust models for interpreting agent goals in uncertain environments.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Placed in Imitation learning methods, one of 13 directions in Offline RL and imitation learning from data. Builds on 20 of its 56 references that are in the map. First posted on arXiv 15 Feb 2026.
Builds on
20 of 56 references.
References · 20
- 2017Proximal Policy Optimization Algorithmscited by 14,441
- 2016Generative Adversarial Imitation Learningcited by 1,576
- 2018A Survey of Inverse Reinforcement Learning: Challenges, Methods and Progresscited by 294
- 2013The Complexity of Decentralized Control of Markov Decision Processescited by 225
- 2021Consequences of Misaligned AIcited by 79
- 2020Online Bayesian Goal Inference for Boundedly-Rational Planning Agentscited by 67
- 2021panda-gym: Open-source goal-conditioned environments for robotic learningcited by 56
- 2022Humans are not Boltzmann Distributions: Challenges and Opportunities for Modelling Human Feedback and Interaction in Reinforcement Learningcited by 22
- 2019Landmark-Based Approaches for Goal Recognition as Planningcited by 21
- 2019Active Goal Recognitioncited by 16
- 2019Multimodal Uncertainty Reduction for Intention Recognition in Human-Robot Interactioncited by 11
- 2022Goal Recognition as Reinforcement Learningcited by 9
8 more
- 2022Goal Recognition as a Deep Learning Task: the GRNet Approachcited by 9
- 2017Norm Conflict Resolution in Stochastic Domainscited by 7
- 2019An LP-Based Approach for Goal Recognition as Planningcited by 6
- 2024ODGR: Online Dynamic Goal Recognitioncited by 5
- 2024Goal Recognition using Actor-Critic Optimizationcited by 5
- 2025Artificial Intelligent Disobedience: Rethinking the Agency of Our Artificial Teammatescited by 4
- 2017SLIM: Semi-Lazy Inference Mechanism for Plan Recognitioncited by 3
- 2020A unified energy optimality criterion predicts human navigation paths and speedscited by 2
Built on by
Citing papers per year: 2026: 3.
3 papers.
Similar, not cited
Close in wording, no citation either way
- 2024Rethinking Inverse Reinforcement Learning: from Data Alignment to Task Alignment
- 2025Consistent Zero-Shot Imitation with Contrastive Goal Inference
- 2019Learning from Trajectories via Subgoal Discovery
- 2019Learning to Reach Goals via Iterated Supervised Learning
- 2023GO-DICE: Goal-Conditioned Option-Aware Offline Imitation Learning via Stationary Distribution Correction Estimation
- 2026Learning from Demonstrations via Capability-Aware Goal Sampling
- 2020Learning to Generalize Across Long-Horizon Tasks from Human Demonstrations
- 2023Backward Learning for Goal-Conditioned Policies