Social Attention for Autonomous Decision-Making in Dense Traffic
Not on the map. Why?
Cited by 20 in End-to-end autonomous driving, but placed by its own abstract, which didn’t fit.
Abstract (arXiv)
We study the design of learning architectures for behavioural planning in a dense traffic setting. Such architectures should deal with a varying number of nearby vehicles, be invariant to the ordering chosen to describe them, while staying accurate and compact. We observe that the two most popular representations in the literature do not fit these criteria, and perform badly on an complex negotiation task. We propose an attention-based architecture that satisfies all these properties and explicitly accounts for the existing interactions between the traffic participants. We show that this architecture leads to significant performance gains, and is able to capture interactions patterns that can be visualised and qualitatively interpreted. Videos and code are available at https://eleurent.github.io/social-attention/.
Key facts. Cited by 39 papers in the map (data through 14 Oct 2026). First posted on arXiv 27 Nov 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 8; 2022: 9; 2023: 3; 2024: 8; 2025: 10; 2026: 1.
39 papers.
Sort:
By area:
- 2023Argoverse 2: Next Generation Datasets for Self-Driving Perception and Forecastingcited by 707
- 2025ReCogDrive: A Reinforced Cognitive Framework for End-to-End Autonomous Drivingcited by 198
- 2022Intention Aware Robot Crowd Navigation with Attention-Based Interaction Graphcited by 53
- 2025CarPlanner: Consistent Auto-regressive Trajectory Planning for Large-scale Reinforcement Learning in Autonomous Drivingcited by 34
- 2022Deep Interactive Motion Prediction and Planning: Playing Games with Motion Prediction Modelscited by 27
- 2022TrajGen: Generating Realistic and Diverse Trajectories with Reactive and Feasible Agent Behaviors for Autonomous Drivingcited by 23
- 2021A Safe Hierarchical Planning Framework for Complex Driving Scenarios based on Reinforcement Learningcited by 18
- 2022Control-Aware Prediction Objectives for Autonomous Drivingcited by 18
- 2021DQ-GAT: Towards Safe and Efficient Autonomous Driving with Deep Q-Learning and Graph Attention Networkscited by 13
- 2023Towards Socially Responsive Autonomous Vehicles: A Reinforcement Learning Framework with Driving Priors and Coordination Awarenesscited by 12
- 2025Dream to Drive with Predictive Individual World Modelcited by 11
- 2021Addressing Action Oscillations through Learning Policy Inertiacited by 9
27 more
- 2024HEIGHT: Heterogeneous Interaction Graph Transformer for Robot Navigation in Crowded and Constrained Environmentscited by 9
- 2022Multi-task Safe Reinforcement Learning for Navigating Intersections in Dense Trafficcited by 8
- 2022Game-Theoretic Planning for Autonomous Driving among Risk-Aware Human Driverscited by 7
- 2023Parameterized Decision-making with Multi-modal Perception for Autonomous Drivingcited by 7
- 2021Learning interaction rules from multi-animal trajectories via augmented behavioral modelscited by 5
- 2021Vision Transformer for Learning Driving Policies in Complex Multi-Agent Environmentscited by 5
- 2025Trends in Motion Prediction Toward Deployable and Generalizable Autonomy: A Revisit and Perspectivescited by 5
- 2021A Reinforcement Learning Benchmark for Autonomous Driving in Intersection Scenarioscited by 4
- 2022A Survey on Explainable Reinforcement Learning: Concepts, Algorithms, Challengescited by 3
- 2022Don't Watch Me: A Spatio-Temporal Trojan Attack on Deep-Reinforcement-Learning-Augment Autonomous Drivingcited by 3
- 2025Embodied Navigation with Auxiliary Task of Action Description Predictioncited by 3
- 2024XRL-Bench: A Benchmark for Evaluating and Comparing Explainable Reinforcement Learning Techniquescited by 2
- 2025A Survey of Reinforcement Learning-Based Motion Planning for Autonomous Driving: Lessons Learned from a Driving Task Perspectivecited by 2
- 2021Benchmarking Lane-changing Decision-making for Deep Reinforcement Learningcited by 1
- 2024Agent-Agnostic Centralized Training for Decentralized Multi-Agent Cooperative Drivingcited by 1
- 2021Spatially and Seamlessly Hierarchical Reinforcement Learning for State Space and Policy space in Autonomous Drivingcited by 0
- 2022Self-Awareness Safety of Deep Reinforcement Learning in Road Traffic Junction Drivingcited by 0
- 2024Scalable Multi-modal Model Predictive Control via Duality-based Interaction Predictionscited by 0
- 2024Training Adversarial yet Safe Agent to Characterize Safety Performance of Highly Automated Vehiclescited by 0
- 2024Demystifying the Physics of Deep Reinforcement Learning-Based Autonomous Vehicle Decision-Makingcited by 0
- 2024Structured Graph Network for Constrained Robot Crowd Navigation with Low Fidelity Simulationcited by 0
- 2024GITSR: Graph Interaction Transformer-based Scene Representation for Multi Vehicle Collaborative Decision-makingcited by 0
- 2025Multi-Agent Inverse Q-Learning from Demonstrationscited by 0
- 2025Sky-Drive: A Distributed Multi-Agent Simulation Platform for Human-AI Collaborative and Socially-Aware Future Transportationcited by 0
- 2025Goal-conditioned Hierarchical Reinforcement Learning for Sample-efficient and Safe Autonomous Driving at Intersectionscited by 0
- 2025An Uncertainty-Weighted Decision Transformer for Navigation in Dense, Complex Driving Scenarioscited by 0
- 2026HOLO-MPPI: Multi-Scenario Motion Planning via Hierarchical Policy Optimizationcited by 0
- 2026HOLO-MPPI: Multi-Scenario Motion Planning via Hierarchical Policy Optimization15 Jun 2026
- 2025Embodied Navigation with Auxiliary Task of Action Description Prediction21 Oct 2025
- 2025An Uncertainty-Weighted Decision Transformer for Navigation in Dense, Complex Driving Scenarios16 Sep 2025
- 2025Goal-conditioned Hierarchical Reinforcement Learning for Sample-efficient and Safe Autonomous Driving at Intersections19 Jun 2025
- 2025ReCogDrive: A Reinforced Cognitive Framework for End-to-End Autonomous Driving9 Jun 2025
- 2025Trends in Motion Prediction Toward Deployable and Generalizable Autonomy: A Revisit and Perspectives14 May 2025
- 2025Sky-Drive: A Distributed Multi-Agent Simulation Platform for Human-AI Collaborative and Socially-Aware Future Transportation25 Apr 2025
- 2025A Survey of Reinforcement Learning-Based Motion Planning for Autonomous Driving: Lessons Learned from a Driving Task Perspective31 Mar 2025
- 2025Multi-Agent Inverse Q-Learning from Demonstrations6 Mar 2025
- 2025CarPlanner: Consistent Auto-regressive Trajectory Planning for Large-scale Reinforcement Learning in Autonomous Driving27 Feb 2025
- 2025Dream to Drive with Predictive Individual World Model28 Jan 2025
- 2024HEIGHT: Heterogeneous Interaction Graph Transformer for Robot Navigation in Crowded and Constrained Environments19 Nov 2024
27 more
- 2024GITSR: Graph Interaction Transformer-based Scene Representation for Multi Vehicle Collaborative Decision-making3 Nov 2024
- 2024Structured Graph Network for Constrained Robot Crowd Navigation with Low Fidelity Simulation27 May 2024
- 2024Agent-Agnostic Centralized Training for Decentralized Multi-Agent Cooperative Driving18 Mar 2024
- 2024Demystifying the Physics of Deep Reinforcement Learning-Based Autonomous Vehicle Decision-Making18 Mar 2024
- 2024XRL-Bench: A Benchmark for Evaluating and Comparing Explainable Reinforcement Learning Techniques20 Feb 2024
- 2024Training Adversarial yet Safe Agent to Characterize Safety Performance of Highly Automated Vehicles2 Feb 2024
- 2024Scalable Multi-modal Model Predictive Control via Duality-based Interaction Predictions2 Feb 2024
- 2023Parameterized Decision-making with Multi-modal Perception for Autonomous Driving19 Dec 2023
- 2023Towards Socially Responsive Autonomous Vehicles: A Reinforcement Learning Framework with Driving Priors and Coordination Awareness18 Sep 2023
- 2023Argoverse 2: Next Generation Datasets for Self-Driving Perception and Forecasting2 Jan 2023
- 2022Don't Watch Me: A Spatio-Temporal Trojan Attack on Deep-Reinforcement-Learning-Augment Autonomous Driving22 Nov 2022
- 2022A Survey on Explainable Reinforcement Learning: Concepts, Algorithms, Challenges12 Nov 2022
- 2022Game-Theoretic Planning for Autonomous Driving among Risk-Aware Human Drivers1 May 2022
- 2022Control-Aware Prediction Objectives for Autonomous Driving28 Apr 2022
- 2022Deep Interactive Motion Prediction and Planning: Playing Games with Motion Prediction Models5 Apr 2022
- 2022TrajGen: Generating Realistic and Diverse Trajectories with Reactive and Feasible Agent Behaviors for Autonomous Driving31 Mar 2022
- 2022Intention Aware Robot Crowd Navigation with Attention-Based Interaction Graph3 Mar 2022
- 2022Multi-task Safe Reinforcement Learning for Navigating Intersections in Dense Traffic19 Feb 2022
- 2022Self-Awareness Safety of Deep Reinforcement Learning in Road Traffic Junction Driving20 Jan 2022
- 2021Spatially and Seamlessly Hierarchical Reinforcement Learning for State Space and Policy space in Autonomous Driving10 Nov 2021
- 2021A Reinforcement Learning Benchmark for Autonomous Driving in Intersection Scenarios22 Sep 2021
- 2021Benchmarking Lane-changing Decision-making for Deep Reinforcement Learning22 Sep 2021
- 2021Vision Transformer for Learning Driving Policies in Complex Multi-Agent Environments14 Sep 2021
- 2021DQ-GAT: Towards Safe and Efficient Autonomous Driving with Deep Q-Learning and Graph Attention Networks11 Aug 2021
- 2021Learning interaction rules from multi-animal trajectories via augmented behavioral models12 Jul 2021
- 2021Addressing Action Oscillations through Learning Policy Inertia3 Mar 2021
- 2021A Safe Hierarchical Planning Framework for Complex Driving Scenarios based on Reinforcement Learning17 Jan 2021
- 2025CarPlanner: Consistent Auto-regressive Trajectory Planning for Large-scale Reinforcement Learning in Autonomous Drivingcited by 34
- 2022TrajGen: Generating Realistic and Diverse Trajectories with Reactive and Feasible Agent Behaviors for Autonomous Drivingcited by 23
- 2021A Safe Hierarchical Planning Framework for Complex Driving Scenarios based on Reinforcement Learningcited by 18
- 2022Control-Aware Prediction Objectives for Autonomous Drivingcited by 18
- 2021DQ-GAT: Towards Safe and Efficient Autonomous Driving with Deep Q-Learning and Graph Attention Networkscited by 13
- 2023Towards Socially Responsive Autonomous Vehicles: A Reinforcement Learning Framework with Driving Priors and Coordination Awarenesscited by 12
- 2022Game-Theoretic Planning for Autonomous Driving among Risk-Aware Human Driverscited by 7
- 2023Parameterized Decision-making with Multi-modal Perception for Autonomous Drivingcited by 7
- 2021Vision Transformer for Learning Driving Policies in Complex Multi-Agent Environmentscited by 5
- 2021A Reinforcement Learning Benchmark for Autonomous Driving in Intersection Scenarioscited by 4
- 2022Don't Watch Me: A Spatio-Temporal Trojan Attack on Deep-Reinforcement-Learning-Augment Autonomous Drivingcited by 3
- 2025A Survey of Reinforcement Learning-Based Motion Planning for Autonomous Driving: Lessons Learned from a Driving Task Perspectivecited by 2
12 most cited of 19 All 19 (JSON)
- 2025Goal-conditioned Hierarchical Reinforcement Learning for Sample-efficient and Safe Autonomous Driving at Intersections19 Jun 2025
- 2025Sky-Drive: A Distributed Multi-Agent Simulation Platform for Human-AI Collaborative and Socially-Aware Future Transportation25 Apr 2025
- 2025A Survey of Reinforcement Learning-Based Motion Planning for Autonomous Driving: Lessons Learned from a Driving Task Perspective31 Mar 2025
- 2025CarPlanner: Consistent Auto-regressive Trajectory Planning for Large-scale Reinforcement Learning in Autonomous Driving27 Feb 2025
- 2024Agent-Agnostic Centralized Training for Decentralized Multi-Agent Cooperative Driving18 Mar 2024
- 2024Demystifying the Physics of Deep Reinforcement Learning-Based Autonomous Vehicle Decision-Making18 Mar 2024
- 2024Training Adversarial yet Safe Agent to Characterize Safety Performance of Highly Automated Vehicles2 Feb 2024
- 2023Parameterized Decision-making with Multi-modal Perception for Autonomous Driving19 Dec 2023
- 2023Towards Socially Responsive Autonomous Vehicles: A Reinforcement Learning Framework with Driving Priors and Coordination Awareness18 Sep 2023
- 2022Don't Watch Me: A Spatio-Temporal Trojan Attack on Deep-Reinforcement-Learning-Augment Autonomous Driving22 Nov 2022
- 2022Game-Theoretic Planning for Autonomous Driving among Risk-Aware Human Drivers1 May 2022
- 2022Control-Aware Prediction Objectives for Autonomous Driving28 Apr 2022
12 newest of 19 All 19 (JSON)
- 2025Embodied Navigation with Auxiliary Task of Action Description Predictioncited by 3
- 2024XRL-Bench: A Benchmark for Evaluating and Comparing Explainable Reinforcement Learning Techniquescited by 2
- 2024Structured Graph Network for Constrained Robot Crowd Navigation with Low Fidelity Simulationcited by 0
- 2025Embodied Navigation with Auxiliary Task of Action Description Prediction21 Oct 2025
- 2024Structured Graph Network for Constrained Robot Crowd Navigation with Low Fidelity Simulation27 May 2024
- 2024XRL-Bench: A Benchmark for Evaluating and Comparing Explainable Reinforcement Learning Techniques20 Feb 2024
- 2025Multi-Agent Inverse Q-Learning from Demonstrationscited by 0
- 2025Multi-Agent Inverse Q-Learning from Demonstrations6 Mar 2025
- 2023Argoverse 2: Next Generation Datasets for Self-Driving Perception and Forecastingcited by 707
- 2022Intention Aware Robot Crowd Navigation with Attention-Based Interaction Graphcited by 53
- 2022Deep Interactive Motion Prediction and Planning: Playing Games with Motion Prediction Modelscited by 27
- 2021Addressing Action Oscillations through Learning Policy Inertiacited by 9
- 2024HEIGHT: Heterogeneous Interaction Graph Transformer for Robot Navigation in Crowded and Constrained Environmentscited by 9
- 2022Multi-task Safe Reinforcement Learning for Navigating Intersections in Dense Trafficcited by 8
- 2021Learning interaction rules from multi-animal trajectories via augmented behavioral modelscited by 5
- 2022A Survey on Explainable Reinforcement Learning: Concepts, Algorithms, Challengescited by 3
- 2021Benchmarking Lane-changing Decision-making for Deep Reinforcement Learningcited by 1
- 2024Scalable Multi-modal Model Predictive Control via Duality-based Interaction Predictionscited by 0
- 2024GITSR: Graph Interaction Transformer-based Scene Representation for Multi Vehicle Collaborative Decision-makingcited by 0
- 2025An Uncertainty-Weighted Decision Transformer for Navigation in Dense, Complex Driving Scenarioscited by 0
12 most cited of 13 All 13 (JSON)
- 2026HOLO-MPPI: Multi-Scenario Motion Planning via Hierarchical Policy Optimization15 Jun 2026
- 2025An Uncertainty-Weighted Decision Transformer for Navigation in Dense, Complex Driving Scenarios16 Sep 2025
- 2024HEIGHT: Heterogeneous Interaction Graph Transformer for Robot Navigation in Crowded and Constrained Environments19 Nov 2024
- 2024GITSR: Graph Interaction Transformer-based Scene Representation for Multi Vehicle Collaborative Decision-making3 Nov 2024
- 2024Scalable Multi-modal Model Predictive Control via Duality-based Interaction Predictions2 Feb 2024
- 2023Argoverse 2: Next Generation Datasets for Self-Driving Perception and Forecasting2 Jan 2023
- 2022A Survey on Explainable Reinforcement Learning: Concepts, Algorithms, Challenges12 Nov 2022
- 2022Deep Interactive Motion Prediction and Planning: Playing Games with Motion Prediction Models5 Apr 2022
- 2022Intention Aware Robot Crowd Navigation with Attention-Based Interaction Graph3 Mar 2022
- 2022Multi-task Safe Reinforcement Learning for Navigating Intersections in Dense Traffic19 Feb 2022
- 2021Benchmarking Lane-changing Decision-making for Deep Reinforcement Learning22 Sep 2021
- 2021Learning interaction rules from multi-animal trajectories via augmented behavioral models12 Jul 2021
12 newest of 13 All 13 (JSON)