mlsanityData to 7 Oct 2026

Aligning Robot Navigation Behaviors with Human Intentions and Preferences

arXiv 2409.18982 ↗First posted 16 Sep 2024cs.RO cs.AI cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Recent advances in the field of machine learning have led to new ways for mobile robots to acquire advanced navigational capabilities. However, these learning-based methods raise the possibility that learned navigation behaviors may not align with the intentions and preferences of people, a problem known as value misalignment. To mitigate this risk, this dissertation aims to answer the question: "How can we use machine learning methods to align the navigational behaviors of autonomous mobile robots with human intentions and preferences?" First, this dissertation addresses this question by introducing a new approach to learning navigation behaviors by imitating human-provided demonstrations of the intended navigation task. This contribution allows mobile robots to acquire autonomous visual navigation capabilities through imitation, using a novel objective function that encourages the agent to align with the human's navigation objectives and penalizes misalignment. Second, this dissertation introduces two algorithms to enhance terrain-aware off-road navigation for mobile robots by learning visual terrain awareness in a self-supervised manner. This contribution enables mobile robots to respect a human operator's preferences for navigating different terrains in urban outdoor environments, while extrapolating these preferences to visually novel terrains by leveraging multi-modal representations. Finally, in the context of robot navigation in human-occupied environments, this dissertation introduces a dataset and an algorithm for robot navigation in a socially compliant manner in both indoor and outdoor environments. In summary, the contributions in this dissertation take significant steps toward addressing the value alignment problem in autonomous navigation, enabling mobile robots to navigate autonomously with objectives that align with human intentions and preferences.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 30 of its 48 references that are in the map. First posted on arXiv 16 Sep 2024.

Builds on

30 of 48 references.

References · 30

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2017Mask R-CNNcited by 7,259
  3. 2015You Only Look Once: Unified, Real-Time Object Detectioncited by 4,829
  4. 2016Concrete Problems in AI Safetycited by 1,582
  5. 2016Generative Adversarial Imitation Learningcited by 1,576
  6. 2017SuperPoint: Self-Supervised Interest Point Detection and Descriptioncited by 1,313
  7. 2016End to End Learning for Self-Driving Carscited by 1,000
  8. 2017AirSim: High-Fidelity Visual and Physical Simulation for Autonomous Vehiclescited by 517
  9. 2018Reward learning from human preferences and demonstrations in Ataricited by 314
  10. 2022Learning robust perceptive locomotion for quadrupedal robots in the wildcited by 299
  11. 2018Learning to Drive in a Daycited by 266
  12. 2018Generative Adversarial Imitation from Observationcited by 183
18 more
  1. 2016A Connection between Generative Adversarial Networks, Inverse Reinforcement Learning, and Energy-Based Modelscited by 167
  2. 2016Value Iteration Networkscited by 158
  3. 2022Socially Compliant Navigation Dataset (SCAND): A Large-Scale Dataset of Demonstrations for Social Navigationcited by 122
  4. 2020RELLIS-3D Dataset: Data, Benchmarks and Analysiscited by 118
  5. 2018The Surprising Creativity of Digital Evolution: A Collection of Anecdotes from the Evolutionary Computation and Artificial Life Research Communitiescited by 78
  6. 2017Self-supervised Deep Reinforcement Learning with Generalized Computation Graphs for Robot Navigationcited by 74
  7. 2021GANav: Efficient Terrain Segmentation for Robot Navigation in Unstructured Outdoor Environmentscited by 51
  8. 2017Socially Compliant Navigation through Raw Depth Inputs with Generative Adversarial Imitation Learningcited by 50
  9. 2019Self-Supervised Visual Terrain Classification from Unsupervised Acoustic Feature Learningcited by 37
  10. 2021VOILA: Visual-Observation-Only Imitation Learning for Autonomous Navigationcited by 27
  11. 2021Differentiable Spatial Planning using Transformerscited by 25
  12. 2022VI-IKD: High-Speed Accurate Off-Road Navigation using Learned Visual-Inertial Inverse Kinodynamicscited by 19
  13. 2020APPLD: Adaptive Planner Parameter Learning from Demonstrationcited by 17
  14. 2021Visual Representation Learning for Preference-Aware Path Planningcited by 17
  15. 2022RCA: Ride Comfort-Aware Visual Navigation via Self-Supervised Learningcited by 10
  16. 2023STERLING: Self-Supervised Terrain Representation Learning from Unconstrained Robot Experiencecited by 10
  17. 2023Wait, That Feels Familiar: Learning to Extrapolate Human Preferences for Preference Aligned Path Planningcited by 6
  18. 2019Autonomous Visual Assistance for Robot Operations Using a Tethered UAVcited by 3

Built on by

Not cited yet.