mlsanityData to 14 Oct 2026

Preference-Based Learning for Exoskeleton Gait Optimization

arXiv 1909.12316 ↗First posted 26 Sep 2019cs.ROcited by 24

Not on the map. Why?

Abstract (arXiv)

This paper presents a personalized gait optimization framework for lower-body exoskeletons. Rather than optimizing numerical objectives such as the mechanical cost of transport, our approach directly learns from user preferences, e.g., for comfort. Building upon work in preference-based interactive learning, we present the CoSpar algorithm. CoSpar prompts the user to give pairwise preferences between trials and suggest improvements; as exoskeleton walking is a non-intuitive behavior, users can provide preferences more easily and reliably than numerical feedback. We show that CoSpar performs competitively in simulation and demonstrate a prototype implementation of CoSpar on a lower-body exoskeleton to optimize human walking trajectory features. In the experiments, CoSpar consistently found user-preferred parameters of the exoskeleton's walking gait, which suggests that it is a promising starting point for adapting and personalizing exoskeletons (or other assistive devices) to individual users.

Key facts. Cited by 24 papers in the map (data through 14 Oct 2026). First posted on arXiv 26 Sep 2019.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2020: 1; 2021: 4; 2022: 2; 2023: 3; 2024: 7; 2025: 2; 2026: 5.

24 papers.

Sort:

By area:

  1. 2024A Minimaximalist Approach to Reinforcement Learning from Human Feedbackcited by 144
  2. 2020Active Preference-Based Gaussian Process Regression for Reward Learningcited by 71
  3. 2021Learning Multimodal Rewards from Rankingscited by 41
  4. 2024Optimal Design for Reward Modeling in RLHFcited by 25
  5. 2023qEUBO: A Decision-Theoretic Acquisition Function for Preferential Bayesian Optimizationcited by 23
  6. 2021APReL: A Library for Active Preference-based Reward Learning Algorithmscited by 14
  7. 2023Active Reward Learning from Online Preferencescited by 13
  8. 2022Comparison-based Conversational Recommender System with Relative Bandit Feedbackcited by 12
  9. 2021Preference-based Learning of Reward Function Featurescited by 9
  10. 2024Batch Active Learning of Reward Functions from Human Preferencescited by 8
  11. 2024Bandits with Preference Feedback: A Stackelberg Game Perspectivecited by 7
  12. 2021Assisted Robust Reward Designcited by 5
12 more
  1. 2022Bayesian Optimization Meets Hybrid Zero Dynamics: Safe Parameter Learning for Bipedal Locomotion Controlcited by 5
  2. 2025Best Policy Learning from Trajectory Preference Feedbackcited by 5
  3. 2024Preferential Multi-Objective Bayesian Optimizationcited by 3
  4. 2024Enhancing Preference-based Linear Bandits via Human Response Timecited by 3
  5. 2025Mixed Likelihood Variational Gaussian Processescited by 2
  6. 2026MO-Playground: Massively Parallelized Multi-Objective Reinforcement Learning for Roboticscited by 2
  7. 2024DP-Dueling: Learning from Preference Feedback without Compromising User Privacycited by 1
  8. 2023Response Time Improves Choice Prediction and Function Estimation for Gaussian Process Models of Perception and Preferencescited by 0
  9. 2026A Finite Time Analysis of Thompson Sampling for Bayesian Optimization with Preferential Feedbackcited by 0
  10. 2026Active Query Synthesis for Preference Learningcited by 0
  11. 2026Adaptive KappaSharp: Condition-Number Shaping for Preferential Bayesian Optimizationcited by 0
  12. 2026Context-Continuous Preference Learning for Exoskeleton Personalizationcited by 0