Preference-Based Learning for Exoskeleton Gait Optimization
Not on the map. Why?
Abstract (arXiv)
This paper presents a personalized gait optimization framework for lower-body exoskeletons. Rather than optimizing numerical objectives such as the mechanical cost of transport, our approach directly learns from user preferences, e.g., for comfort. Building upon work in preference-based interactive learning, we present the CoSpar algorithm. CoSpar prompts the user to give pairwise preferences between trials and suggest improvements; as exoskeleton walking is a non-intuitive behavior, users can provide preferences more easily and reliably than numerical feedback. We show that CoSpar performs competitively in simulation and demonstrate a prototype implementation of CoSpar on a lower-body exoskeleton to optimize human walking trajectory features. In the experiments, CoSpar consistently found user-preferred parameters of the exoskeleton's walking gait, which suggests that it is a promising starting point for adapting and personalizing exoskeletons (or other assistive devices) to individual users.
Key facts. Cited by 24 papers in the map (data through 14 Oct 2026). First posted on arXiv 26 Sep 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2020: 1; 2021: 4; 2022: 2; 2023: 3; 2024: 7; 2025: 2; 2026: 5.
24 papers.
Sort:
By area:
- 2024A Minimaximalist Approach to Reinforcement Learning from Human Feedbackcited by 144
- 2020Active Preference-Based Gaussian Process Regression for Reward Learningcited by 71
- 2021Learning Multimodal Rewards from Rankingscited by 41
- 2024Optimal Design for Reward Modeling in RLHFcited by 25
- 2023qEUBO: A Decision-Theoretic Acquisition Function for Preferential Bayesian Optimizationcited by 23
- 2021APReL: A Library for Active Preference-based Reward Learning Algorithmscited by 14
- 2023Active Reward Learning from Online Preferencescited by 13
- 2022Comparison-based Conversational Recommender System with Relative Bandit Feedbackcited by 12
- 2021Preference-based Learning of Reward Function Featurescited by 9
- 2024Batch Active Learning of Reward Functions from Human Preferencescited by 8
- 2024Bandits with Preference Feedback: A Stackelberg Game Perspectivecited by 7
- 2021Assisted Robust Reward Designcited by 5
12 more
- 2022Bayesian Optimization Meets Hybrid Zero Dynamics: Safe Parameter Learning for Bipedal Locomotion Controlcited by 5
- 2025Best Policy Learning from Trajectory Preference Feedbackcited by 5
- 2024Preferential Multi-Objective Bayesian Optimizationcited by 3
- 2024Enhancing Preference-based Linear Bandits via Human Response Timecited by 3
- 2025Mixed Likelihood Variational Gaussian Processescited by 2
- 2026MO-Playground: Massively Parallelized Multi-Objective Reinforcement Learning for Roboticscited by 2
- 2024DP-Dueling: Learning from Preference Feedback without Compromising User Privacycited by 1
- 2023Response Time Improves Choice Prediction and Function Estimation for Gaussian Process Models of Perception and Preferencescited by 0
- 2026A Finite Time Analysis of Thompson Sampling for Bayesian Optimization with Preferential Feedbackcited by 0
- 2026Active Query Synthesis for Preference Learningcited by 0
- 2026Adaptive KappaSharp: Condition-Number Shaping for Preferential Bayesian Optimizationcited by 0
- 2026Context-Continuous Preference Learning for Exoskeleton Personalizationcited by 0
- 2026Context-Continuous Preference Learning for Exoskeleton Personalization23 Sep 2026
- 2026Adaptive KappaSharp: Condition-Number Shaping for Preferential Bayesian Optimization8 Aug 2026
- 2026Active Query Synthesis for Preference Learning25 May 2026
- 2026A Finite Time Analysis of Thompson Sampling for Bayesian Optimization with Preferential Feedback27 Apr 2026
- 2026MO-Playground: Massively Parallelized Multi-Objective Reinforcement Learning for Robotics10 Mar 2026
- 2025Mixed Likelihood Variational Gaussian Processes6 Mar 2025
- 2025Best Policy Learning from Trajectory Preference Feedback31 Jan 2025
- 2024Optimal Design for Reward Modeling in RLHF22 Oct 2024
- 2024Enhancing Preference-based Linear Bandits via Human Response Time9 Sep 2024
- 2024Bandits with Preference Feedback: A Stackelberg Game Perspective24 Jun 2024
- 2024Preferential Multi-Objective Bayesian Optimization20 Jun 2024
- 2024DP-Dueling: Learning from Preference Feedback without Compromising User Privacy22 Mar 2024
12 more
- 2024Batch Active Learning of Reward Functions from Human Preferences24 Feb 2024
- 2024A Minimaximalist Approach to Reinforcement Learning from Human Feedback8 Jan 2024
- 2023Response Time Improves Choice Prediction and Function Estimation for Gaussian Process Models of Perception and Preferences9 Jun 2023
- 2023qEUBO: A Decision-Theoretic Acquisition Function for Preferential Bayesian Optimization28 Mar 2023
- 2023Active Reward Learning from Online Preferences27 Feb 2023
- 2022Comparison-based Conversational Recommender System with Relative Bandit Feedback21 Aug 2022
- 2022Bayesian Optimization Meets Hybrid Zero Dynamics: Safe Parameter Learning for Bipedal Locomotion Control4 Mar 2022
- 2021Assisted Robust Reward Design18 Nov 2021
- 2021Learning Multimodal Rewards from Rankings27 Sep 2021
- 2021APReL: A Library for Active Preference-based Reward Learning Algorithms16 Aug 2021
- 2021Preference-based Learning of Reward Function Features3 Mar 2021
- 2020Active Preference-Based Gaussian Process Regression for Reward Learning6 May 2020
- 2024A Minimaximalist Approach to Reinforcement Learning from Human Feedbackcited by 144
- 2020Active Preference-Based Gaussian Process Regression for Reward Learningcited by 71
- 2021Learning Multimodal Rewards from Rankingscited by 41
- 2024Optimal Design for Reward Modeling in RLHFcited by 25
- 2023Active Reward Learning from Online Preferencescited by 13
- 2021Preference-based Learning of Reward Function Featurescited by 9
- 2024Bandits with Preference Feedback: A Stackelberg Game Perspectivecited by 7
- 2025Best Policy Learning from Trajectory Preference Feedbackcited by 5
- 2025Best Policy Learning from Trajectory Preference Feedback31 Jan 2025
- 2024Optimal Design for Reward Modeling in RLHF22 Oct 2024
- 2024Bandits with Preference Feedback: A Stackelberg Game Perspective24 Jun 2024
- 2024A Minimaximalist Approach to Reinforcement Learning from Human Feedback8 Jan 2024
- 2023Active Reward Learning from Online Preferences27 Feb 2023
- 2021Learning Multimodal Rewards from Rankings27 Sep 2021
- 2021Preference-based Learning of Reward Function Features3 Mar 2021
- 2020Active Preference-Based Gaussian Process Regression for Reward Learning6 May 2020
- 2023qEUBO: A Decision-Theoretic Acquisition Function for Preferential Bayesian Optimizationcited by 23
- 2021APReL: A Library for Active Preference-based Reward Learning Algorithmscited by 14
- 2022Comparison-based Conversational Recommender System with Relative Bandit Feedbackcited by 12
- 2024Batch Active Learning of Reward Functions from Human Preferencescited by 8
- 2021Assisted Robust Reward Designcited by 5
- 2022Bayesian Optimization Meets Hybrid Zero Dynamics: Safe Parameter Learning for Bipedal Locomotion Controlcited by 5
- 2024Preferential Multi-Objective Bayesian Optimizationcited by 3
- 2024Enhancing Preference-based Linear Bandits via Human Response Timecited by 3
- 2025Mixed Likelihood Variational Gaussian Processescited by 2
- 2024DP-Dueling: Learning from Preference Feedback without Compromising User Privacycited by 1
- 2023Response Time Improves Choice Prediction and Function Estimation for Gaussian Process Models of Perception and Preferencescited by 0
- 2026A Finite Time Analysis of Thompson Sampling for Bayesian Optimization with Preferential Feedbackcited by 0
12 most cited of 15 All 15 (JSON)
- 2026Context-Continuous Preference Learning for Exoskeleton Personalization23 Sep 2026
- 2026Adaptive KappaSharp: Condition-Number Shaping for Preferential Bayesian Optimization8 Aug 2026
- 2026Active Query Synthesis for Preference Learning25 May 2026
- 2026A Finite Time Analysis of Thompson Sampling for Bayesian Optimization with Preferential Feedback27 Apr 2026
- 2025Mixed Likelihood Variational Gaussian Processes6 Mar 2025
- 2024Enhancing Preference-based Linear Bandits via Human Response Time9 Sep 2024
- 2024Preferential Multi-Objective Bayesian Optimization20 Jun 2024
- 2024DP-Dueling: Learning from Preference Feedback without Compromising User Privacy22 Mar 2024
- 2024Batch Active Learning of Reward Functions from Human Preferences24 Feb 2024
- 2023Response Time Improves Choice Prediction and Function Estimation for Gaussian Process Models of Perception and Preferences9 Jun 2023
- 2023qEUBO: A Decision-Theoretic Acquisition Function for Preferential Bayesian Optimization28 Mar 2023
- 2022Comparison-based Conversational Recommender System with Relative Bandit Feedback21 Aug 2022
12 newest of 15 All 15 (JSON)