ROIAL: Region of Interest Active Learning for Characterizing Exoskeleton Gait Preference Landscapes
Not on the map. Why?
Abstract (arXiv)
Characterizing what types of exoskeleton gaits are comfortable for users, and understanding the science of walking more generally, require recovering a user's utility landscape. Learning these landscapes is challenging, as walking trajectories are defined by numerous gait parameters, data collection from human trials is expensive, and user safety and comfort must be ensured. This work proposes the Region of Interest Active Learning (ROIAL) framework, which actively learns each user's underlying utility function over a region of interest that ensures safety and comfort. ROIAL learns from ordinal and preference feedback, which are more reliable feedback mechanisms than absolute numerical scores. The algorithm's performance is evaluated both in simulation and experimentally for three non-disabled subjects walking inside of a lower-body exoskeleton. ROIAL learns Bayesian posteriors that predict each exoskeleton user's utility landscape across four exoskeleton gait parameters. The algorithm discovers both commonalities and discrepancies across users' gait preferences and identifies the gait parameters that most influenced user feedback. These results demonstrate the feasibility of recovering gait utility landscapes from limited human trials.
Key facts. Cited by 19 papers in the map (data through 7 Oct 2026). First posted on arXiv 9 Nov 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 3; 2022: 2; 2023: 5; 2024: 4; 2025: 1; 2026: 4.
19 papers.
Sort:
By area:
- 2021Learning Multimodal Rewards from Rankingscited by 41
- 2021Learning Reward Functions from Scale Feedbackcited by 24
- 2024Principled Preferential Bayesian Optimizationcited by 16
- 2022Policy-Based Bayesian Experimental Design for Non-Differentiable Implicit Modelscited by 15
- 2021APReL: A Library for Active Preference-based Reward Learning Algorithmscited by 14
- 2023SIRL: Similarity-based Implicit Representation Learningcited by 13
- 2023Active Reward Learning from Online Preferencescited by 12
- 2023Towards Modeling and Influencing the Dynamics of Human Learningcited by 11
- 2024Batch Active Learning of Reward Functions from Human Preferencescited by 8
- 2025PABBO: Preferential Amortized Black-Box Optimizationcited by 7
- 2023Preference Elicitation with Soft Attributes in Interactive Recommendationcited by 3
- 2024A Generalized Acquisition Function for Preference-based Reward Learningcited by 1
7 more
- 2024DP-Dueling: Learning from Preference Feedback without Compromising User Privacycited by 1
- 2026Knowledge Gradient for Preference Learningcited by 1
- 2022An Approach to Investigate Public Opinion, Views, and Perspectives Towards Exoskeleton Technologycited by 0
- 2023Identifying Copeland Winners in Dueling Bandits with Indifferencescited by 0
- 2026Human-in-the-Loop Pareto Optimization: Trade-off Characterization for Assist-as-Needed Training and Performance Evaluationcited by 0
- 2026Active Query Synthesis for Preference Learningcited by 0
- 2026Context-Continuous Preference Learning for Exoskeleton Personalizationcited by 0
- 2026Context-Continuous Preference Learning for Exoskeleton Personalization23 Sep 2026
- 2026Active Query Synthesis for Preference Learning25 May 2026
- 2026Human-in-the-Loop Pareto Optimization: Trade-off Characterization for Assist-as-Needed Training and Performance Evaluation24 Mar 2026
- 2026Knowledge Gradient for Preference Learning29 Jan 2026
- 2025PABBO: Preferential Amortized Black-Box Optimization2 Mar 2025
- 2024DP-Dueling: Learning from Preference Feedback without Compromising User Privacy22 Mar 2024
- 2024A Generalized Acquisition Function for Preference-based Reward Learning9 Mar 2024
- 2024Batch Active Learning of Reward Functions from Human Preferences24 Feb 2024
- 2024Principled Preferential Bayesian Optimization8 Feb 2024
- 2023Preference Elicitation with Soft Attributes in Interactive Recommendation22 Oct 2023
- 2023Identifying Copeland Winners in Dueling Bandits with Indifferences1 Oct 2023
- 2023Active Reward Learning from Online Preferences27 Feb 2023
7 more
- 2023Towards Modeling and Influencing the Dynamics of Human Learning2 Jan 2023
- 2023SIRL: Similarity-based Implicit Representation Learning2 Jan 2023
- 2022An Approach to Investigate Public Opinion, Views, and Perspectives Towards Exoskeleton Technology27 Apr 2022
- 2022Policy-Based Bayesian Experimental Design for Non-Differentiable Implicit Models8 Mar 2022
- 2021Learning Reward Functions from Scale Feedback1 Oct 2021
- 2021Learning Multimodal Rewards from Rankings27 Sep 2021
- 2021APReL: A Library for Active Preference-based Reward Learning Algorithms16 Aug 2021
- 2021Learning Multimodal Rewards from Rankingscited by 41
- 2023Active Reward Learning from Online Preferencescited by 12
- 2023Active Reward Learning from Online Preferences27 Feb 2023
- 2021Learning Multimodal Rewards from Rankings27 Sep 2021
- 2021Learning Reward Functions from Scale Feedbackcited by 24
- 2024Principled Preferential Bayesian Optimizationcited by 16
- 2022Policy-Based Bayesian Experimental Design for Non-Differentiable Implicit Modelscited by 15
- 2021APReL: A Library for Active Preference-based Reward Learning Algorithmscited by 14
- 2023SIRL: Similarity-based Implicit Representation Learningcited by 13
- 2023Towards Modeling and Influencing the Dynamics of Human Learningcited by 11
- 2024Batch Active Learning of Reward Functions from Human Preferencescited by 8
- 2025PABBO: Preferential Amortized Black-Box Optimizationcited by 7
- 2023Preference Elicitation with Soft Attributes in Interactive Recommendationcited by 3
- 2024A Generalized Acquisition Function for Preference-based Reward Learningcited by 1
- 2024DP-Dueling: Learning from Preference Feedback without Compromising User Privacycited by 1
- 2026Knowledge Gradient for Preference Learningcited by 1
12 most cited of 17 All 17 (JSON)
- 2026Context-Continuous Preference Learning for Exoskeleton Personalization23 Sep 2026
- 2026Active Query Synthesis for Preference Learning25 May 2026
- 2026Human-in-the-Loop Pareto Optimization: Trade-off Characterization for Assist-as-Needed Training and Performance Evaluation24 Mar 2026
- 2026Knowledge Gradient for Preference Learning29 Jan 2026
- 2025PABBO: Preferential Amortized Black-Box Optimization2 Mar 2025
- 2024DP-Dueling: Learning from Preference Feedback without Compromising User Privacy22 Mar 2024
- 2024A Generalized Acquisition Function for Preference-based Reward Learning9 Mar 2024
- 2024Batch Active Learning of Reward Functions from Human Preferences24 Feb 2024
- 2024Principled Preferential Bayesian Optimization8 Feb 2024
- 2023Preference Elicitation with Soft Attributes in Interactive Recommendation22 Oct 2023
- 2023Identifying Copeland Winners in Dueling Bandits with Indifferences1 Oct 2023
- 2023Towards Modeling and Influencing the Dynamics of Human Learning2 Jan 2023
12 newest of 17 All 17 (JSON)