SHARPIE: A Modular Framework for Reinforcement Learning and Human-AI Interaction Experiments
On the map: Deep reinforcement learning methods → RL training of language and agent models
Abstract (arXiv)
Reinforcement learning (RL) offers a general approach for modeling and training AI agents, including human-AI interaction scenarios. In this paper, we propose SHARPIE (Shared Human-AI Reinforcement Learning Platform for Interactive Experiments) to address the need for a generic framework to support experiments with RL agents and humans. Its modular design consists of a versatile wrapper for RL environments and algorithm libraries, a participant-facing web interface, logging utilities, deployment on popular cloud and participant recruitment platforms. It empowers researchers to study a wide variety of research questions related to the interaction between humans and RL agents, including those related to interactive reward specification and learning, learning from human feedback, action delegation, preference elicitation, user-modeling, and human-AI teaming. The platform is based on a generic interface for human-RL interactions that aims to standardize the field of study on RL in human contexts.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in RL training of language and agent models, one of 15 directions in Deep reinforcement learning methods. First posted on arXiv 31 Jan 2025.
Builds on
0 of 0 references.
No references here yet.
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2024Mapping out the Space of Human Feedback for Reinforcement Learning: A Conceptual Framework
- 2026Themis: An explainable AI-enabled framework for Reinforcement Learning with Human Feedback
- 2023A Survey of Reinforcement Learning from Human Feedback
- 2022Improving Multimodal Interactive Agents with Reinforcement Learning from Human Feedback
- 2024AI Alignment through Reinforcement Learning from Human Feedback? Contradictions and Limitations
- 2023RLHF-Blender: A Configurable Interactive Interface for Learning from Diverse Human Feedback
- 2025NiceWebRL: a Python library for human subject experiments with reinforcement learning environments
- 2025Interactive Groupwise Comparison for Reinforcement Learning from Human Feedback