ORPP: Self-Optimizing Role-playing Prompts to Enhance Language Model Capabilities
Not on the map. Why?
Abstract (arXiv)
High-quality prompts are crucial for eliciting outstanding performance from large language models (LLMs) on complex tasks. Existing research has explored model-driven strategies for prompt optimization. However, these methods often suffer from high computational overhead or require strong optimization capabilities from the model itself, which limits their broad applicability.To address these challenges, we propose ORPP (Optimized Role-Playing Prompt),a framework that enhances model performance by optimizing and generating role-playing prompts. The core idea of ORPP is to confine the prompt search space to role-playing scenarios, thereby fully activating the model's intrinsic capabilities through carefully crafted, high-quality role-playing prompts. Specifically, ORPP first performs iterative optimization on a small subset of training samples to generate high-quality role-playing prompts. Then, leveraging the model's few-shot learning capability, it transfers the optimization experience to efficiently generate suitable prompts for the remaining samples.Our experimental results show that ORPP not only matches but in most cases surpasses existing mainstream prompt optimization methods in terms of performance. Notably, ORPP demonstrates superior "plug-and-play" capability. In most cases, it can be integrated with various other prompt methods and further enhance their effectiveness.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 29 of its 40 references that are in the map. First posted on arXiv 3 Jun 2025.
Builds on
29 of 40 references.
References · 29
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
- 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,767
- 2021Measuring Mathematical Problem Solving With the MATH Datasetcited by 5,203
- 2023GPQA: A Graduate-Level Google-Proof Q&A Benchmarkcited by 2,748
- 2024MMLU-Pro: A More Robust and Challenging Multi-Task Language Understanding Benchmarkcited by 1,758
- 2020What Disease does this Patient Have? A Large-scale Open Domain Question Answering Dataset from Medical Examscited by 1,324
- 2023Automatic Prompt Optimization with "Gradient Descent" and Beam Searchcited by 628
- 2023Promptbreeder: Self-Referential Self-Improvement Via Prompt Evolutioncited by 521
- 2024Interpretable Preferences via Multi-Objective Reward Modeling and Mixture-of-Expertscited by 369
- 2023Character-LLM: A Trainable Agent for Role-Playingcited by 335
- 2023PromptAgent: Strategic Planning with Language Models Enables Expert-level Prompt Optimizationcited by 226
- 2023Better Zero-Shot Reasoning with Role-Play Promptingcited by 220
17 more
- 2024From Persona to Personalization: A Survey on Role-Playing Language Agentscited by 206
- 2023Take a Step Back: Evoking Reasoning via Abstraction in Large Language Modelscited by 157
- 2023Rephrase and Respond: Let Large Language Models Ask Better Questions for Themselvescited by 123
- 2024Large Language Models are Superpositions of All Characters: Attaining Arbitrary Role-play via Self-Alignmentcited by 104
- 2024LLM Discussion: Enhancing the Creativity of Large Language Models via Discussion Framework and Role-Playcited by 65
- 2024MMLU-CF: A Contamination-free Multi-task Language Understanding Benchmarkcited by 41
- 2024Beyond Demographics: Aligning Role-playing LLM-based Agents Using Human Belief Networkscited by 39
- 2025Self-Supervised Prompt Optimizationcited by 37
- 2024Multi-Task Inference: Can Large Language Models Follow Multiple Instructions at Once?cited by 28
- 2024Pron vs Prompt: Can Large Language Models already Challenge a World-Class Fiction Author at Creative Text Writing?cited by 26
- 2024HoLLMwood: Unleashing the Creativity of Large Language Models in Screenwriting via Role Playingcited by 22
- 2024Dynamic Planning for LLM-based Graphical User Interface Automationcited by 19
- 2024StraGo: Harnessing Strategic Guidance for Prompt Optimizationcited by 16
- 2025The Prompt Alchemist: Automated LLM-Tailored Prompt Optimization for Test Case Generationcited by 16
- 2024Self-Prompt Tuning: Enable Autonomous Role-Playing in LLMscited by 12
- 2025The Rise of Darkness: Safety-Utility Trade-Offs in Role-Playing Dialogue Agentscited by 7
- 2024MORPHEUS: Modeling Role from Personalized Dialogue History by Exploring and Utilizing Latent Spacecited by 4
Built on by
Citing papers per year: 2026: 3.
3 papers.
- 2026Memory-Driven Role-Playing: Evaluation and Enhancement of Persona Knowledge Utilization in LLMscited by 5
- 2026ODUTQA-MDC: A Task for Open-Domain Underspecified Tabular QA with Multi-turn Dialogue-based Clarificationcited by 1
- 2026In-Situ Behavioral Evaluation for LLM Fairness, Not Standardized-Test Scorescited by 0
- 2026In-Situ Behavioral Evaluation for LLM Fairness, Not Standardized-Test Scores21 Apr 2026
- 2026ODUTQA-MDC: A Task for Open-Domain Underspecified Tabular QA with Multi-turn Dialogue-based Clarification11 Apr 2026
- 2026Memory-Driven Role-Playing: Evaluation and Enhancement of Persona Knowledge Utilization in LLMs14 Mar 2026