One Prompt Does Not Fit All: Self-Meta-Evolve for Personalized Information Extraction
Not on the map. Why?
Abstract (arXiv)
Large language models (LLMs) are increasingly deployed for enterprise information extraction (IE), where the same document must be reorganized differently for each user. Existing prompt optimization methods, however, rely on a single prompt optimized against a global objective, which is misaligned with the inherent user heterogeneity of real workplaces. We formulate enterprise IE as per-user prompt adaptation under interaction feedback and propose Self-Meta-Evolve, a hierarchical framework that maintains a dedicated prompt for each user and continuously refines it through a dual-loop process: an inner loop that edits structured prompts based on persona-conditioned feedback, and an outer loop that evolves the meta-prompt itself by distilling successful editing patterns. To enable scalable training and evaluation, we release a persona-driven IE benchmark of 292 simulated enterprise users, paired with a reproducible persona-generation pipeline grounded in O*NET occupational taxonomies. On this benchmark, Self-Meta-Evolve achieves a 74.58% success rate, outperforming the strongest prompt-optimization baseline by 13.56 absolute points, and reaches 52.54% within only two iterations. A double-blind human study with twenty real professionals further confirms that prompts adapted by our framework win against static baselines in 71% of pairwise comparisons.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 38 of its 57 references that are in the map. First posted on arXiv 18 Sep 2026.
Builds on
38 of 57 references.
References · 38
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,393
- 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,500
- 2022Self-Instruct: Aligning Language Models with Self-Generated Instructionscited by 2,674
- 2023G-Eval: NLG Evaluation using GPT-4 with Better Human Alignmentcited by 2,205
- 2022Large Language Models Are Human-Level Prompt Engineerscited by 1,020
- 2018Personalizing Dialogue Agents: I have a dog, do you have pets too?cited by 820
- 2023Automatic Prompt Optimization with "Gradient Descent" and Beam Searchcited by 628
- 2023Promptbreeder: Self-Referential Self-Improvement Via Prompt Evolutioncited by 521
- 2023LaMP: When Large Language Models Meet Personalizationcited by 425
- 2022RLPrompt: Optimizing Discrete Text Prompts with Reinforcement Learningcited by 361
- 2024ReEvo: Large Language Models as Hyper-Heuristics with Reflective Evolutioncited by 266
- 2024Two Tales of Persona in LLMs: A Survey of Role-Playing and Personalizationcited by 203
26 more
- 2023Large Language Models for Generative Information Extraction: A Surveycited by 183
- 2023Large Language Models as Evolutionary Optimizerscited by 122
- 2019Personalizing Dialogue Agents via Meta-Learningcited by 83
- 2025Personalized Generation In Large Model Era: A Surveycited by 45
- 2025SimulatorArena: Are User Simulators Reliable Proxies for Multi-Turn Evaluation of AI Assistants?cited by 45
- 2025PersonaLens: A Benchmark for Personalization Evaluation in Conversational AI Assistantscited by 44
- 2025A Survey on Personalized Alignment -- The Missing Piece for Large Language Models in Real-World Applicationscited by 40
- 2025PersonaX: A Recommendation Agent Oriented User Modeling Framework for Long Behavior Sequencecited by 33
- 2024Few-shot Personalization of LLMs with Mis-aligned Responsescited by 30
- 2025LaMP-QA: A Benchmark for Personalized Long-form Question Answeringcited by 30
- 2025ExPerT: Effective and Explainable Evaluation of Personalized Long-Form Text Generationcited by 26
- 2023Guideline Learning for In-context Information Extractioncited by 24
- 2025Benchmarking Deep Search over Heterogeneous Enterprise Datacited by 23
- 2025Towards a Design Guideline for RPA Evaluation: A Survey of Large Language Model-Based Role-Playing Agentscited by 22
- 2024Personalized Text Generation with Fine-Grained Linguistic Controlcited by 20
- 2026Self-Evolving Recommendation System: End-To-End Autonomous Model Optimization With LLM Agentscited by 19
- 2025System Prompt Optimization with Meta-Learningcited by 18
- 2025Exploring the Potential of LLMs as Personalized Assistants: Dataset, Evaluation, and Analysiscited by 16
- 2024LLM Roleplay: Simulating Human-Chatbot Interactioncited by 15
- 2025MAPRO: Recasting Multi-Agent Prompt Optimization as Maximum a Posteriori Inferencecited by 15
- 2025Can LLMs Help You at Work? A Sandbox for Evaluating LLM Agents in Enterprise Environmentscited by 15
- 2024CRAFT Your Dataset: Task-Specific Synthetic Dataset Generation Through Corpus Retrieval and Augmentationcited by 14
- 2025Persistent Personas? Role-Playing, Instruction Following, and Safety in Extended Interactionscited by 12
- 2024Learning to Solve Geometry Problems via Simulating Human Dual-Reasoning Processcited by 10
- 2025GuideX: Guided Synthetic Data Generation for Zero-Shot Information Extractioncited by 3
- 2025Re-FRAME the Meeting Summarization SCOPE: Fact-Based Summarization and Personalization via Questionscited by 3
Built on by
Not cited yet.