mlsanityData to 7 Oct 2026

One Prompt Does Not Fit All: Self-Meta-Evolve for Personalized Information Extraction

arXiv 2609.21626 ↗First posted 18 Sep 2026cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Large language models (LLMs) are increasingly deployed for enterprise information extraction (IE), where the same document must be reorganized differently for each user. Existing prompt optimization methods, however, rely on a single prompt optimized against a global objective, which is misaligned with the inherent user heterogeneity of real workplaces. We formulate enterprise IE as per-user prompt adaptation under interaction feedback and propose Self-Meta-Evolve, a hierarchical framework that maintains a dedicated prompt for each user and continuously refines it through a dual-loop process: an inner loop that edits structured prompts based on persona-conditioned feedback, and an outer loop that evolves the meta-prompt itself by distilling successful editing patterns. To enable scalable training and evaluation, we release a persona-driven IE benchmark of 292 simulated enterprise users, paired with a reproducible persona-generation pipeline grounded in O*NET occupational taxonomies. On this benchmark, Self-Meta-Evolve achieves a 74.58% success rate, outperforming the strongest prompt-optimization baseline by 13.56 absolute points, and reaches 52.54% within only two iterations. A double-blind human study with twenty real professionals further confirms that prompts adapted by our framework win against static baselines in 71% of pairwise comparisons.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 38 of its 57 references that are in the map. First posted on arXiv 18 Sep 2026.

Builds on

38 of 57 references.

References · 38

  1. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,393
  2. 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,500
  3. 2022Self-Instruct: Aligning Language Models with Self-Generated Instructionscited by 2,674
  4. 2023G-Eval: NLG Evaluation using GPT-4 with Better Human Alignmentcited by 2,205
  5. 2022Large Language Models Are Human-Level Prompt Engineerscited by 1,020
  6. 2018Personalizing Dialogue Agents: I have a dog, do you have pets too?cited by 820
  7. 2023Automatic Prompt Optimization with "Gradient Descent" and Beam Searchcited by 628
  8. 2023Promptbreeder: Self-Referential Self-Improvement Via Prompt Evolutioncited by 521
  9. 2023LaMP: When Large Language Models Meet Personalizationcited by 425
  10. 2022RLPrompt: Optimizing Discrete Text Prompts with Reinforcement Learningcited by 361
  11. 2024ReEvo: Large Language Models as Hyper-Heuristics with Reflective Evolutioncited by 266
  12. 2024Two Tales of Persona in LLMs: A Survey of Role-Playing and Personalizationcited by 203
26 more
  1. 2023Large Language Models for Generative Information Extraction: A Surveycited by 183
  2. 2023Large Language Models as Evolutionary Optimizerscited by 122
  3. 2019Personalizing Dialogue Agents via Meta-Learningcited by 83
  4. 2025Personalized Generation In Large Model Era: A Surveycited by 45
  5. 2025SimulatorArena: Are User Simulators Reliable Proxies for Multi-Turn Evaluation of AI Assistants?cited by 45
  6. 2025PersonaLens: A Benchmark for Personalization Evaluation in Conversational AI Assistantscited by 44
  7. 2025A Survey on Personalized Alignment -- The Missing Piece for Large Language Models in Real-World Applicationscited by 40
  8. 2025PersonaX: A Recommendation Agent Oriented User Modeling Framework for Long Behavior Sequencecited by 33
  9. 2024Few-shot Personalization of LLMs with Mis-aligned Responsescited by 30
  10. 2025LaMP-QA: A Benchmark for Personalized Long-form Question Answeringcited by 30
  11. 2025ExPerT: Effective and Explainable Evaluation of Personalized Long-Form Text Generationcited by 26
  12. 2023Guideline Learning for In-context Information Extractioncited by 24
  13. 2025Benchmarking Deep Search over Heterogeneous Enterprise Datacited by 23
  14. 2025Towards a Design Guideline for RPA Evaluation: A Survey of Large Language Model-Based Role-Playing Agentscited by 22
  15. 2024Personalized Text Generation with Fine-Grained Linguistic Controlcited by 20
  16. 2026Self-Evolving Recommendation System: End-To-End Autonomous Model Optimization With LLM Agentscited by 19
  17. 2025System Prompt Optimization with Meta-Learningcited by 18
  18. 2025Exploring the Potential of LLMs as Personalized Assistants: Dataset, Evaluation, and Analysiscited by 16
  19. 2024LLM Roleplay: Simulating Human-Chatbot Interactioncited by 15
  20. 2025MAPRO: Recasting Multi-Agent Prompt Optimization as Maximum a Posteriori Inferencecited by 15
  21. 2025Can LLMs Help You at Work? A Sandbox for Evaluating LLM Agents in Enterprise Environmentscited by 15
  22. 2024CRAFT Your Dataset: Task-Specific Synthetic Dataset Generation Through Corpus Retrieval and Augmentationcited by 14
  23. 2025Persistent Personas? Role-Playing, Instruction Following, and Safety in Extended Interactionscited by 12
  24. 2024Learning to Solve Geometry Problems via Simulating Human Dual-Reasoning Processcited by 10
  25. 2025GuideX: Guided Synthetic Data Generation for Zero-Shot Information Extractioncited by 3
  26. 2025Re-FRAME the Meeting Summarization SCOPE: Fact-Based Summarization and Personalization via Questionscited by 3

Built on by

Not cited yet.