mlsanityData to 13 Oct 2026

CoPA: Benchmarking Personalized Question Answering with Data-Informed Cognitive Factors

arXiv 2604.14773 ↗First posted 16 Apr 2026cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

While LLMs have demonstrated remarkable potential in Question Answering (QA), evaluating personalization remains a critical bottleneck. Existing paradigms predominantly rely on lexical-level similarity or manual heuristics, often lacking sufficient data-driven validation. We address this by mining Community-Individual Preference Divergence (CIPD), where individual choices override consensus, to distill six key personalization factors as evaluative dimensions. Accordingly, we introduce CoPA, a benchmark with 1,985 user profiles for fine-grained, factor-level assessment. By quantifying the alignment between model outputs and user-specific cognitive preferences inferred from interaction patterns, CoPA provides a more comprehensive and discriminative standard for evaluating personalized QA than generic metrics. The code is available at https://github.com/bjzgcai/CoPA.

Key facts. No citing papers in the map yet (data through 13 Oct 2026). Builds on 20 of its 42 references that are in the map. First posted on arXiv 16 Apr 2026.

Builds on

20 of 42 references.

References · 20

  1. 2023GPT-4 Technical Reportcited by 18,278
  2. 2025Qwen3 Technical Reportcited by 8,510
  3. 2025Qwen3 Embedding: Advancing Text Embedding and Reranking Through Foundation Modelscited by 1,222
  4. 2023LaMP: When Large Language Models Meet Personalizationcited by 430
  5. 2024Can LLM be a Personalized Judge?cited by 99
  6. 2024LongLaMP: A Benchmark for Personalized Long-form Text Generationcited by 93
  7. 2024Democratizing Large Language Models via Personalized Parameter-Efficient Fine-tuningcited by 89
  8. 2024HYDRA: Model Factorization Framework for Black-Box LLM Personalizationcited by 59
  9. 2021Complex Knowledge Base Question Answering: A Surveycited by 52
  10. 2024CoRAL: Collaborative Retrieval-Augmented Large Language Models Improve Long-tail Recommendationcited by 44
  11. 2023Knowledge-Augmented Large Language Models for Personalized Contextual Query Suggestioncited by 43
  12. 2023Learning to Rewrite Prompts for Personalized Text Generationcited by 40
8 more
  1. 2025Personalized Text Generation with Contrastive Activation Steeringcited by 32
  2. 2025LaMP-QA: A Benchmark for Personalized Long-form Question Answeringcited by 30
  3. 2024Harnessing Large Language Models for Knowledge Graph Question Answering via Adaptive Multi-Aspect Retrieval-Augmentationcited by 24
  4. 2025Retrieval Augmented Generation with Collaborative Filtering for Personalized Text Generationcited by 23
  5. 2025One Size doesn't Fit All: A Personalized Conversational Tutoring Agent for Mathematics Instructioncited by 17
  6. 2024MPCODER: Multi-user Personalized Code Generator with Explicit and Implicit Style Representation Learningcited by 12
  7. 2025UQABench: Evaluating User Embedding for Prompting LLMs in Personalized Question Answeringcited by 10
  8. 2025DEEPER Insight into Your User: Directed Persona Refinement for Dynamic Persona Modelingcited by 9

Built on by

Not cited yet.