mlsanityData to 14 Oct 2026

Can LLM be a Personalized Judge?

arXiv 2406.11657 ↗First posted 17 Jun 2024cs.CL cs.CYcited by 100

Not on the map. Why?

Abstract (arXiv)

Ensuring that large language models (LLMs) reflect diverse user values and preferences is crucial as their user bases expand globally. It is therefore encouraging to see the growing interest in LLM personalization within the research community. However, current works often rely on the LLM-as-a-Judge approach for evaluation without thoroughly examining its validity. In this paper, we investigate the reliability of LLM-as-a-Personalized-Judge, asking LLMs to judge user preferences based on personas. Our findings suggest that directly applying LLM-as-a-Personalized-Judge is less reliable than previously assumed, showing low and inconsistent agreement with human ground truth. The personas typically used are often overly simplistic, resulting in low predictive power. To address these issues, we introduce verbal uncertainty estimation into the LLM-as-a-Personalized-Judge pipeline, allowing the model to express low confidence on uncertain judgments. This adjustment leads to much higher agreement (above 80%) on high-certainty samples for binary tasks. Through human evaluation, we find that the LLM-as-a-Personalized-Judge achieves comparable performance to third-party humans evaluation and even surpasses human performance on high-certainty samples. Our work indicates that certainty-enhanced LLM-as-a-Personalized-Judge offers a promising direction for developing more reliable and scalable methods for evaluating LLM personalization.

Key facts. Cited by 100 papers in the map (data through 14 Oct 2026). Builds on 31 of its 48 references that are in the map. First posted on arXiv 17 Jun 2024.

Builds on

31 of 48 references.

References · 31

  1. 2023GPT-4 Technical Reportcited by 18,396
  2. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
  3. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
  4. 2019The Curious Case of Neural Text Degenerationcited by 2,916
  5. 2022Language Models (Mostly) Know What They Knowcited by 1,856
  6. 2020MiniLM: Deep Self-Attention Distillation for Task-Agnostic Compression of Pre-Trained Transformerscited by 1,463
  7. 2018Personalizing Dialogue Agents: I have a dog, do you have pets too?cited by 828
  8. 2023Just Ask for Calibration: Strategies for Eliciting Calibrated Confidence Scores from Language Models Fine-Tuned with Human Feedbackcited by 812
  9. 2023Whose Opinions Do Language Models Reflect?cited by 773
  10. 2024Prometheus 2: An Open Source Language Model Specialized in Evaluating Other Language Modelscited by 446
  11. 2023LaMP: When Large Language Models Meet Personalizationcited by 437
  12. 2023Character-LLM: A Trainable Agent for Role-Playingcited by 339
19 more
  1. 2024Replacing Judges with Juries: Evaluating LLM Generations with a Panel of Diverse Modelscited by 326
  2. 2021Towards Understanding and Mitigating Social Biases in Language Modelscited by 296
  3. 2023Personalized Soups: Personalized Large Language Model Alignment via Post-hoc Parameter Mergingcited by 280
  4. 2016A Persona-Based Neural Conversation Modelcited by 223
  5. 2024Quantifying the Persona Effect in LLM Simulationscited by 169
  6. 2024Large Language Models are Inconsistent and Biased Evaluatorscited by 153
  7. 2024Aligning with Human Judgement: The Role of Pairwise Preference in Large Language Model Evaluatorscited by 149
  8. 2024Who Validates the Validators? Aligning LLM-Assisted Evaluation of LLM Outputs with Human Preferencescited by 144
  9. 2024The PRISM Alignment Dataset: What Participatory, Representative and Individualised Human Feedback Reveals About the Subjective and Multicultural Alignment of Large Language Modelscited by 144
  10. 2024Personalized Language Modeling from Personalized Human Feedbackcited by 132
  11. 2023Generative Language Models Exhibit Social Identity Biasescited by 111
  12. 2024STaR-GATE: Teaching Language Models to Ask Clarifying Questionscited by 104
  13. 2021BoB: BERT Over BERT for Training Persona-based Dialogue Models from Limited Personalized Datacited by 75
  14. 2024Aligning LLM Agents by Learning Latent Preference from User Editscited by 69
  15. 2024What are human values, and how do we align AI to them?cited by 32
  16. 2024Can Language Models Recognize Convincing Arguments?cited by 21
  17. 2022Empathic Conversations: A Multi-level Dataset of Contextualized Conversationscited by 20
  18. 2023PRODIGy: a PROfile-based DIalogue Generation datasetcited by 16
  19. 2024The Call for Socially Aware Language Technologiescited by 13

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 9; 2025: 60; 2026: 31.

100 papers.

Sort:

By area:

  1. 2024From Generation to Judgment: Opportunities and Challenges of LLM-as-a-judgecited by 494
  2. 2024LLMs-as-Judges: A Comprehensive Survey on LLM-based Evaluation Methodscited by 465
  3. 2024Agent-as-a-Judge: Evaluate Agents with Agentscited by 238
  4. 2025Know Me, Respond to Me: Benchmarking LLMs for Dynamic User Profiling and Personalized Responses at Scalecited by 178
  5. 2025LLM Post-Training: A Deep Dive into Reasoning Large Language Modelscited by 135
  6. 2025The Alternative Annotator Test for LLM-as-a-Judge: How to Statistically Justify Replacing Human Annotators with LLMscited by 74
  7. 2025Flipping the Dialogue: Training and Evaluating User Language Modelscited by 58
  8. 2025SimBench: Benchmarking the Ability of Large Language Models to Simulate Human Behaviorscited by 52
  9. 2025LoRe: Personalizing LLMs via Low-Rank Reward Modelingcited by 38
  10. 2025Beyond Demographics: Fine-tuning Large Language Models to Predict Individuals' Subjective Text Perceptionscited by 33
  11. 2024LLM-as-a-Judge & Reward Model: What They Can and Cannot Docited by 32
  12. 2025Language Model Personalization via Reward Factorizationcited by 31
38 more
  1. 2025SynthesizeMe! Inducing Persona-Guided Prompts for Personalized Reward Models in LLMscited by 29
  2. 2025Toward Generalizable Evaluation in the LLM Era: A Survey Beyond Benchmarkscited by 28
  3. 2025A Survey of Personalization: From RAG to Agentcited by 27
  4. 2025ExPerT: Effective and Explainable Evaluation of Personalized Long-Form Text Generationcited by 26
  5. 2026Noisy but Valid: Robust Statistical Evaluation of LLMs with Imperfect Judgescited by 24
  6. 2024ComPO: Community Preferences for Language Model Personalizationcited by 19
  7. 2025BadJudge: Backdoor Vulnerabilities of LLM-as-a-Judgecited by 18
  8. 2025Instant Personalized Large Language Model Adaptation via Hypernetworkcited by 18
  9. 2025IPO: Your Language Model is Secretly a Preference Classifiercited by 17
  10. 2024PM-LLM-Benchmark: Evaluating Large Language Models on Process Mining Taskscited by 16
  11. 2025Cultural Learning-Based Culture Adaptation of Language Modelscited by 16
  12. 2025Beyond the Surface: Enhancing LLM-as-a-Judge Alignment with Human via Internal Representationscited by 15
  13. 2024GLIDER: Grading LLM Interactions and Decisions using Explainable Rankingcited by 14
  14. 2025Anthropomimetic Uncertainty: What Verbalized Uncertainty in Language Models is Missingcited by 14
  15. 2026Confidence Estimation for LLMs in Multi-turn Interactionscited by 12
  16. 2025Persona-judge: Personalized Alignment of Large Language Models via Token-level Self-judgmentcited by 11
  17. 2025MedGUIDE: Benchmarking Clinical Decision-Making in Large Language Modelscited by 10
  18. 2025When Personalization Meets Reality: A Multi-Faceted Analysis of Personalized Preference Learningcited by 9
  19. 2025Boosting Relational Deep Learning with Pretrained Tabular Modelscited by 9
  20. 2025Toward Safe and Human-Aligned Game Conversational Recommendation via Multi-Agent Decompositioncited by 9
  21. 2025Can You Trick the Grader? Adversarial Persuasion of LLM Judgescited by 9
  22. 2025TRIDENT: Benchmarking LLM Safety in Finance, Medicine, and Lawcited by 8
  23. 2025Doubly-Robust LLM-as-a-Judge: Externally Valid Estimation with Imperfect Personascited by 8
  24. 2025Multi-Agent LLM Judge: automatic personalized LLM judge design for evaluating natural language generation applicationscited by 7
  25. 2025HARBOR: Exploring Persona Dynamics in Multi-Agent Competitioncited by 6
  26. 2025Evaluating how LLM annotations represent diverse views on contentious topicscited by 6
  27. 2025Surface Fairness, Deep Bias: A Comparative Study of Bias in Language Modelscited by 6
  28. 2025Evaluating Podcast Recommendations with Profile-Aware LLM-as-a-Judgecited by 6
  29. 2026PRECISE: Reducing the Bias of LLM Evaluations Using Prediction-Powered Ranking Estimationcited by 6
  30. 2024Adaptive Self-Supervised Learning Strategies for Dynamic On-Device LLM Personalizationcited by 5
  31. 2025Quantifying the Impact of Structured Output Format on Large Language Models through Causal Inferencecited by 5
  32. 2025Confidence as a Reward: Transforming LLMs into Reward Modelscited by 5
  33. 2025CrowdLLM: Building LLM-Based Digital Populations Augmented with Generative Modelscited by 5
  34. 2026The Illusion of Intervention: Your LLM-Simulated Experiment is an Observational Studycited by 5
  35. 2025iNews: A Multimodal Dataset for Modeling Personalized Affective Responses to Newscited by 4
  36. 2026Meet Dynamic Individual Preferences: Resolving Conflicting Human Value with Paired Fine-Tuningcited by 4
  37. 2024Towards Operationalizing Right to Data Protectioncited by 3
  38. 2025Localizing Persona Representations in LLMscited by 3

50 most cited of 100 All 100 (JSON)