mlsanityData to 14 Oct 2026

Same Question, Different Answer? Measuring and Mitigating Prompt Privilege for Equitable AI Access

arXiv 2608.08942 ↗First posted 9 Aug 2026cs.CLcited by 3

Not on the map. Why?

Abstract (arXiv)

Large language models (LLMs) are increasingly integrated into healthcare, education, public services, and everyday decision making. They should provide comparable assistance regardless of a user's literacy, communication style, or prompt-engineering expertise. However, existing research on prompt robustness primarily focuses on adversarial attacks, prompt injection, and prompt optimization, while overlooking whether semantically equivalent requests receive different responses simply because they are phrased differently. We refer to this accessibility challenge as "Prompt Privilege": users with greater prompting expertise systematically obtain better model performance despite expressing the same underlying intent. To address this problem, we present a unified framework for measuring and mitigating accessibility disparities in LLM interactions. We introduce Prompt Equity Score (PES), a quantitative metric for evaluating performance consistency across user populations, and Prompt Equity Transformer (PET), an LLM-based agent that automatically transforms user requests into semantically equivalent, accessibility-oriented prompts while preserving their intent. PET shifts prompt optimization from the user to the AI system, functioning as an intelligent accessibility layer between users and foundation models. Experiments on the MedQA benchmark demonstrate measurable prompt privilege, with statistically significant performance disparities between low-literacy and expert-prompting cohorts. Applying PET eliminates these disparities while preserving semantic fidelity, demonstrating that accessibility-oriented prompt normalization can improve equitable AI access. By introducing prompt privilege as a new dimension of AI accessibility and PET as a practical solution, this work advances system-centered accessibility and provides a foundation for more fair, trustworthy, and inclusive AI systems.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 22 of its 33 references that are in the map. First posted on arXiv 9 Aug 2026.

Builds on

22 of 33 references.

References · 22

  1. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
  2. 2020What Disease does this Patient Have? A Large-scale Open Domain Question Answering Dataset from Medical Examscited by 1,356
  3. 2022Large Language Models Are Human-Level Prompt Engineerscited by 1,045
  4. 2023FastPillars: A Deployment-friendly Pillar-based 3D Detectorcited by 39
  5. 2025DRP: Distilled Reasoning Pruning with Skill-aware Step Decomposition for Efficient Large Reasoning Modelscited by 30
  6. 2024LiDAR-PTQ: Post-Training Quantization for Point Cloud 3D Object Detectioncited by 29
  7. 2026PACED: Distillation and On-Policy Self-Distillation at the Frontier of Student Competencecited by 28
  8. 2026SCRIBE: Structured Mid-Level Supervision for Tool-Using Language Modelscited by 21
  9. 2026When Safe Skills Collide: Measuring Compositional Risk in Agent Skill Ecosystemscited by 17
  10. 2026Does RAG Know When Retrieval Is Wrong? Diagnosing Context Compliance under Knowledge Conflictcited by 15
  11. 2026Relevant Is Not Warranted: Evidence-Force Calibration for Cited RAGcited by 14
  12. 2026Beyond GRPO and On-Policy Distillation: An Empirical Sparse-to-Dense Reward Principle for Language-Model Post-Trainingcited by 11
10 more
  1. 2024Improving Representation of High-frequency Components for Medical Visual Foundation Modelscited by 9
  2. 2025Bridging the Fairness Gap: Enhancing Pre-trained Models with LLM-Generated Sentencescited by 5
  3. 2026Non-Intrusive Graph-Based Bot Detection for E-Commerce Using Inductive Graph Neural Networkscited by 4
  4. 2026Interpretable Factor Decomposition for Decision Intelligence in Large-Scale Financial Markets: Evidence from China's A-Share Marketcited by 4
  5. 2026Cross-Model LLM Code Review: Should you use Claude to review Codex or vice versa?cited by 4
  6. 2025NetSenseML: Network-Adaptive Compression for Efficient Distributed Machine Learningcited by 2
  7. 2025Beyond Chat: a Framework for LLMs as Human-Centered Support Systemscited by 2
  8. 2025Adhera: A Human-Centered Health Informatics Solution for Reducing Informal Caregiver Burden through Improved Medication Adherencecited by 2
  9. 2026RegDivergence-101: An LLM Benchmark for Cross-Jurisdiction Regulatory Contradiction Detection in Life Sciencescited by 2
  10. 2026Risk-based test framework for LLM features in regulated softwarecited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 3.

3 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025A Closer Look at System Prompt Robustness
  2. 2025Rethinking Prompt-based Debiasing in Large Language Models
  3. 2023PromptRobust: Towards Evaluating the Robustness of Large Language Models on Adversarial Prompts
  4. 2024Are Large Language Models Really Bias-Free? Jailbreak Prompts for Assessing Adversarial Robustness to Bias Elicitation
  5. 2024Stress-Testing Capability Elicitation With Password-Locked Models
  6. 2026Are LLMs Vulnerable to Preference-Undermining Attacks (PUA)? A Factorial Analysis Methodology for Diagnosing the Trade-off between Preference Alignment and Real-World Validity
  7. 2024Why Are My Prompts Leaked? Unraveling Prompt Extraction Threats in Customized Large Language Models
  8. 2026Evaluating 5W3H Structured Prompting for Intent Alignment in Human-AI Interaction