{"total":138,"rows":[{"id":"2211.02570","title":"The 'Problem' of Human Label Variation: On Ground Truth in Data, Modeling and Evaluation","created":"2022-11-04","cited_by_count":139,"area":null},{"id":"2102.12060","title":"Teach Me to Explain: A Review of Datasets for Explainable Natural Language Processing","created":"2021-02-24","cited_by_count":126,"area":null},{"id":"2304.14399","title":"We're Afraid Language Models Aren't Modeling Ambiguity","created":"2023-04-27","cited_by_count":126,"area":null},{"id":"2410.13788","title":"Modeling Future Conversation Turns to Teach LLMs to Ask Clarifying Questions","created":"2024-10-17","cited_by_count":76,"area":null},{"id":"2210.16133","title":"Stop Measuring Calibration When Humans Disagree","created":"2022-10-28","cited_by_count":71,"area":null},{"id":"2308.05342","title":"Metacognitive Prompting Improves Understanding in Large Language Models","created":"2023-08-10","cited_by_count":58,"area":null},{"id":"2510.17516","title":"SimBench: Benchmarking the Ability of Large Language Models to Simulate Human Behaviors","created":"2025-10-20","cited_by_count":52,"area":null},{"id":"2403.01931","title":"VariErr NLI: Separating Annotation Error from Human Label Variation","created":"2024-03-04","cited_by_count":42,"area":null},{"id":"2305.14663","title":"You Are What You Annotate: Towards Better Models through Annotator Representations","created":"2023-05-24","cited_by_count":40,"area":null},{"id":"2104.00640","title":"AmbiFC: Fact-Checking Ambiguous Claims with Evidence","created":"2021-04-01","cited_by_count":38,"area":null},{"id":"2405.05860","title":"The Perspectivist Paradigm Shift: Assumptions and Challenges of Capturing Human Labels","created":"2024-05-09","cited_by_count":38,"area":null},{"id":"2201.06028","title":"Natural Language Deduction through Search over Statement Compositions","created":"2022-01-16","cited_by_count":35,"area":null},{"id":"2105.06020","title":"Are Larger Pretrained Language Models Uniformly Better? Comparing Performance at the Instance Level","created":"2021-05-13","cited_by_count":34,"area":null},{"id":"2305.13788","title":"Can Large Language Models Capture Dissenting Human Voices?","created":"2023-05-23","cited_by_count":33,"area":null},{"id":"2104.08676","title":"Distributed NLI: Learning to Predict Human Opinion Distributions for Language Reasoning","created":"2021-04-18","cited_by_count":31,"area":null},{"id":"2209.03392","title":"Investigating Reasons for Disagreement in Natural Language Inference","created":"2022-09-07","cited_by_count":29,"area":null},{"id":"2405.01299","title":"The Effectiveness of LLMs as Annotators: A Comparative Overview and Empirical Analysis of Direct Representation","created":"2024-05-02","cited_by_count":29,"area":null},{"id":"2109.04408","title":"Learning with Different Amounts of Annotation: From Zero to Many Labels","created":"2021-09-09","cited_by_count":28,"area":null},{"id":"2307.10168","title":"LLMs as Workers in Human-Computational Algorithms? Replicating Crowdsourcing Pipelines with LLMs","created":"2023-07-19","cited_by_count":27,"area":null},{"id":"2407.02397","title":"Learning to Refine with Fine-Grained Natural Language Feedback","created":"2024-07-02","cited_by_count":27,"area":null},{"id":"2305.09022","title":"It Takes Two to Tango: Navigating Conceptualizations of NLP Tasks and Measurements of Performance","created":"2023-05-15","cited_by_count":26,"area":null},{"id":"2605.29800","title":"Nine Judges, Two Effective Votes: Correlated Errors Undermine LLM Evaluation Panels","created":"2026-05-28","cited_by_count":26,"area":null},{"id":"2110.08514","title":"Analyzing Dynamic Adversarial Training Data in the Limit","created":"2021-10-16","cited_by_count":24,"area":null},{"id":"2403.07726","title":"SemEval-2024 Shared Task 6: SHROOM, a Shared-task on Hallucinations and Related Observable Overgeneration Mistakes","created":"2024-03-12","cited_by_count":24,"area":null},{"id":"2406.19354","title":"Fundamental Problems With Model Editing: How Should Rational Belief Revision Work in LLMs?","created":"2024-06-27","cited_by_count":24,"area":null},{"id":"2106.00794","title":"What Ingredients Make for an Effective Crowdsourcing Protocol for Difficult NLU Data Collection Tasks?","created":"2021-06-01","cited_by_count":23,"area":null},{"id":"2106.03020","title":"Embracing Ambiguity: Shifting the Training Target of NLI Models","created":"2021-06-06","cited_by_count":23,"area":null},{"id":"2205.04980","title":"ALLSH: Active Learning Guided by Local Sensitivity and Hardness","created":"2022-05-10","cited_by_count":23,"area":null},{"id":"2104.04470","title":"Did they answer? Subjective acts and intents in conversational discourse","created":"2021-04-09","cited_by_count":22,"area":null},{"id":"2402.10723","title":"Conformalized Credal Set Predictors","created":"2024-02-16","cited_by_count":21,"area":null},{"id":"2506.07461","title":"From Calibration to Collaboration: LLM Uncertainty Quantification Should Be More Human-Centered","created":"2025-06-09","cited_by_count":21,"area":null},{"id":"2205.11308","title":"Symptom Identification for Interpretable Detection of Multiple Mental Disorders","created":"2022-05-23","cited_by_count":20,"area":null},{"id":"2501.19047","title":"Understanding Model Calibration -- A gentle introduction and visual exploration of calibration and the expected calibration error (ECE)","created":"2025-01-31","cited_by_count":20,"area":null},{"id":"2411.04852","title":"Conformalized Credal Regions for Classification with Ambiguous Ground Truth","created":"2024-11-07","cited_by_count":19,"area":null},{"id":"2404.15720","title":"Annotator-Centric Active Learning for Subjective NLP Tasks","created":"2024-04-24","cited_by_count":18,"area":null},{"id":"2311.05265","title":"Don't Waste a Single Annotation: Improving Single-Label Classifiers Through Soft Labels","created":"2023-11-09","cited_by_count":17,"area":null},{"id":"2406.17600","title":"\"Seeing the Big through the Small\": Can LLMs Approximate Human Judgment Distributions on NLI from a Few Explanations?","created":"2024-06-25","cited_by_count":17,"area":null},{"id":"2111.04104","title":"Uncertainty Calibration for Ensemble-Based Debiasing Methods","created":"2021-11-07","cited_by_count":16,"area":null},{"id":"2306.00824","title":"Zero and Few-shot Semantic Parsing with Ambiguous Inputs","created":"2023-06-01","cited_by_count":16,"area":null},{"id":"2310.13850","title":"Ecologically Valid Explanations for Label Variation in NLI","created":"2023-10-20","cited_by_count":16,"area":null},{"id":"2402.16102","title":"Interpreting Predictive Probabilities: Model Confidence or Human Label Variation?","created":"2024-02-25","cited_by_count":15,"area":null},{"id":"2304.00815","title":"Design Choices for Crowdsourcing Implicit Discourse Relations: Revealing the Biases Introduced by Task Design","created":"2023-04-03","cited_by_count":14,"area":null},{"id":"2406.15471","title":"Improving Large Models with Small models: Lower Costs and Better Performance","created":"2024-06-15","cited_by_count":14,"area":null},{"id":"2106.04102","title":"Swords: A Benchmark for Lexical Substitution with Improved Data Coverage and Quality","created":"2021-06-08","cited_by_count":13,"area":null},{"id":"2408.14141","title":"Crowd-Calibrator: Can Annotator Disagreement Inform Calibration in Subjective Tasks?","created":"2024-08-26","cited_by_count":13,"area":null},{"id":"2111.08181","title":"Adversarially Constructed Evaluation Sets Are More Challenging, but May Not Be Fair","created":"2021-11-16","cited_by_count":12,"area":null},{"id":"2203.06342","title":"What Makes Reading Comprehension Questions Difficult?","created":"2022-03-12","cited_by_count":11,"area":null},{"id":"2305.14770","title":"Using Natural Language Explanations to Rescale Human Judgments","created":"2023-05-24","cited_by_count":11,"area":null},{"id":"2412.13942","title":"A Rose by Any Other Name: LLM-Generated Explanations Are Good Proxies for Human Explanations to Collect Label Distributions on NLI","created":"2024-12-18","cited_by_count":9,"area":null},{"id":"2505.01595","title":"Always Tell Me The Odds: Fine-grained Conditional Probability Estimation","created":"2025-05-02","cited_by_count":9,"area":null},{"id":"2510.08460","title":"LeWiDi-2025 at NLPerspectives: Third Edition of the Learning with Disagreements Shared Task","created":"2025-10-09","cited_by_count":9,"area":null},{"id":"2106.06849","title":"Can Transformer Language Models Predict Psychometric Properties?","created":"2021-06-12","cited_by_count":8,"area":null},{"id":"2308.04114","title":"Collective Human Opinions in Semantic Textual Similarity","created":"2023-08-08","cited_by_count":8,"area":null},{"id":"2502.01891","title":"Training and Evaluating with Human Label Variation: An Empirical Study","created":"2025-02-03","cited_by_count":8,"area":null},{"id":"2502.19676","title":"FOReCAst: The Future Outcome Reasoning and Confidence Assessment Benchmark","created":"2025-02-27","cited_by_count":8,"area":null},{"id":"2505.22332","title":"Credal Prediction based on Relative Likelihood","created":"2025-05-28","cited_by_count":8,"area":null},{"id":"2307.02191","title":"Evaluating AI systems under uncertain ground truth: a case study in dermatology","created":"2023-07-05","cited_by_count":7,"area":null},{"id":"2310.02457","title":"The Empty Signifier Problem: Towards Clearer Paradigms for Operationalising \"Alignment\" in Large Language Models","created":"2023-10-03","cited_by_count":7,"area":null},{"id":"2204.04735","title":"Reducing Model Jitter: Stable Re-training of Semantic Parsers in Production Environments","created":"2022-04-10","cited_by_count":6,"area":null},{"id":"2302.06976","title":"Investigating Multi-source Active Learning for Natural Language Inference","created":"2023-02-14","cited_by_count":6,"area":null},{"id":"2409.12218","title":"ARTICLE: Annotator Reliability Through In-Context Learning","created":"2024-09-18","cited_by_count":6,"area":null},{"id":"2502.13853","title":"Fine-grained Fallacy Detection with Human Label Variation","created":"2025-02-19","cited_by_count":6,"area":null},{"id":"2505.20761","title":"Practical estimation of the optimal classification error with soft labels and calibration","created":"2025-05-27","cited_by_count":6,"area":null},{"id":"2609.33209","title":"Beyond Calibration: Do a Typed-Decision Model's Probabilities Obey the Probability Axioms?","created":"2026-09-27","cited_by_count":6,"area":null},{"id":"2205.06203","title":"Predicting Human Psychometric Properties Using Computational Language Models","created":"2022-05-12","cited_by_count":5,"area":null},{"id":"2304.12443","title":"Understanding and Predicting Human Label Variation in Natural Language Inference through Explanation","created":"2023-04-24","cited_by_count":5,"area":null},{"id":"2402.01423","title":"Different Tastes of Entities: Investigating Human Label Variation in Named Entity Annotations","created":"2024-02-02","cited_by_count":5,"area":null},{"id":"2510.16458","title":"Agree, Disagree, Explain: Decomposing Human Label Variation in NLI through the Lens of Explanations","created":"2025-10-18","cited_by_count":5,"area":null},{"id":"2304.04726","title":"Uncertainty-Aware Natural Language Inference with Stochastic Weight Averaging","created":"2023-04-10","cited_by_count":4,"area":null},{"id":"2402.17527","title":"Predict the Next Word: Humans exhibit uncertainty in this task and language models _____","created":"2024-02-27","cited_by_count":4,"area":null},{"id":"2403.04400","title":"Exploring Continual Learning of Compositional Generalization in NLI","created":"2024-03-07","cited_by_count":4,"area":null},{"id":"2408.08971","title":"A Multi-Task and Multi-Label Classification Model for Implicit Discourse Relation Recognition","created":"2024-08-16","cited_by_count":4,"area":null},{"id":"2505.22848","title":"LiTEx: A Linguistic Taxonomy of Explanations for Understanding Within-Label Variation in Natural Language Inference","created":"2025-05-28","cited_by_count":4,"area":null},{"id":"2507.15114","title":"From Disagreement to Understanding: The Case for Ambiguity Detection in NLI","created":"2025-07-20","cited_by_count":4,"area":null},{"id":"2604.27345","title":"LLMs Capture Emotion Labels, Not Emotion Uncertainty: Distributional Analysis and Calibration of Human-LLM Judgment Gaps","created":"2026-04-30","cited_by_count":4,"area":null},{"id":"2310.14572","title":"Unveiling the Multi-Annotation Process: Examining the Influence of Annotation Quantity and Instance Difficulty on Model Performance","created":"2023-10-23","cited_by_count":3,"area":null},{"id":"2503.13369","title":"Sightation Counts: Leveraging Sighted User Feedback in Building a BLV-aligned Dataset of Diagram Descriptions","created":"2025-03-17","cited_by_count":3,"area":null},{"id":"2505.19033","title":"Optimal Conformal Prediction under Epistemic Uncertainty","created":"2025-05-25","cited_by_count":3,"area":null},{"id":"2505.21786","title":"VeriTrail: Closed-Domain Hallucination Detection with Traceability","created":"2025-05-27","cited_by_count":3,"area":null},{"id":"2510.12817","title":"From Noise to Signal to Selbstzweck: Reframing Human Label Variation in the Era of Post-training in NLP","created":"2025-10-09","cited_by_count":3,"area":null},{"id":"2604.08701","title":"Unified Multimodal Uncertain Inference","created":"2026-04-09","cited_by_count":3,"area":null},{"id":"2306.04925","title":"Prefer to Classify: Improving Text Classifiers via Auxiliary Preference Learning","created":"2023-06-08","cited_by_count":2,"area":null},{"id":"2312.03726","title":"Interpretation modeling: Social grounding of sentences by reasoning over their implicit moral judgments","created":"2023-11-27","cited_by_count":2,"area":null},{"id":"2404.01785","title":"Can Humans Identify Domains?","created":"2024-04-02","cited_by_count":2,"area":null},{"id":"2405.09439","title":"Facilitating Opinion Diversity through Hybrid NLP Approaches","created":"2024-05-15","cited_by_count":2,"area":null},{"id":"2405.11197","title":"Designing NLP Systems That Adapt to Diverse Worldviews","created":"2024-05-18","cited_by_count":2,"area":null},{"id":"2408.02257","title":"To Aggregate or Not to Aggregate. That is the Question: A Case Study on Annotation Subjectivity in Span Prediction","created":"2024-08-05","cited_by_count":2,"area":null},{"id":"2506.02378","title":"Exploring Explanations Improves the Robustness of In-Context Learning","created":"2025-06-03","cited_by_count":2,"area":null},{"id":"2511.14117","title":"Distributions In, Distributions Out: The Case for Soft-Label Training","created":"2025-11-18","cited_by_count":2,"area":null},{"id":"2604.07591","title":"From Ground Truth to Measurement: A Statistical Framework for Human Labeling","created":"2026-04-08","cited_by_count":2,"area":null},{"id":"2606.05376","title":"SHALA-LLM: Smartly Handling Ambiguous Labels in Aligning LLMs","created":"2026-06-03","cited_by_count":2,"area":null},{"id":"2212.02745","title":"Sources of Noise in Dialogue and How to Deal with Them","created":"2022-12-06","cited_by_count":1,"area":null},{"id":"2212.08756","title":"Multi-Scales Data Augmentation Approach In Natural Language Inference For Artifacts Mitigation And Pre-Trained Model Optimization","created":"2022-12-16","cited_by_count":1,"area":null},{"id":"2305.15130","title":"On Degrees of Freedom in Defining and Testing Natural Language Understanding","created":"2023-05-24","cited_by_count":1,"area":null},{"id":"2306.07061","title":"Deep Model Compression Also Helps Models Capture Ambiguity","created":"2023-06-12","cited_by_count":1,"area":null},{"id":"2307.07412","title":"HuCurl: Human-induced Curriculum Discovery","created":"2023-07-14","cited_by_count":1,"area":null},{"id":"2311.08874","title":"Human-in-the-loop: Towards Label Embeddings for Measuring Classification Difficulty","created":"2023-11-15","cited_by_count":1,"area":null},{"id":"2404.01799","title":"PATCH! {P}sychometrics-{A}ssis{T}ed Ben{CH}marking of Large Language Models against Human Populations: A Case Study of Proficiency in 8th Grade Mathematics","created":"2024-04-02","cited_by_count":1,"area":null},{"id":"2404.06670","title":"What's Mine becomes Yours: Defining, Annotating and Detecting Context-Dependent Paraphrases in News Interview Dialogs","created":"2024-04-10","cited_by_count":1,"area":null},{"id":"2502.05793","title":"On Reference (In-)Determinacy in Natural Language Inference","created":"2025-02-09","cited_by_count":1,"area":null}],"next_cursor":"100"}