{"total":235,"rows":[{"id":"2110.12088","title":"Learning with Noisy Labels Revisited: A Study Using Real-World Human Annotations","created":"2021-10-22","cited_by_count":256,"area":null},{"id":"2406.04127","title":"Are We Done with MMLU?","created":"2024-06-06","cited_by_count":194,"area":null},{"id":"2310.13018","title":"Getting aligned on representational alignment","created":"2023-10-18","cited_by_count":143,"area":null},{"id":"2211.02570","title":"The 'Problem' of Human Label Variation: On Ground Truth in Data, Modeling and Evaluation","created":"2022-11-04","cited_by_count":139,"area":null},{"id":"2109.04270","title":"Toward a Perspectivist Turn in Ground Truthing for Predictive Computing","created":"2021-09-09","cited_by_count":130,"area":null},{"id":"2202.02950","title":"Jury Learning: Integrating Dissenting Voices into Machine Learning Models","created":"2022-02-07","cited_by_count":118,"area":null},{"id":"2207.07411","title":"Plex: Towards Reliability using Pretrained Large Model Extensions","created":"2022-07-15","cited_by_count":102,"area":null},{"id":"2207.10062","title":"DataPerf: Benchmarks for Data-Centric AI Development","created":"2022-07-20","cited_by_count":90,"area":null},{"id":"2402.19460","title":"Benchmarking Uncertainty Disentanglement: Specialized Uncertainties for Specialized Tasks","created":"2024-02-29","cited_by_count":78,"area":null},{"id":"2109.13563","title":"Agreeing to Disagree: Annotating Offensive Language Datasets with Annotators' Disagreement","created":"2021-09-28","cited_by_count":72,"area":null},{"id":"2201.12006","title":"Improving Expert Predictions with Conformal Prediction","created":"2022-01-28","cited_by_count":54,"area":null},{"id":"2304.14803","title":"SemEval-2023 Task 11: Learning With Disagreements (LeWiDi)","created":"2023-04-28","cited_by_count":52,"area":null},{"id":"2109.00574","title":"Active label cleaning for improved dataset quality under resource constraints","created":"2021-09-01","cited_by_count":44,"area":null},{"id":"2207.00810","title":"Eliciting and Learning with Soft Labels from Every Annotator","created":"2022-07-02","cited_by_count":43,"area":null},{"id":"2207.06214","title":"Is one annotation enough? A data-centric image classification benchmark for noisy and ambiguous label estimation","created":"2022-07-13","cited_by_count":43,"area":null},{"id":"2403.01931","title":"VariErr NLI: Separating Annotation Error from Human Label Variation","created":"2024-03-04","cited_by_count":42,"area":null},{"id":"2109.14591","title":"Combining Human Predictions with Model Probabilities via Confusion Matrices and Calibration","created":"2021-09-29","cited_by_count":40,"area":null},{"id":"2206.07948","title":"Forming Effective Human-AI Teams: Building Machine Learning Models that Complement the Capabilities of Multiple Experts","created":"2022-06-16","cited_by_count":40,"area":null},{"id":"2312.07353","title":"CLIP in Medical Imaging: A Survey","created":"2023-12-12","cited_by_count":40,"area":null},{"id":"2303.12872","title":"Human Uncertainty in Concept-Based AI Systems","created":"2023-03-22","cited_by_count":39,"area":null},{"id":"2104.00640","title":"AmbiFC: Fact-Checking Ambiguous Claims with Evidence","created":"2021-04-01","cited_by_count":38,"area":null},{"id":"2306.04507","title":"Improving neural network representations using human similarity judgments","created":"2023-06-07","cited_by_count":38,"area":null},{"id":"2106.05586","title":"Data augmentation in Bayesian neural networks and the cold posterior effect","created":"2021-06-10","cited_by_count":36,"area":null},{"id":"2110.05922","title":"Trivial or impossible -- dichotomous data difficulty masks model differences (on ImageNet and beyond)","created":"2021-10-12","cited_by_count":35,"area":null},{"id":"2205.01411","title":"On the Utility of Prediction Sets in Human-AI Teams","created":"2022-05-03","cited_by_count":34,"area":null},{"id":"2104.08676","title":"Distributed NLI: Learning to Predict Human Opinion Distributions for Language Reasoning","created":"2021-04-18","cited_by_count":31,"area":null},{"id":"2307.09302","title":"Conformal prediction under ambiguous ground truth","created":"2023-07-18","cited_by_count":31,"area":null},{"id":"2206.07181","title":"To Aggregate or Not? Learning with Separate Noisy Labels","created":"2022-06-14","cited_by_count":29,"area":null},{"id":"2302.02865","title":"Probabilistic Contrastive Learning Recovers the Correct Aleatoric Uncertainty of Ambiguous Inputs","created":"2023-02-06","cited_by_count":29,"area":null},{"id":"2105.03492","title":"Human-Aided Saliency Maps Improve Generalization of Deep Learning","created":"2021-05-07","cited_by_count":27,"area":null},{"id":"2202.00395","title":"Is the Performance of My Deep Network Too Good to Be True? A Direct Approach to Estimating the Bayes Error in Binary Classification","created":"2022-02-01","cited_by_count":26,"area":null},{"id":"2311.01106","title":"In Defense of Softmax Parametrization for Calibrated and Consistent Learning to Defer","created":"2023-11-02","cited_by_count":26,"area":null},{"id":"2407.08188","title":"Position: Measure Dataset Diversity, Don't Just Claim It","created":"2024-07-11","cited_by_count":26,"area":null},{"id":"2503.13050","title":"E-Values Expand the Scope of Conformal Prediction","created":"2025-03-17","cited_by_count":26,"area":null},{"id":"2309.05092","title":"Adaptive conformal classification with noisy labels","created":"2023-09-10","cited_by_count":25,"area":null},{"id":"2502.20502","title":"On Benchmarking Human-Like Intelligence in Machines","created":"2025-02-27","cited_by_count":25,"area":null},{"id":"2111.11044","title":"Exploring Segment-level Semantics for Online Phase Recognition from Surgical Videos","created":"2021-11-22","cited_by_count":23,"area":null},{"id":"2106.06596","title":"Disentangling the Roles of Curation, Data-Augmentation and the Prior in the Cold Posterior Effect","created":"2021-06-11","cited_by_count":22,"area":null},{"id":"2505.05522","title":"Continuous Thought Machines","created":"2025-05-08","cited_by_count":22,"area":null},{"id":"2109.03351","title":"Capturing the objects of vision with neural networks","created":"2021-09-07","cited_by_count":21,"area":null},{"id":"2203.02485","title":"Better Supervisory Signals by Observing Learning Paths","created":"2022-03-04","cited_by_count":21,"area":"distill"},{"id":"2402.10723","title":"Conformalized Credal Set Predictors","created":"2024-02-16","cited_by_count":21,"area":null},{"id":"2501.19047","title":"Understanding Model Calibration -- A gentle introduction and visual exploration of calibration and the expected calibration error (ECE)","created":"2025-01-31","cited_by_count":20,"area":null},{"id":"2105.03053","title":"Salient Objects in Clutter","created":"2021-05-07","cited_by_count":19,"area":null},{"id":"2411.04852","title":"Conformalized Credal Regions for Classification with Ambiguous Ground Truth","created":"2024-11-07","cited_by_count":19,"area":null},{"id":"2404.15720","title":"Annotator-Centric Active Learning for Subjective NLP Tasks","created":"2024-04-24","cited_by_count":18,"area":null},{"id":"2307.03810","title":"URL: A Representation Learning Benchmark for Transferable Uncertainty Estimates","created":"2023-07-07","cited_by_count":17,"area":null},{"id":"2310.14979","title":"ACTOR: Active Learning with Annotator-specific Classification Heads to Embrace Human Label Variation","created":"2023-10-23","cited_by_count":17,"area":null},{"id":"2311.05265","title":"Don't Waste a Single Annotation: Improving Single-Label Classifiers Through Soft Labels","created":"2023-11-09","cited_by_count":17,"area":null},{"id":"2104.08188","title":"I Find Your Lack of Uncertainty in Computer Vision Disturbing","created":"2021-04-16","cited_by_count":16,"area":null},{"id":"2210.06812","title":"CROWDLAB: Supervised learning to infer consensus labels and quality scores for data with multiple annotators","created":"2022-10-13","cited_by_count":16,"area":null},{"id":"2306.09467","title":"AQuA: A Benchmarking Tool for Label Quality Assessment","created":"2023-06-15","cited_by_count":16,"area":null},{"id":"2411.02433","title":"SLED: Self Logits Evolution Decoding for Improving Factuality in Large Language Models","created":"2024-11-01","cited_by_count":16,"area":"moe"},{"id":"2202.09244","title":"Transfer and Marginalize: Explaining Away Label Noise with Privileged Information","created":"2022-02-18","cited_by_count":15,"area":null},{"id":"2402.16102","title":"Interpreting Predictive Probabilities: Model Confidence or Human Label Variation?","created":"2024-02-25","cited_by_count":15,"area":null},{"id":"2107.11413","title":"An Instance-Dependent Simulation Framework for Learning with Label Noise","created":"2021-07-23","cited_by_count":14,"area":null},{"id":"2203.08653","title":"Counterfactual Inference of Second Opinions","created":"2022-03-16","cited_by_count":14,"area":null},{"id":"2304.00815","title":"Design Choices for Crowdsourcing Implicit Discourse Relations: Revealing the Biases Introduced by Task Design","created":"2023-04-03","cited_by_count":14,"area":null},{"id":"2304.06701","title":"Learning Personalized Decision Support Policies","created":"2023-04-13","cited_by_count":14,"area":null},{"id":"2312.03035","title":"SEVA: Leveraging sketches to evaluate alignment between human and machine visual abstraction","created":"2023-12-05","cited_by_count":14,"area":null},{"id":"2402.18551","title":"Implicit Optimization Bias of Next-Token Prediction in Linear Models","created":"2024-02-28","cited_by_count":14,"area":null},{"id":"2402.13635","title":"The METRIC-framework for assessing data quality for trustworthy AI in medicine: a systematic review","created":"2024-02-21","cited_by_count":13,"area":null},{"id":"2408.14141","title":"Crowd-Calibrator: Can Annotator Disagreement Inform Calibration in Subjective Tasks?","created":"2024-08-26","cited_by_count":13,"area":null},{"id":"2210.03102","title":"Ambiguous Images With Human Judgments for Robust Visual Event Classification","created":"2022-10-06","cited_by_count":12,"area":null},{"id":"2211.01407","title":"On the Informativeness of Supervision Signals","created":"2022-11-02","cited_by_count":12,"area":null},{"id":"2212.10405","title":"AnnoBERT: Effectively Representing Multiple Annotators' Label Choices to Improve Hate Speech Detection","created":"2022-12-20","cited_by_count":12,"area":null},{"id":"2405.17423","title":"Privacy-Aware Visual Language Models","created":"2024-05-27","cited_by_count":12,"area":"mllm"},{"id":"2407.07700","title":"Split Conformal Prediction under Data Contamination","created":"2024-07-10","cited_by_count":12,"area":null},{"id":"2502.10184","title":"Realistic Evaluation of Deep Partial-Label Learning Algorithms","created":"2025-02-14","cited_by_count":12,"area":null},{"id":"2105.08997","title":"When Deep Classifiers Agree: Analyzing Correlations between Learning Order and Image Statistics","created":"2021-05-19","cited_by_count":11,"area":null},{"id":"2112.10768","title":"Improving Learning-to-Defer Algorithms Through Fine-Tuning","created":"2021-12-18","cited_by_count":11,"area":null},{"id":"2404.10980","title":"Hyper Evidential Deep Learning to Quantify Composite Classification Uncertainty","created":"2024-04-17","cited_by_count":11,"area":null},{"id":"2202.04728","title":"Predicting Human Similarity Judgments Using Large Language Models","created":"2022-02-09","cited_by_count":10,"area":null},{"id":"2303.01806","title":"When does Privileged Information Explain Away Label Noise?","created":"2023-03-03","cited_by_count":10,"area":null},{"id":"2403.04085","title":"Don't Blame the Data, Blame the Model: Understanding Noise and Bias When Learning from Subjective Annotations","created":"2024-03-06","cited_by_count":10,"area":null},{"id":"2412.13573","title":"Seeking Consistent Flat Minima for Better Domain Generalization via Refining Loss Landscapes","created":"2024-12-18","cited_by_count":10,"area":null},{"id":"2106.16209","title":"A data-centric approach for improving ambiguous labels with combined semi-supervised classification and clustering","created":"2021-06-30","cited_by_count":9,"area":null},{"id":"2210.08906","title":"A.I. Robustness: a Human-Centered Perspective on Technological Challenges and Opportunities","created":"2022-10-17","cited_by_count":9,"area":null},{"id":"2312.07331","title":"Coupled Confusion Correction: Learning from Crowds with Sparse Annotations","created":"2023-12-12","cited_by_count":9,"area":null},{"id":"2402.07214","title":"Through the Lens of Split Vote: Exploring Disagreement, Difficulty and Calibration in Legal Case Outcome Classification","created":"2024-02-11","cited_by_count":9,"area":null},{"id":"2405.19902","title":"Learning Discriminative Dynamics with Label Corruption for Noisy Label Detection","created":"2024-05-30","cited_by_count":9,"area":null},{"id":"2502.09252","title":"On the Importance of Embedding Norms in Self-Supervised Learning","created":"2025-02-13","cited_by_count":9,"area":null},{"id":"2101.03477","title":"Training Affective Computer Vision Models by Crowdsourcing Soft-Target Labels","created":"2021-01-10","cited_by_count":8,"area":null},{"id":"2206.12041","title":"How many labelers do you have? A closer look at gold-standard labels","created":"2022-06-24","cited_by_count":8,"area":null},{"id":"2211.01202","title":"Human-in-the-Loop Mixup","created":"2022-11-02","cited_by_count":8,"area":null},{"id":"2404.00897","title":"Machine Learning Robustness: A Primer","created":"2024-04-01","cited_by_count":8,"area":null},{"id":"2502.01891","title":"Training and Evaluating with Human Label Variation: An Empirical Study","created":"2025-02-03","cited_by_count":8,"area":null},{"id":"2505.22332","title":"Credal Prediction based on Relative Likelihood","created":"2025-05-28","cited_by_count":8,"area":null},{"id":"2205.06905","title":"Perspectives on Incorporating Expert Feedback into Model Updates","created":"2022-05-13","cited_by_count":7,"area":null},{"id":"2207.06224","title":"Beyond Hard Labels: Investigating data label distributions","created":"2022-07-13","cited_by_count":7,"area":null},{"id":"2302.02944","title":"Learning Complementary Policies for Human-AI Teams","created":"2023-02-06","cited_by_count":7,"area":null},{"id":"2307.02191","title":"Evaluating AI systems under uncertain ground truth: a case study in dermatology","created":"2023-07-05","cited_by_count":7,"area":null},{"id":"2405.11547","title":"Certified Robust Accuracy of Neural Networks Are Bounded due to Bayes Errors","created":"2024-05-19","cited_by_count":7,"area":null},{"id":"2407.00935","title":"Look Ahead or Look Around? A Theoretical Comparison Between Autoregressive and Masked Pretraining","created":"2024-07-01","cited_by_count":7,"area":null},{"id":"2407.07003","title":"Learning to Complement and to Defer to Multiple Users","created":"2024-07-09","cited_by_count":7,"area":null},{"id":"2407.09087","title":"On the Role of Discrete Tokenization in Visual Representation Learning","created":"2024-07-12","cited_by_count":7,"area":null},{"id":"2102.09808","title":"Improving Anytime Prediction with Parallel Cascaded Networks and a Temporal-Difference Loss","created":"2021-02-19","cited_by_count":6,"area":null},{"id":"2107.10449","title":"Improve Learning from Crowds via Generative Augmentation","created":"2021-07-22","cited_by_count":6,"area":null},{"id":"2210.05330","title":"Label Noise-Robust Learning using a Confidence-Based Sieving Strategy","created":"2022-10-11","cited_by_count":6,"area":null},{"id":"2306.08424","title":"Selective Concept Models: Permitting Stakeholder Customisation at Test-Time","created":"2023-06-14","cited_by_count":6,"area":null}],"next_cursor":"100"}