{"list":"other","total":101,"rows":[{"id":"2110.14168","title":"Training Verifiers to Solve Math Word Problems","created":"2021-10-27","cited_by_count":10109},{"id":"2009.03300","title":"Measuring Massive Multitask Language Understanding","created":"2020-09-07","cited_by_count":7963},{"id":"1706.04599","title":"On Calibration of Modern Neural Networks","created":"2017-06-14","cited_by_count":4960},{"id":"1705.03551","title":"TriviaQA: A Large Scale Distantly Supervised Challenge Dataset for Reading Comprehension","created":"2017-05-09","cited_by_count":2955},{"id":"2207.05221","title":"Language Models (Mostly) Know What They Know","created":"2022-07-11","cited_by_count":1856},{"id":"1811.00937","title":"CommonsenseQA: A Question Answering Challenge Targeting Commonsense Knowledge","created":"2018-11-02","cited_by_count":1822},{"id":"2306.13063","title":"Can LLMs Express Their Uncertainty? An Empirical Evaluation of Confidence Elicitation in LLMs","created":"2023-06-22","cited_by_count":974},{"id":"1910.09457","title":"Aleatoric and Epistemic Uncertainty in Machine Learning: An Introduction to Concepts and Methods","created":"2019-10-21","cited_by_count":913},{"id":"1705.08500","title":"Selective Classification for Deep Neural Networks","created":"2017-05-23","cited_by_count":852},{"id":"2302.09664","title":"Semantic Uncertainty: Linguistic Invariances for Uncertainty Estimation in Natural Language Generation","created":"2023-02-19","cited_by_count":819},{"id":"2305.14975","title":"Just Ask for Calibration: Strategies for Eliciting Calibrated Confidence Scores from Language Models Fine-Tuned with Human Feedback","created":"2023-05-24","cited_by_count":812},{"id":"2303.08896","title":"SelfCheckGPT: Zero-Resource Black-Box Hallucination Detection for Generative Large Language Models","created":"2023-03-15","cited_by_count":810},{"id":"2205.14334","title":"Teaching Models to Express Their Uncertainty in Words","created":"2022-05-28","cited_by_count":751},{"id":"2101.02235","title":"Did Aristotle Use a Laptop? A Question Answering Benchmark with Implicit Reasoning Strategies","created":"2021-01-06","cited_by_count":743},{"id":"1906.00300","title":"Latent Retrieval for Weakly Supervised Open Domain Question Answering","created":"2019-06-01","cited_by_count":695},{"id":"2405.01470","title":"WildChat: 1M ChatGPT Interaction Logs in the Wild","created":"2024-05-02","cited_by_count":629},{"id":"2309.03882","title":"Large Language Models Are Not Robust Multiple Choice Selectors","created":"2023-09-07","cited_by_count":486},{"id":"2203.09509","title":"ToxiGen: A Large-Scale Machine-Generated Dataset for Adversarial and Implicit Hate Speech Detection","created":"2022-03-17","cited_by_count":422},{"id":"2004.10645","title":"AmbigQA: Answering Ambiguous Open-domain Questions","created":"2020-04-22","cited_by_count":390},{"id":"2305.19187","title":"Generating with Confidence: Uncertainty Quantification for Black-box Large Language Models","created":"2023-05-30","cited_by_count":293},{"id":"2403.03952","title":"Bridging Language and Items for Retrieval and Recommendation: Benchmarking LLMs as Semantic Encoders","created":"2024-03-06","cited_by_count":224},{"id":"2203.10020","title":"Challenges and Strategies in Cross-Cultural NLP","created":"2022-03-18","cited_by_count":218},{"id":"2406.04770","title":"WildBench: Benchmarking LLMs with Challenging Tasks from Real Users in the Wild","created":"2024-06-07","cited_by_count":218},{"id":"2012.14983","title":"Reducing conversational agents' overconfidence through linguistic calibration","created":"2020-12-30","cited_by_count":210},{"id":"2002.04087","title":"Human-Centered Artificial Intelligence: Reliable, Safe & Trustworthy","created":"2020-02-10","cited_by_count":183},{"id":"2405.20003","title":"Kernel Language Entropy: Fine-grained Uncertainty Quantification for LLMs from Semantic Similarities","created":"2024-05-30","cited_by_count":159},{"id":"2010.03532","title":"What Can We Learn from Collective Human Opinions on Natural Language Inference Data?","created":"2020-10-07","cited_by_count":153},{"id":"2307.01379","title":"Shifting Attention to Relevance: Towards the Predictive Uncertainty Quantification of Free-Form Large Language Models","created":"2023-07-03","cited_by_count":150},{"id":"2109.06157","title":"SituatedQA: Incorporating Extra-Linguistic Contexts into QA","created":"2021-09-13","cited_by_count":145},{"id":"2001.08298","title":"Proxy Tasks and Subjective Measures Can Be Misleading in Evaluating Explainable AI Systems","created":"2020-01-22","cited_by_count":139},{"id":"2306.01941","title":"AI Transparency in the Age of LLMs: A Human-Centered Research Roadmap","created":"2023-06-02","cited_by_count":123},{"id":"2308.16175","title":"Quantifying Uncertainty in Answers from any Language Model and Enhancing their Trustworthiness","created":"2023-08-30","cited_by_count":122},{"id":"2412.05563","title":"A Survey on Uncertainty Quantification of Large Language Models: Taxonomy, Open Research Challenges, and Future Directions","created":"2024-12-07","cited_by_count":121},{"id":"2308.13111","title":"Bayesian Low-rank Adaptation for Large Language Models","created":"2023-08-24","cited_by_count":115},{"id":"2502.06233","title":"Confidence Improves Self-Consistency in LLMs","created":"2025-02-10","cited_by_count":113},{"id":"2109.00590","title":"WebQA: Multihop and Multimodal QA","created":"2021-09-01","cited_by_count":109},{"id":"2210.04714","title":"Uncertainty Quantification with Pre-trained Language Models: A Large-Scale Empirical Analysis","created":"2022-10-10","cited_by_count":104},{"id":"2311.13230","title":"Enhancing Uncertainty-Based Hallucination Detection with Stronger Focus","created":"2023-11-22","cited_by_count":99},{"id":"2503.15850","title":"Uncertainty Quantification and Confidence Calibration in Large Language Models: A Survey","created":"2025-03-20","cited_by_count":95},{"id":"2310.15638","title":"CoAnnotating: Uncertainty-Guided Work Allocation between Human and Large Language Models for Data Annotation","created":"2023-10-24","cited_by_count":94},{"id":"2406.09714","title":"Large language model validity via enhanced conformal prediction methods","created":"2024-06-14","cited_by_count":92},{"id":"2405.16908","title":"Can Large Language Models Faithfully Express Their Intrinsic Uncertainty in Words?","created":"2024-05-27","cited_by_count":87},{"id":"2210.11584","title":"Towards Human-centered Explainable AI: A Survey of User Studies for Model Explanations","created":"2022-10-20","cited_by_count":85},{"id":"2302.13425","title":"A Survey on Uncertainty Quantification Methods for Deep Learning","created":"2023-02-26","cited_by_count":81},{"id":"2404.15993","title":"Uncertainty Estimation and Quantification for LLMs: A Simple Supervised Approach","created":"2024-04-24","cited_by_count":76},{"id":"2002.08035","title":"A Case for Humans-in-the-Loop: Decisions in the Presence of Erroneous Algorithmic Scores","created":"2020-02-19","cited_by_count":74},{"id":"2212.07769","title":"CLAM: Selective Clarification for Ambiguous Questions with Generative Language Models","created":"2022-12-15","cited_by_count":69},{"id":"2305.14613","title":"Selectively Answering Ambiguous Questions","created":"2023-05-24","cited_by_count":66},{"id":"2403.05973","title":"Calibrating Large Language Models Using Their Generations Only","created":"2024-03-09","cited_by_count":65},{"id":"2309.12236","title":"Smooth ECE: Principled Reliability Diagrams via Kernel Smoothing","created":"2023-09-21","cited_by_count":63},{"id":"2409.19817","title":"Calibrating Language Models with Adaptive Temperature Scaling","created":"2024-09-29","cited_by_count":58},{"id":"2410.15326","title":"A Survey of Uncertainty Estimation in LLMs: Theory Meets Practice","created":"2024-10-20","cited_by_count":55},{"id":"2405.02917","title":"Overconfidence is Key: Verbalized Uncertainty Evaluation in Large Language and Vision-Language Models","created":"2024-05-05","cited_by_count":54},{"id":"2211.16886","title":"A Unifying Theory of Distance from Calibration","created":"2022-11-30","cited_by_count":53},{"id":"2502.14127","title":"Which of These Best Describes Multiple Choice Evaluation with LLMs? A) Forced B) Flawed C) Fixable D) All of the Above","created":"2025-02-19","cited_by_count":52},{"id":"2310.11689","title":"Adaptation with Self-Evaluation to Improve Selective Prediction in LLMs","created":"2023-10-18","cited_by_count":50},{"id":"2006.11194","title":"Does Explainable Artificial Intelligence Improve Human Decision-Making?","created":"2020-06-19","cited_by_count":49},{"id":"2402.11756","title":"MARS: Meaning-Aware Response Scoring for Uncertainty Estimation in Generative LLMs","created":"2024-02-19","cited_by_count":46},{"id":"2404.04689","title":"Multicalibration for Confidence Scoring in LLMs","created":"2024-04-06","cited_by_count":46},{"id":"2202.08821","title":"Human-Algorithm Collaboration: Achieving Complementarity and Avoiding Unfairness","created":"2022-02-17","cited_by_count":45},{"id":"2310.12418","title":"The Shifted and The Overlooked: A Task-oriented Investigation of User-GPT Interactions","created":"2023-10-19","cited_by_count":45},{"id":"2007.14435","title":"Towards Ecologically Valid Research on Language User Interfaces","created":"2020-07-28","cited_by_count":42},{"id":"2206.10847","title":"Connecting Algorithmic Research and Usage Contexts: A Perspective of Contextualized Evaluation for Explainable AI","created":"2022-06-22","cited_by_count":40},{"id":"2305.07095","title":"Are Machine Rationales (Not) Useful to Humans? Measuring and Improving Human Utility of Free-Text Rationales","created":"2023-05-11","cited_by_count":37},{"id":"2406.04306","title":"Improving Uncertainty Estimation through Semantically Diverse Language Generation","created":"2024-06-06","cited_by_count":35},{"id":"2405.16282","title":"Confidence Under the Hood: An Investigation into the Confidence-Probability Alignment in Large Language Models","created":"2024-05-25","cited_by_count":34},{"id":"2209.03943","title":"The Utility of Explainable AI in Ad Hoc Human-Machine Teaming","created":"2022-09-08","cited_by_count":30},{"id":"2305.19249","title":"Preserving Pre-trained Features Helps Calibrate Fine-tuned Language Models","created":"2023-05-30","cited_by_count":29},{"id":"2306.00074","title":"Human-Aligned Calibration for AI-Assisted Decision Making","created":"2023-05-31","cited_by_count":28},{"id":"2407.14614","title":"Evaluating language models as risk scores","created":"2024-07-19","cited_by_count":27},{"id":"2202.05983","title":"Uncalibrated Models Can Improve Human-AI Collaboration","created":"2022-02-12","cited_by_count":26},{"id":"2410.14582","title":"Do LLMs estimate uncertainty well in instruction-following?","created":"2024-10-18","cited_by_count":26},{"id":"2305.18262","title":"Beyond Confidence: Reliable Models Should Also Consider Atypicality","created":"2023-05-29","cited_by_count":25},{"id":"2406.11278","title":"Do Not Design, Learn: A Trainable Scoring Function for Uncertainty Estimation in Generative LLMs","created":"2024-06-17","cited_by_count":23},{"id":"2504.14154","title":"SConU: Selective Conformal Uncertainty in Large Language Models","created":"2025-04-19","cited_by_count":23},{"id":"2401.07955","title":"A Study on Large Language Models' Limitations in Multiple-Choice Question Answering","created":"2024-01-15","cited_by_count":22},{"id":"2502.11250","title":"Uncertainty-Aware Step-wise Verification with Generative Reward Models","created":"2025-02-16","cited_by_count":22},{"id":"2302.07248","title":"Generation Probabilities Are Not Enough: Uncertainty Highlighting in AI Code Completions","created":"2023-02-14","cited_by_count":20},{"id":"2502.19110","title":"Conformal Linguistic Calibration: Trading-off between Factuality and Specificity","created":"2025-02-26","cited_by_count":20},{"id":"2406.06487","title":"When is Multicalibration Post-Processing Necessary?","created":"2024-06-10","cited_by_count":18},{"id":"2405.13907","title":"Just rephrase it! Uncertainty estimation in closed-source language models via multiple rephrased queries","created":"2024-05-22","cited_by_count":15},{"id":"2405.21028","title":"LACIE: Listener-Aware Finetuning for Confidence Calibration in Large Language Models","created":"2024-05-31","cited_by_count":15},{"id":"2503.19168","title":"Language Model Uncertainty Quantification with Attention Chain","created":"2025-03-24","cited_by_count":14},{"id":"2407.21057","title":"Multi-group Uncertainty Quantification for Long-form Text Generation","created":"2024-07-25","cited_by_count":13},{"id":"2410.06615","title":"QA-Calibration of Language Model Confidence Scores","created":"2024-10-09","cited_by_count":13},{"id":"2505.17510","title":"Large Language Models Do Multi-Label Classification Differently","created":"2025-05-23","cited_by_count":13},{"id":"2306.01646","title":"Auditing for Human Expertise","created":"2023-06-02","cited_by_count":12},{"id":"2502.14105","title":"Conformal Prediction under Levy-Prokhorov Distribution Shifts: Robustness to Local and Global Perturbations","created":"2025-02-19","cited_by_count":12},{"id":"2309.10852","title":"Using AI Uncertainty Quantification to Improve Human Decision-Making","created":"2023-09-19","cited_by_count":11},{"id":"2310.16225","title":"CleanCoNLL: A Nearly Noise-Free Named Entity Recognition Dataset","created":"2023-10-24","cited_by_count":11},{"id":"2401.05612","title":"Designing for Appropriate Reliance: The Roles of AI Uncertainty Presentation, Initial User Decision, and User Demographics in AI-Assisted Decision-Making","created":"2024-01-11","cited_by_count":11},{"id":"2411.02454","title":"Graph-based Confidence Calibration for Large Language Models","created":"2024-11-03","cited_by_count":10},{"id":"2407.03545","title":"On Evaluating Explanation Utility for Human-AI Decision Making in NLP","created":"2024-07-03","cited_by_count":9},{"id":"2406.04068","title":"Reassessing How to Compare and Improve the Calibration of Machine Learning Models","created":"2024-06-06","cited_by_count":8},{"id":"2410.04315","title":"Calibrating Expressions of Certainty","created":"2024-10-06","cited_by_count":7},{"id":"2403.11025","title":"Pre-Trained Language Models Represent Some Geographic Populations Better Than Others","created":"2024-03-16","cited_by_count":6},{"id":"2502.13321","title":"Adjust for Trust: Mitigating Trust-Induced Inappropriate Reliance on AI Assistance","created":"2025-02-18","cited_by_count":6},{"id":"2501.14035","title":"Human-Alignment Influences the Utility of AI-assisted Decision Making","created":"2025-01-23","cited_by_count":5},{"id":"2502.19684","title":"GRACE: A Granular Benchmark for Evaluating Model Calibration against Human Calibration","created":"2025-02-27","cited_by_count":5},{"id":"2406.17274","title":"Can We Trust the Performance Evaluation of Uncertainty Estimation Methods in Text Summarization?","created":"2024-06-25","cited_by_count":3}],"next_cursor":"100"}