{"total":282,"rows":[{"id":"2303.17548","title":"Whose Opinions Do Language Models Reflect?","created":"2023-03-30","cited_by_count":773,"area":null},{"id":"2306.16388","title":"Towards Measuring the Representation of Subjective Global Opinions in Language Models","created":"2023-06-28","cited_by_count":437,"area":null},{"id":"2203.09509","title":"ToxiGen: A Large-Scale Machine-Generated Dataset for Adversarial and Implicit Hate Speech Detection","created":"2022-03-17","cited_by_count":422,"area":null},{"id":"2208.03274","title":"A Holistic Approach to Undesired Content Detection in the Real World","created":"2022-08-05","cited_by_count":356,"area":null},{"id":"2305.08283","title":"From Pretraining Data to Language Models to Downstream Tasks: Tracking the Trails of Political Biases Leading to Unfair NLP Models","created":"2023-05-15","cited_by_count":260,"area":null},{"id":"2203.10020","title":"Challenges and Strategies in Cross-Cultural NLP","created":"2022-03-18","cited_by_count":218,"area":null},{"id":"2402.10811","title":"Quantifying the Persona Effect in LLM Simulations","created":"2024-02-16","cited_by_count":169,"area":null},{"id":"2202.06675","title":"Can Machines Help Us Answering Question 16 in Datasheets, and In Turn Reflecting on Inappropriate Content?","created":"2022-02-14","cited_by_count":155,"area":null},{"id":"2211.02570","title":"The 'Problem' of Human Label Variation: On Ground Truth in Data, Modeling and Evaluation","created":"2022-11-04","cited_by_count":139,"area":null},{"id":"2202.02950","title":"Jury Learning: Integrating Dissenting Voices into Machine Learning Models","created":"2022-02-07","cited_by_count":118,"area":null},{"id":"2203.07785","title":"The Ghost in the Machine has an American accent: value conflict in GPT-3","created":"2022-03-15","cited_by_count":105,"area":null},{"id":"2309.00779","title":"Value Kaleidoscope: Engaging AI with Pluralistic Human Values, Rights, and Duties","created":"2023-09-02","cited_by_count":97,"area":null},{"id":"2306.01943","title":"NLPositionality: Characterizing Design Biases of Datasets and Models","created":"2023-06-02","cited_by_count":94,"area":null},{"id":"2305.06626","title":"When the Majority is Wrong: Modeling Annotator Disagreement for Subjective Tasks","created":"2023-05-11","cited_by_count":90,"area":null},{"id":"2308.06374","title":"Large Language Models and Knowledge Graphs: Opportunities and Challenges","created":"2023-08-11","cited_by_count":71,"area":null},{"id":"2302.08956","title":"AfriSenti: A Twitter Sentiment Analysis Benchmark for African Languages","created":"2023-02-17","cited_by_count":68,"area":null},{"id":"2201.08277","title":"NaijaSenti: A Nigerian Twitter Sentiment Corpus for Multilingual Sentiment Analysis","created":"2022-01-20","cited_by_count":64,"area":null},{"id":"2301.05036","title":"Everyone's Voice Matters: Quantifying Annotation Disagreement Using Demographic Information","created":"2023-01-12","cited_by_count":52,"area":null},{"id":"2304.02828","title":"Uncurated Image-Text Datasets: Shedding Light on Demographic Bias","created":"2023-04-06","cited_by_count":52,"area":null},{"id":"2304.14803","title":"SemEval-2023 Task 11: Learning With Disagreements (LeWiDi)","created":"2023-04-28","cited_by_count":52,"area":null},{"id":"2205.05256","title":"Evaluation Gaps in Machine Learning Practice","created":"2022-05-11","cited_by_count":49,"area":null},{"id":"2303.04222","title":"SemEval-2023 Task 10: Explainable Detection of Online Sexism","created":"2023-03-07","cited_by_count":48,"area":null},{"id":"2306.11559","title":"The Ecological Fallacy in Annotation: Modelling Human Label Variation goes beyond Sociodemographics","created":"2023-06-20","cited_by_count":46,"area":null},{"id":"2308.16705","title":"Exploring Cross-Cultural Differences in English Hate Speech Annotations: From Dataset Construction to Analysis","created":"2023-08-31","cited_by_count":45,"area":null},{"id":"2207.06214","title":"Is one annotation enough? A data-centric image classification benchmark for noisy and ambiguous label estimation","created":"2022-07-13","cited_by_count":43,"area":null},{"id":"2403.01931","title":"VariErr NLI: Separating Annotation Error from Human Label Variation","created":"2024-03-04","cited_by_count":42,"area":null},{"id":"2305.14663","title":"You Are What You Annotate: Towards Better Models through Annotator Representations","created":"2023-05-24","cited_by_count":40,"area":null},{"id":"2502.20897","title":"Beyond Demographics: Fine-tuning Large Language Models to Predict Individuals' Subjective Text Perceptions","created":"2025-02-28","cited_by_count":33,"area":null},{"id":"2205.12771","title":"Does Moral Code Have a Moral Code? Probing Delphi's Moral Philosophy","created":"2022-05-25","cited_by_count":31,"area":null},{"id":"2209.03392","title":"Investigating Reasons for Disagreement in Natural Language Inference","created":"2022-09-07","cited_by_count":29,"area":null},{"id":"2311.09743","title":"Capturing Perspectives of Crowdsourced Annotators in Subjective Learning Tasks","created":"2023-11-16","cited_by_count":29,"area":null},{"id":"2402.15350","title":"Farsight: Fostering Responsible AI Awareness During AI Application Prototyping","created":"2024-02-23","cited_by_count":28,"area":null},{"id":"2403.01222","title":"Emotion Analysis in NLP: Trends, Gaps and Roadmap for Future Directions","created":"2024-03-02","cited_by_count":27,"area":null},{"id":"2305.09022","title":"It Takes Two to Tango: Navigating Conceptualizations of NLP Tasks and Measurements of Performance","created":"2023-05-15","cited_by_count":26,"area":null},{"id":"2312.06861","title":"Disentangling Perceptions of Offensiveness: Cultural and Moral Correlates","created":"2023-12-11","cited_by_count":26,"area":null},{"id":"2407.08188","title":"Position: Measure Dataset Diversity, Don't Just Claim It","created":"2024-07-11","cited_by_count":26,"area":null},{"id":"2403.05696","title":"SeeGULL Multilingual: a Dataset of Geo-Culturally Situated Stereotypes","created":"2024-03-08","cited_by_count":24,"area":null},{"id":"2406.11565","title":"Extrinsic Evaluation of Cultural Competence in Large Language Models","created":"2024-06-17","cited_by_count":24,"area":null},{"id":"2305.08414","title":"What's the Meaning of Superhuman Performance in Today's NLU?","created":"2023-05-15","cited_by_count":23,"area":null},{"id":"2406.14462","title":"Modeling Human Subjectivity in LLMs Using Explicit and Implicit Human Factors in Personas","created":"2024-06-20","cited_by_count":23,"area":null},{"id":"2407.04910","title":"NADI 2024: The Fifth Nuanced Arabic Dialect Identification Shared Task","created":"2024-07-06","cited_by_count":23,"area":null},{"id":"2210.14531","title":"Unifying Data Perspectivism and Personalization: An Application to Social Norms","created":"2022-10-26","cited_by_count":22,"area":null},{"id":"2305.09073","title":"Consensus and Subjectivity of Skin Tone Annotation for ML Fairness","created":"2023-05-16","cited_by_count":22,"area":null},{"id":"2208.05545","title":"The Moral Foundations Reddit Corpus","created":"2022-08-10","cited_by_count":21,"area":null},{"id":"2205.12698","title":"Empathic Conversations: A Multi-level Dataset of Contextualized Conversations","created":"2022-05-25","cited_by_count":20,"area":null},{"id":"2404.01651","title":"NLP Systems That Can't Tell Use from Mention Censor Counterspeech, but Teaching the Distinction Helps","created":"2024-04-02","cited_by_count":20,"area":null},{"id":"2502.10441","title":"AI Alignment at Your Discretion","created":"2025-02-10","cited_by_count":20,"area":null},{"id":"2310.14424","title":"Which Prompts Make The Difference? Data Prioritization For Efficient Human LLM Evaluation","created":"2023-10-22","cited_by_count":18,"area":null},{"id":"2404.15720","title":"Annotator-Centric Active Learning for Subjective NLP Tasks","created":"2024-04-24","cited_by_count":18,"area":null},{"id":"2203.06498","title":"The worst of both worlds: A comparative analysis of errors in learning from data in psychology and machine learning","created":"2022-03-12","cited_by_count":17,"area":null},{"id":"2310.14979","title":"ACTOR: Active Learning with Annotator-specific Classification Heads to Embrace Human Label Variation","created":"2023-10-23","cited_by_count":17,"area":null},{"id":"2311.05265","title":"Don't Waste a Single Annotation: Improving Single-Label Classifiers Through Soft Labels","created":"2023-11-09","cited_by_count":17,"area":null},{"id":"2405.06346","title":"Akal Badi ya Bias: An Exploratory Study of Gender Bias in Hindi Language Technology","created":"2024-05-10","cited_by_count":17,"area":null},{"id":"2406.17600","title":"\"Seeing the Big through the Small\": Can LLMs Approximate Human Judgment Distributions on NLI from a Few Explanations?","created":"2024-06-25","cited_by_count":17,"area":null},{"id":"2409.09467","title":"Keeping Humans in the Loop: Human-Centered Automated Annotation with Generative AI","created":"2024-09-14","cited_by_count":17,"area":null},{"id":"2409.17213","title":"Plurals: A System for Guiding LLMs Via Simulated Social Ensembles","created":"2024-09-25","cited_by_count":17,"area":null},{"id":"2503.19075","title":"The Case for \"Thick Evaluations\" of Cultural Representation in AI","created":"2025-03-24","cited_by_count":17,"area":null},{"id":"2210.03165","title":"A Theory of Dynamic Benchmarks","created":"2022-10-06","cited_by_count":16,"area":null},{"id":"2301.12534","title":"Vicarious Offense and Noise Audit of Offensive Speech Classifiers: Unifying Human and Machine Disagreement on What is Offensive","created":"2023-01-29","cited_by_count":16,"area":null},{"id":"2309.00384","title":"BatchPrompt: Accomplish more with less","created":"2023-09-01","cited_by_count":16,"area":null},{"id":"2405.04457","title":"Towards Geographic Inclusion in the Evaluation of Text-to-Image Models","created":"2024-05-07","cited_by_count":16,"area":null},{"id":"2310.17428","title":"''Fifty Shades of Bias'': Normative Ratings of Gender Bias in GPT Generated English Text","created":"2023-10-26","cited_by_count":15,"area":null},{"id":"2402.01787","title":"Harm Amplification in Text-to-Image Models","created":"2024-02-01","cited_by_count":15,"area":null},{"id":"2402.16102","title":"Interpreting Predictive Probabilities: Model Confidence or Human Label Variation?","created":"2024-02-25","cited_by_count":15,"area":null},{"id":"2202.12288","title":"Toward More Meaningful Resources for Lower-resourced Languages","created":"2022-02-24","cited_by_count":14,"area":null},{"id":"2401.07058","title":"Does More Advice Help? The Effects of Second Opinions in AI-Assisted Decision Making","created":"2024-01-13","cited_by_count":14,"area":null},{"id":"2502.06207","title":"Is LLM an Overconfident Judge? Unveiling the Capabilities of LLMs in Detecting Offensive Language with Annotation Disagreement","created":"2025-02-10","cited_by_count":14,"area":null},{"id":"2503.10688","title":"CULEMO: Cultural Lenses on Emotion -- Benchmarking LLMs for Cross-Cultural Emotion Understanding","created":"2025-03-12","cited_by_count":14,"area":null},{"id":"2307.03201","title":"Scaling Laws Do Not Scale","created":"2023-07-05","cited_by_count":13,"area":null},{"id":"2408.14141","title":"Crowd-Calibrator: Can Annotator Disagreement Inform Calibration in Subjective Tasks?","created":"2024-08-26","cited_by_count":13,"area":null},{"id":"2505.17510","title":"Large Language Models Do Multi-Label Classification Differently","created":"2025-05-23","cited_by_count":13,"area":null},{"id":"2601.09065","title":"Beyond Consensus: Perspectivist Modeling and Evaluation of Annotator Disagreement in NLP","created":"2026-01-14","cited_by_count":13,"area":null},{"id":"2110.14839","title":"Hate Speech Classifiers Learn Human-Like Social Stereotypes","created":"2021-10-28","cited_by_count":12,"area":null},{"id":"2112.07475","title":"Two Contrasting Data Annotation Paradigms for Subjective NLP Tasks","created":"2021-12-14","cited_by_count":12,"area":null},{"id":"2212.10405","title":"AnnoBERT: Effectively Representing Multiple Annotators' Label Choices to Improve Hate Speech Detection","created":"2022-12-20","cited_by_count":12,"area":null},{"id":"2112.03529","title":"Ground-Truth, Whose Truth? -- Examining the Challenges with Annotating Toxic Text Datasets","created":"2021-12-07","cited_by_count":11,"area":null},{"id":"2210.02659","title":"Explainable Abuse Detection as Intent Classification and Slot Filling","created":"2022-10-06","cited_by_count":11,"area":null},{"id":"2306.06760","title":"Estimating the Uncertainty in Emotion Attributes using Deep Evidential Regression","created":"2023-06-11","cited_by_count":11,"area":null},{"id":"2310.15398","title":"\"One-Size-Fits-All\"? Examining Expectations around What Constitute \"Fair\" or \"Good\" NLG System Behaviors","created":"2023-10-23","cited_by_count":11,"area":null},{"id":"2404.10857","title":"D3CODE: Disentangling Disagreements in Data across Cultures on Offensiveness Detection and Evaluation","created":"2024-04-16","cited_by_count":11,"area":null},{"id":"2407.18078","title":"PEFT-U: Parameter-Efficient Fine-Tuning for User Personalization","created":"2024-07-25","cited_by_count":11,"area":null},{"id":"2204.13568","title":"Justice in Misinformation Detection Systems: An Analysis of Algorithms, Stakeholders, and Potential Harms","created":"2022-04-28","cited_by_count":10,"area":null},{"id":"2305.06074","title":"iLab at SemEval-2023 Task 11 Le-Wi-Di: Modelling Disagreement or Modelling Perspectives?","created":"2023-05-10","cited_by_count":10,"area":null},{"id":"2403.04085","title":"Don't Blame the Data, Blame the Model: Understanding Noise and Bias When Learning from Subjective Annotations","created":"2024-03-06","cited_by_count":10,"area":null},{"id":"2403.06009","title":"Detectors for Safe and Reliable LLMs: Implementations, Uses, and Limitations","created":"2024-03-09","cited_by_count":10,"area":null},{"id":"2402.01535","title":"An Empirical Analysis of Diversity in Argument Summarization","created":"2024-02-02","cited_by_count":9,"area":null},{"id":"2407.14259","title":"Voices in a Crowd: Searching for Clusters of Unique Perspectives","created":"2024-07-19","cited_by_count":9,"area":null},{"id":"2510.08460","title":"LeWiDi-2025 at NLPerspectives: Third Edition of the Learning with Disagreements Shared Task","created":"2025-10-09","cited_by_count":9,"area":null},{"id":"2402.06811","title":"Discipline and Label: A WEIRD Genealogy and Social Theory of Data Annotation","created":"2024-02-09","cited_by_count":8,"area":null},{"id":"2404.02340","title":"Corpus Considerations for Annotator Modeling and Scaling","created":"2024-04-02","cited_by_count":8,"area":null},{"id":"2410.03543","title":"Re-examining Sexism and Misogyny Classification with Annotator Attitudes","created":"2024-10-04","cited_by_count":8,"area":null},{"id":"2210.07415","title":"Noise Audits Improve Moral Foundation Classification","created":"2022-10-13","cited_by_count":7,"area":null},{"id":"2210.15870","title":"\"It's Not Just Hate'': A Multi-Dimensional Perspective on Detecting Harmful Speech Online","created":"2022-10-28","cited_by_count":7,"area":null},{"id":"2302.02944","title":"Learning Complementary Policies for Human-AI Teams","created":"2023-02-06","cited_by_count":7,"area":null},{"id":"2307.02191","title":"Evaluating AI systems under uncertain ground truth: a case study in dermatology","created":"2023-07-05","cited_by_count":7,"area":null},{"id":"2307.10189","title":"Subjective Crowd Disagreements for Subjective Data: Uncovering Meaningful CrowdOpinion with Population-level Learning","created":"2023-07-07","cited_by_count":7,"area":null},{"id":"2310.02457","title":"The Empty Signifier Problem: Towards Clearer Paradigms for Operationalising \"Alignment\" in Large Language Models","created":"2023-10-03","cited_by_count":7,"area":null},{"id":"2402.02249","title":"Don't Label Twice: Quantity Beats Quality when Comparing Binary Classifiers on a Budget","created":"2024-02-03","cited_by_count":7,"area":null},{"id":"2406.04106","title":"Explainability and Hate Speech: Structured Explanations Make Social Media Moderators Faster","created":"2024-06-06","cited_by_count":7,"area":null},{"id":"2411.08977","title":"Robustness and Confounders in the Demographic Alignment of LLMs with Human Perceptions of Offensiveness","created":"2024-11-13","cited_by_count":7,"area":null}],"next_cursor":"100"}