{"list":"other","total":198,"rows":[{"id":"2005.14050","title":"Language (Technology) is Power: A Critical Survey of \"Bias\" in NLP","created":"2020-05-28","cited_by_count":956},{"id":"2305.14387","title":"AlpacaFarm: A Simulation Framework for Methods that Learn from Human Feedback","created":"2023-05-22","cited_by_count":748},{"id":"2104.08773","title":"Cross-Task Generalization via Natural Language Crowdsourcing Instructions","created":"2021-04-18","cited_by_count":699},{"id":"2101.11718","title":"BOLD: Dataset and Metrics for Measuring Biases in Open-Ended Language Generation","created":"2021-01-27","cited_by_count":412},{"id":"2212.09689","title":"Unnatural Instructions: Tuning Language Models with (Almost) No Human Labor","created":"2022-12-19","cited_by_count":397},{"id":"2110.05719","title":"Dealing with Disagreements: Looking Beyond the Majority Vote in Subjective Annotations","created":"2021-10-12","cited_by_count":314},{"id":"2309.13007","title":"ReConcile: Round-Table Conference Improves Reasoning via Consensus among Diverse LLMs","created":"2023-09-22","cited_by_count":309},{"id":"2111.07997","title":"Annotators with Attitudes: How Annotator Beliefs And Identities Bias Toxic Language Detection","created":"2021-11-15","cited_by_count":264},{"id":"2406.15513","title":"PKU-SafeRLHF: Towards Multi-Level Safety Alignment for LLMs with Human Preference","created":"2024-06-20","cited_by_count":261},{"id":"2412.03304","title":"Global MMLU: Understanding and Addressing Cultural and Linguistic Biases in Multilingual Evaluation","created":"2024-12-04","cited_by_count":191},{"id":"2204.01075","title":"Data Cards: Purposeful and Transparent Dataset Documentation for Responsible AI","created":"2022-04-03","cited_by_count":171},{"id":"2402.10811","title":"Quantifying the Persona Effect in LLM Simulations","created":"2024-02-16","cited_by_count":169},{"id":"1912.07726","title":"Towards Fairer Datasets: Filtering and Balancing the Distribution of the People Subtree in the ImageNet Hierarchy","created":"2019-12-16","cited_by_count":156},{"id":"2212.07981","title":"Revisiting the Gold Standard: Grounding Summarization Evaluation with Robust Human Evaluation","created":"2022-12-15","cited_by_count":142},{"id":"2010.13561","title":"Towards Accountability for Machine Learning Datasets: Practices from Software Engineering and Infrastructure","created":"2020-10-23","cited_by_count":138},{"id":"2406.07814","title":"Collective Constitutional AI: Aligning a Language Model with Public Input","created":"2024-06-12","cited_by_count":123},{"id":"2202.02950","title":"Jury Learning: Integrating Dissenting Voices into Machine Learning Models","created":"2022-02-07","cited_by_count":118},{"id":"1912.10389","title":"Lessons from Archives: Strategies for Collecting Sociocultural Data in Machine Learning","created":"2019-12-22","cited_by_count":116},{"id":"2410.12954","title":"A Note on Shumailov et al. (2024): `AI Models Collapse When Trained on Recursively Generated Data'","created":"2024-10-16","cited_by_count":115},{"id":"2306.01943","title":"NLPositionality: Characterizing Design Biases of Datasets and Models","created":"2023-06-02","cited_by_count":94},{"id":"2306.11247","title":"DICES Dataset: Diversity in Conversational AI Evaluation for Safety","created":"2023-06-20","cited_by_count":86},{"id":"2108.04308","title":"Do Datasets Have Politics? Disciplinary Values in Computer Vision Dataset Development","created":"2021-08-09","cited_by_count":85},{"id":"1910.13913","title":"Toward Gender-Inclusive Coreference Resolution","created":"2019-10-30","cited_by_count":84},{"id":"2402.11782","title":"What Evidence Do Language Models Find Convincing?","created":"2024-02-19","cited_by_count":75},{"id":"2501.10970","title":"The Alternative Annotator Test for LLM-as-a-Judge: How to Statistically Justify Replacing Human Annotators with LLMs","created":"2025-01-19","cited_by_count":74},{"id":"2205.00501","title":"Is Your Toxicity My Toxicity? Exploring the Impact of Rater Identity on Toxicity Annotation","created":"2022-05-01","cited_by_count":69},{"id":"2311.18743","title":"AlignBench: Benchmarking Chinese Alignment of Large Language Models","created":"2023-11-30","cited_by_count":68},{"id":"2204.11788","title":"Human-AI Collaboration via Conditional Delegation: A Case Study of Content Moderation","created":"2022-04-25","cited_by_count":67},{"id":"1912.08320","title":"Garbage In, Garbage Out? Do Machine Learning Application Papers in Social Computing Report Where Human-Labeled Training Data Comes From?","created":"2019-12-17","cited_by_count":64},{"id":"2206.08931","title":"CrowdWorkSheets: Accounting for Individual and Collective Identities Underlying Crowdsourced Dataset Annotation","created":"2022-06-09","cited_by_count":59},{"id":"2007.15963","title":"Disentangling Human Error from the Ground Truth in Segmentation of Medical Images","created":"2020-07-31","cited_by_count":58},{"id":"2305.09941","title":"\"I'm fully who I am\": Towards Centering Transgender and Non-Binary Voices to Measure Biases in Open Language Generation","created":"2023-05-17","cited_by_count":56},{"id":"2112.04554","title":"Whose Ground Truth? Accounting for Individual and Collective Identities Underlying Dataset Annotation","created":"2021-12-08","cited_by_count":52},{"id":"2301.05036","title":"Everyone's Voice Matters: Quantifying Annotation Disagreement Using Demographic Information","created":"2023-01-12","cited_by_count":52},{"id":"2305.09666","title":"AbdomenAtlas-8K: Annotating 8,000 CT Volumes for Multi-Organ Segmentation in Three Weeks","created":"2023-05-16","cited_by_count":52},{"id":"2405.14758","title":"Axioms for AI Alignment from Human Feedback","created":"2024-05-23","cited_by_count":52},{"id":"2105.13947","title":"Changing the World by Changing the Data","created":"2021-05-28","cited_by_count":51},{"id":"2410.16491","title":"BIG5-CHAT: Shaping LLM Personalities Through Training on Human-Grounded Data","created":"2024-10-21","cited_by_count":50},{"id":"2205.07722","title":"How Different Groups Prioritize Ethical Values for Responsible AI","created":"2022-05-16","cited_by_count":49},{"id":"2409.14509","title":"Can AI writing be salvaged? Mitigating Idiosyncrasies and Improving Human-AI Alignment in the Writing Process through Edits","created":"2024-09-22","cited_by_count":49},{"id":"2105.02317","title":"A Step Toward More Inclusive People Annotations for Fairness","created":"2021-05-05","cited_by_count":46},{"id":"2310.19677","title":"MoCa: Measuring Human-Language Model Alignment on Causal and Moral Judgment Tasks","created":"2023-10-30","cited_by_count":44},{"id":"2207.06214","title":"Is one annotation enough? A data-centric image classification benchmark for noisy and ambiguous label estimation","created":"2022-07-13","cited_by_count":43},{"id":"2402.16795","title":"If in a Crowdsourced Data Annotation Pipeline, a GPT-4","created":"2024-02-26","cited_by_count":38},{"id":"2301.06937","title":"Improving Human-AI Collaboration With Descriptions of AI Behavior","created":"2023-01-06","cited_by_count":36},{"id":"2207.02942","title":"Towards Transparency in Dermatology Image Datasets with Skin Tone Annotations by Experts, Crowds, and an Algorithm","created":"2022-07-06","cited_by_count":35},{"id":"2102.02320","title":"One Label, One Billion Faces: Usage and Consistency of Racial Categories in Computer Vision","created":"2021-02-03","cited_by_count":33},{"id":"2502.20897","title":"Beyond Demographics: Fine-tuning Large Language Models to Predict Individuals' Subjective Text Perceptions","created":"2025-02-28","cited_by_count":33},{"id":"2005.07493","title":"History for Visual Dialog: Do we really need it?","created":"2020-05-08","cited_by_count":32},{"id":"2106.07393","title":"Cross-replication Reliability -- An Empirical Approach to Interpreting Inter-rater Reliability","created":"2021-06-11","cited_by_count":31},{"id":"2502.18695","title":"Policy-as-Prompt: Rethinking Content Moderation in the Age of Large Language Models","created":"2025-02-25","cited_by_count":31},{"id":"2105.01774","title":"Envisioning Communities: A Participatory Approach Towards AI for Social Good","created":"2021-05-04","cited_by_count":30},{"id":"2110.10746","title":"Better than Average: Paired Evaluation of NLP Systems","created":"2021-10-20","cited_by_count":30},{"id":"2205.04221","title":"The Forgotten Margins of AI Ethics","created":"2022-05-09","cited_by_count":30},{"id":"2301.09656","title":"Selective Explanations: Leveraging Human Input to Align Explainable AI","created":"2023-01-23","cited_by_count":29},{"id":"2311.09743","title":"Capturing Perspectives of Crowdsourced Annotators in Subjective Learning Tasks","created":"2023-11-16","cited_by_count":29},{"id":"2103.04725","title":"Assessing the Impact of Automated Suggestions on Decision Making: Domain Experts Mediate Model Errors but Take Less Initiative","created":"2021-03-08","cited_by_count":28},{"id":"2206.02923","title":"Understanding Machine Learning Practitioners' Data Documentation Perceptions, Needs, Challenges, and Desiderata","created":"2022-06-06","cited_by_count":28},{"id":"2409.19430","title":"'Simulacrum of Stories': Examining Large Language Models as Qualitative Research Participants","created":"2024-09-28","cited_by_count":28},{"id":"2502.18411","title":"OmniAlign-V: Towards Enhanced Alignment of MLLMs with Human Preference","created":"2025-02-25","cited_by_count":28},{"id":"2108.05271","title":"DeliData: A dataset for deliberation in multi-party problem solving","created":"2021-08-11","cited_by_count":26},{"id":"2312.06861","title":"Disentangling Perceptions of Offensiveness: Cultural and Moral Correlates","created":"2023-12-11","cited_by_count":26},{"id":"2410.19133","title":"Hybrid Preferences: Learning to Route Instances for Human vs. AI Feedback","created":"2024-10-24","cited_by_count":26},{"id":"2007.14886","title":"Between Subjectivity and Imposition: Power Dynamics in Data Annotation for Computer Vision","created":"2020-07-29","cited_by_count":25},{"id":"2302.06503","title":"Ground(less) Truth: A Causal Framework for Proxy Labels in Human-Algorithm Decision-Making","created":"2023-02-13","cited_by_count":25},{"id":"2203.10748","title":"Whose AI Dream? In search of the aspiration in data annotation","created":"2022-03-21","cited_by_count":24},{"id":"2106.00794","title":"What Ingredients Make for an Effective Crowdsourcing Protocol for Difficult NLU Data Collection Tasks?","created":"2021-06-01","cited_by_count":23},{"id":"2202.13028","title":"Healthsheet: Development of a Transparency Artifact for Health Datasets","created":"2022-02-26","cited_by_count":23},{"id":"2403.07678","title":"MoralBERT: A Fine-Tuned Language Model for Capturing Moral Values in Social Discussions","created":"2024-03-12","cited_by_count":23},{"id":"1910.04289","title":"Learning to Contextually Aggregate Multi-Source Supervision for Sequence Labeling","created":"2019-10-09","cited_by_count":22},{"id":"2302.03675","title":"Auditing Gender Presentation Differences in Text-to-Image Models","created":"2023-02-07","cited_by_count":22},{"id":"2305.09073","title":"Consensus and Subjectivity of Skin Tone Annotation for ML Fairness","created":"2023-05-16","cited_by_count":22},{"id":"2405.01820","title":"Real Risks of Fake Data: Synthetic Data, Diversity-Washing and Consent Circumvention","created":"2024-05-03","cited_by_count":21},{"id":"2403.12075","title":"Adversarial Nibbler: An Open Red-Teaming Method for Identifying Diverse Harms in Text-to-Image Generation","created":"2024-02-14","cited_by_count":20},{"id":"2502.10441","title":"AI Alignment at Your Discretion","created":"2025-02-10","cited_by_count":20},{"id":"2406.16469","title":"Evaluating Visual and Cultural Interpretation: The K-Viscuit Benchmark with Human-VLM Collaboration","created":"2024-06-24","cited_by_count":19},{"id":"2105.04273","title":"Loss-Aversively Fair Classification","created":"2021-05-10","cited_by_count":18},{"id":"2402.14147","title":"Wikibench: Community-Driven Data Curation for AI Evaluation on Wikipedia","created":"2024-02-21","cited_by_count":18},{"id":"2405.02703","title":"Machine Learning Data Practices through a Data Curation Lens: An Evaluation Framework","created":"2024-05-04","cited_by_count":18},{"id":"2406.13925","title":"GenderAlign: An Alignment Dataset for Mitigating Gender Bias in Large Language Models","created":"2024-06-20","cited_by_count":18},{"id":"2409.09467","title":"Keeping Humans in the Loop: Human-Centered Automated Annotation with Generative AI","created":"2024-09-14","cited_by_count":17},{"id":"2110.00169","title":"Quantifying the Invisible Labor in Crowd Work","created":"2021-10-01","cited_by_count":16},{"id":"2205.11963","title":"The Data-Production Dispositif","created":"2022-05-24","cited_by_count":16},{"id":"2305.04672","title":"Augmented Datasheets for Speech Datasets and Ethical Decision-Making","created":"2023-05-08","cited_by_count":16},{"id":"2405.04457","title":"Towards Geographic Inclusion in the Evaluation of Text-to-Image Models","created":"2024-05-07","cited_by_count":16},{"id":"2405.13974","title":"CIVICS: Building a Dataset for Examining Culturally-Informed Values in Large Language Models","created":"2024-05-22","cited_by_count":16},{"id":"2406.00020","title":"Harmful Speech Detection by Language Models Exhibits Gender-Queer Dialect Bias","created":"2024-05-23","cited_by_count":16},{"id":"2103.09058","title":"Understanding the Representation and Representativeness of Age in AI Data Sets","created":"2021-03-10","cited_by_count":15},{"id":"2105.12980","title":"Investigating label suggestions for opinion mining in German Covid-19 social media","created":"2021-05-27","cited_by_count":15},{"id":"2405.08209","title":"Who's in and who's out? A case study of multimodal CLIP-filtering in DataComp","created":"2024-05-13","cited_by_count":15},{"id":"2405.15760","title":"GPT is Not an Annotator: The Necessity of Human Annotation in Fairness Benchmark Construction","created":"2024-05-24","cited_by_count":15},{"id":"2412.19080","title":"Mask Factory: Towards High-quality Synthetic Data Generation for Dichotomous Image Segmentation","created":"2024-12-26","cited_by_count":15},{"id":"2502.11267","title":"Prompting in the Dark: Assessing Human Performance in Prompt Engineering for Data Labeling When Gold Labels Are Absent","created":"2025-02-16","cited_by_count":15},{"id":"2103.01168","title":"Narratives and Counternarratives on Data Sharing in Africa","created":"2021-03-01","cited_by_count":14},{"id":"2110.08038","title":"Toward Annotator Group Bias in Crowdsourcing","created":"2021-10-08","cited_by_count":14},{"id":"2502.13137","title":"Theorem Prover as a Judge for Synthetic Data Generation","created":"2025-02-18","cited_by_count":14},{"id":"2503.10688","title":"CULEMO: Cultural Lenses on Emotion -- Benchmarking LLMs for Cross-Cultural Emotion Understanding","created":"2025-03-12","cited_by_count":14},{"id":"2203.07031","title":"Model Positionality and Computational Reflexivity: Promoting Reflexivity in Data Science","created":"2022-03-08","cited_by_count":13},{"id":"2305.03117","title":"Are Human Explanations Always Helpful? Towards Objective Evaluation of Human Natural Language Explanations","created":"2023-05-04","cited_by_count":13},{"id":"2506.00777","title":"Improving Automatic Evaluation of Large Language Models (LLMs) in Biomedical Relation Extraction via LLMs-as-the-Judge","created":"2025-06-01","cited_by_count":13}],"next_cursor":"100"}