Towards AI-Empowered Crowdsourcing
Not on the map. Why?
Abstract (arXiv)
Crowdsourcing, in which human intelligence and productivity is dynamically mobilized to tackle tasks too complex for automation alone to handle, has grown to be an important research topic and inspired new businesses (e.g., Uber, Airbnb). Over the years, crowdsourcing has morphed from providing a platform where workers and tasks can be matched up manually into one which leverages data-driven algorithmic management approaches powered by artificial intelligence (AI) to achieve increasingly sophisticated optimization objectives. In this paper, we provide a survey presenting a unique systematic overview on how AI can empower crowdsourcing to improve its efficiency - which we refer to as AI-Empowered Crowdsourcing(AIEC). We propose a taxonomy which divides AIEC into three major areas: 1) task delegation, 2) motivating workers, and 3) quality control, focusing on the major objectives which need to be accomplished. We discuss the limitations and insights, and curate the challenges of doing research in each of these areas to highlight promising future research directions.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 18 of its 154 references that are in the map. First posted on arXiv 28 Dec 2022.
Builds on
18 of 154 references.
References · 18
- 2017Who Said What: Modeling Individual Labelers Improves Classificationcited by 77
- 2018Building Ethics into Artificial Intelligencecited by 19
- 2018Leveraging Crowdsourcing Data For Deep Active Learning - An Application: Learning Intents in Alexacited by 11
- 2019Truth Inference at Scale: A Bayesian Model for Adjudicating Highly Redundant Crowd Annotationscited by 11
- 2021A Survey on Task Assignment in Crowdsourcingcited by 8
- 2018A Technical Survey on Statistical Modelling and Design Methods for Crowdsourcing Quality Controlcited by 7
- 2018Analysis of Minimax Error Rate for Crowdsourcing and Its Application to Worker Clustering Modelcited by 6
- 2015Defending against Sybil Devices in Crowdsourced Mapping Servicescited by 3
- 2020Federated Crowdsensing: Framework and Challengescited by 3
- 2015Online Assignment of Heterogeneous Tasks in Crowdsourcing Marketscited by 2
- 2015Exploiting Social Trust Assisted Reciprocity (STAR) towards Utility-Optimal Socially-aware Crowdsensingcited by 2
- 2016FROG: A Fast and Reliable Crowdsourcing Framework (Technical Report)cited by 2
6 more
- 2018Task Recommendation in Crowdsourcing Based on Learning Preferences and Reliabilitiescited by 2
- 2018Truth Inference on Sparse Crowdsourcing Data with Local Differential Privacycited by 2
- 2019Ethically Aligned Opportunistic Scheduling for Productive Lazinesscited by 2
- 2020A Misreport- and Collusion-Proof Crowdsourcing Mechanism without Quality Verificationcited by 2
- 2017A Socially-Aware Incentive Mechanism for Mobile Crowdsensing Service Marketcited by 1
- 2019An End-to-End Deep RL Framework for Task Arrangement in Crowdsourcing Platformscited by 1
Built on by
Not cited yet.