mlsanityData to 7 Oct 2026

Academic competitions

arXiv 2312.00268 ↗First posted 1 Dec 2023cs.LG cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Academic challenges comprise effective means for (i) advancing the state of the art, (ii) putting in the spotlight of a scientific community specific topics and problems, as well as (iii) closing the gap for under represented communities in terms of accessing and participating in the shaping of research fields. Competitions can be traced back for centuries and their achievements have had great influence in our modern world. Recently, they (re)gained popularity, with the overwhelming amounts of data that is being generated in different domains, as well as the need of pushing the barriers of existing methods, and available tools to handle such data. This chapter provides a survey of academic challenges in the context of machine learning and related fields. We review the most influential competitions in the last few years and analyze challenges per area of knowledge. The aims of scientific challenges, their goals, major achievements and expectations for the next few years are reviewed.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 34 of its 110 references that are in the map. First posted on arXiv 1 Dec 2023.

Builds on

34 of 110 references.

References · 34

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2014Microsoft COCO: Common Objects in Contextcited by 17,498
  3. 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
  4. 2014ImageNet Large Scale Visual Recognition Challengecited by 8,441
  5. 2021Evaluating Large Language Models Trained on Codecited by 8,053
  6. 2018GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understandingcited by 4,854
  7. 2015You Only Look Once: Unified, Real-Time Object Detectioncited by 4,829
  8. 2014Going Deeper with Convolutionscited by 4,231
  9. 2021Program Synthesis with Large Language Modelscited by 3,509
  10. 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,193
  11. 2017CARLA: An Open Urban Driving Simulatorcited by 2,431
  12. 2022Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language modelscited by 1,970
22 more
  1. 2023WebArena: A Realistic Web Environment for Building Autonomous Agentscited by 1,908
  2. 2019SuperGLUE: A Stickier Benchmark for General-Purpose Language Understanding Systemscited by 1,718
  3. 2021Bayesian Optimization is Superior to Random Search for Machine Learning Hyperparameter Tuning: Analysis of the Black-Box Optimization Challenge 2020cited by 146
  4. 2023On the Tool Manipulation Capability of Open-source Large Language Modelscited by 122
  5. 2021Scalable Evaluation of Multi-Agent Reinforcement Learning with Melting Potcited by 97
  6. 2019Cold Case: The Lost MNIST Digitscited by 61
  7. 2021RODNet: A Real-Time Radar Object Detection Network Cross-Supervised by Camera-Radar Fused Object 3D Localizationcited by 49
  8. 2022NTIRE 2022 Challenge on Perceptual Image Quality Assessmentcited by 41
  9. 2022Overview of the HECKTOR Challenge at MICCAI 2021: Automatic Head and Neck Tumor Segmentation and Outcome Prediction in PET/CT Imagescited by 29
  10. 2020Cross-ethnicity Face Anti-spoofing Recognition Challenge: A Reviewcited by 25
  11. 2018Learning to Run challenge solutions: Adapting reinforcement learning methods for neuromusculoskeletal environmentscited by 19
  12. 2020Retrospective Analysis of the 2019 MineRL Competition on Sample Efficient Reinforcement Learningcited by 18
  13. 2021TRECVID 2020: A comprehensive campaign for evaluating video retrieval tasks across multiple application domainscited by 16
  14. 2022Winning solutions and post-challenge analyses of the ChaLearn AutoDL challenge 2019cited by 16
  15. 2022Traffic4cast at NeurIPS 2021 -- Temporal and Spatial Few-Shot Transfer Learning in Gridded Geo-Spatial Processescited by 15
  16. 2021ChaLearn LAP Large Scale Signer Independent Isolated Sign Language Recognition Challenge: Design, Results and Future Researchcited by 10
  17. 2022Lessons learned from the NeurIPS 2021 MetaDL challenge: Backbone fine-tuning without episodic meta-learning dominates for few-shot learning image classificationcited by 10
  18. 2021Woodscape Fisheye Semantic Segmentation for Autonomous Driving -- CVPR 2021 OmniCV Workshop Challengecited by 8
  19. 2020The 1st Challenge on Remote Physiological Signal Sensing (RePSS)cited by 6
  20. 2019AutoML @ NeurIPS 2018 challenge: Design and Resultscited by 4
  21. 2017ChaLearn Looking at People: A Review of Events and Resourcescited by 3
  22. 2020AutoCLINT: The Winning Method in AutoCV Challenge 2019cited by 2

Built on by

Not cited yet.