mlsanityData to 14 Oct 2026

A Review of YOLOv12: Attention-Based Enhancements vs. Previous Versions

arXiv 2504.11995 ↗First posted 16 Apr 2025cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

The YOLO (You Only Look Once) series has been a leading framework in real-time object detection, consistently improving the balance between speed and accuracy. However, integrating attention mechanisms into YOLO has been challenging due to their high computational overhead. YOLOv12 introduces a novel approach that successfully incorporates attention-based enhancements while preserving real-time performance. This paper provides a comprehensive review of YOLOv12's architectural innovations, including Area Attention for computationally efficient self-attention, Residual Efficient Layer Aggregation Networks for improved feature aggregation, and FlashAttention for optimized memory access. Additionally, we benchmark YOLOv12 against prior YOLO versions and competing object detectors, analyzing its improvements in accuracy, inference speed, and computational efficiency. Through this analysis, we demonstrate how YOLOv12 advances real-time object detection by refining the latency-accuracy trade-off and optimizing computational resources.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 37 of its 67 references that are in the map. First posted on arXiv 16 Apr 2025.

Builds on

37 of 67 references.

References · 37

  1. 2014Microsoft COCO: Common Objects in Contextcited by 17,608
  2. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
  3. 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,403
  4. 2015You Only Look Once: Unified, Real-Time Object Detectioncited by 4,852
  5. 2022FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awarenesscited by 3,673
  6. 2018YOLOv3: An Incremental Improvementcited by 2,659
  7. 2023FlashAttention-2: Faster Attention with Better Parallelism and Work Partitioningcited by 2,598
  8. 2020Transformers are RNNs: Fast Autoregressive Transformers with Linear Attentioncited by 2,022
  9. 2020YOLOv4: Optimal Speed and Accuracy of Object Detectioncited by 1,630
  10. 2020Rethinking Attention with Performerscited by 1,601
  11. 2020Linformer: Self-Attention with Linear Complexitycited by 1,474
  12. 2016YOLO9000: Better, Faster, Strongercited by 1,431
25 more
  1. 2022YOLOv7: Trainable bag-of-freebies sets new state-of-the-art for real-time object detectorscited by 982
  2. 2024VMamba: Visual State Space Modelcited by 969
  3. 2021Going deeper with Image Transformerscited by 764
  4. 2018CCNet: Criss-Cross Attention for Semantic Segmentationcited by 718
  5. 2021CSWin Transformer: A General Vision Transformer Backbone with Cross-Shaped Windowscited by 527
  6. 2024YOLOv10: Real-Time End-to-End Object Detectioncited by 515
  7. 2021Nystr"omformer: A Nystr"om-Based Algorithm for Approximating Self-Attentioncited by 471
  8. 2024YOLOv9: Learning What You Want to Learn Using Programmable Gradient Informationcited by 425
  9. 2024YOLOv11: An Overview of the Key Architectural Enhancementscited by 425
  10. 2019CSPNet: A New Backbone that can Enhance Learning Capability of CNNcited by 381
  11. 2023EVA-02: A Visual Representation for Neon Genesiscited by 381
  12. 2018Efficient Attention: Attention with Linear Complexitiescited by 368
  13. 2019Deep Multi-modal Object Detection and Semantic Segmentation for Autonomous Driving: Datasets, Methods, and Challengescited by 314
  14. 2025YOLOv12: Attention-Centric Real-Time Object Detectorscited by 305
  15. 2022YOLOv6: A Single-Stage Object Detection Framework for Industrial Applicationscited by 275
  16. 2021A Survey on Deep Semi-supervised Learningcited by 251
  17. 20223D Object Detection for Autonomous Driving: A Comprehensive Surveycited by 132
  18. 2020A Review and Comparative Study on Probabilistic Object Detection in Autonomous Drivingcited by 115
  19. 2020Low-Rank Bottleneck in Multi-head Attention Modelscited by 89
  20. 2024Compressing Large Language Models using Low Rank and Low Precision Decompositioncited by 59
  21. 2024What is YOLOv5: A deep look into the internal features of the popular object detectorcited by 37
  22. 2020Perception and Navigation in Autonomous Systems in the Era of Learning: A Surveycited by 30
  23. 2022A Comprehensive Review on Autonomous Navigationcited by 19
  24. 2021Panoptic Segmentation: A Reviewcited by 18
  25. 2023Transformer-Based Autonomous Driving Models and Deployment-Oriented Compression: A Surveycited by 8

Built on by

Not cited yet.