# R-TOSS: A Framework for Real-Time Object Detection using Semi-Structured Pruning

arXiv: https://arxiv.org/abs/2303.02191 · HTML: https://mlsanity.com/paper/2303.02191/

## Key facts

- Cited by 4 papers in the map (data through 14 Oct 2026).
- Builds on 24 of its 41 references that are in the map.
- First posted on arXiv 3 Mar 2023.

## Builds on (most cited first, 24 of 24)

- [Microsoft COCO: Common Objects in Context](https://mlsanity.com/paper/1405.0312/) (2014)
- [End-to-End Object Detection with Transformers](https://mlsanity.com/paper/2005.12872/) (2020)
- [Fast R-CNN](https://mlsanity.com/paper/1504.08083/) (2015)
- [Rich feature hierarchies for accurate object detection and semantic segmentation](https://mlsanity.com/paper/1311.2524/) (2013)
- [YOLOv4: Optimal Speed and Accuracy of Object Detection](https://mlsanity.com/paper/2004.10934/) (2020)
- [Pruning Filters for Efficient ConvNets](https://mlsanity.com/paper/1608.08710/) (2016)
- [YOLOX: Exceeding YOLO Series in 2021](https://mlsanity.com/paper/2107.08430/) (2021)
- [YOLOv7: Trainable bag-of-freebies sets new state-of-the-art for real-time object detectors](https://mlsanity.com/paper/2207.02696/) (2022)
- [SNIP: Single-shot Network Pruning based on Connection Sensitivity](https://mlsanity.com/paper/1810.02340/) (2018)
- [Learning Efficient Convolutional Networks through Network Slimming](https://mlsanity.com/paper/1708.06519/) (2017)
- [Importance Estimation for Neural Network Pruning](https://mlsanity.com/paper/1906.10771/) (2019)
- [Pruning neural networks without any data by iteratively conserving synaptic flow](https://mlsanity.com/paper/2006.05467/) (2020)
- [The State of Sparsity in Deep Neural Networks](https://mlsanity.com/paper/1902.09574/) (2019)
- [Picking Winning Tickets Before Training by Preserving Gradient Flow](https://mlsanity.com/paper/2002.07376/) (2020)
- [Deep Learning for Generic Object Detection: A Survey](https://mlsanity.com/paper/1809.02165/) (2018)
- [Neural Pruning via Growing Regularization](https://mlsanity.com/paper/2012.09243/) (2020)
- [You Only Learn One Representation: Unified Network for Multiple Tasks](https://mlsanity.com/paper/2105.04206/) (2021)
- [PatDNN: Achieving Real-Time DNN Execution on Mobile Devices with Pattern-based Weight Pruning](https://mlsanity.com/paper/2001.00138/) (2020)
- [YOLObile: Real-Time Object Detection on Mobile Devices via Compression-Compilation Co-Design](https://mlsanity.com/paper/2009.05697/) (2020)
- [Localization-aware Channel Pruning for Object Detection](https://mlsanity.com/paper/1911.02237/) (2019)
- [SONIC: A Sparse Neural Network Inference Accelerator with Silicon Photonics for Energy-Efficient Deep Learning](https://mlsanity.com/paper/2109.04459/) (2021)
- [LATTE: LSTM Self-Attention based Anomaly Detection in Embedded Automotive Platforms](https://mlsanity.com/paper/2107.05561/) (2021)
- [Roadmap for Cybersecurity in Autonomous Vehicles](https://mlsanity.com/paper/2201.10349/) (2022)
- [Robust Perception Architecture Design for Automotive Cyber-Physical Systems](https://mlsanity.com/paper/2205.08067/) (2022)

## Built on by (most cited first, 4 of 4)

- [Online Robot Navigation and Manipulation with Distilled Vision-Language Models](https://mlsanity.com/paper/2401.17083/) (2024)
- [Optical Computing for Deep Neural Network Acceleration: Foundations, Recent Developments, and Emerging Directions](https://mlsanity.com/paper/2407.21184/) (2024)
- [UPAQ: A Framework for Real-Time and Energy-Efficient 3D Object Detection in Autonomous Vehicles](https://mlsanity.com/paper/2501.04213/) (2025)
- [A Novel Compression Framework for YOLOv8: Achieving Real-Time Aerial Object Detection on Edge Devices via Structured Pruning and Channel-Wise Distillation](https://mlsanity.com/paper/2509.12918/) (2025)

## Abstract (arXiv)

Object detectors used in autonomous vehicles can have high memory and computational overheads. In this paper, we introduce a novel semi-structured pruning framework called R-TOSS that overcomes the shortcomings of state-of-the-art model pruning techniques. Experimental results on the JetsonTX2 show that R-TOSS has a compression rate of 4.4x on the YOLOv5 object detector with a 2.15x speedup in inference time and 57.01% decrease in energy usage. R-TOSS also enables 2.89x compression on RetinaNet with a 1.86x speedup in inference time and 56.31% decrease in energy usage. We also demonstrate significant improvements compared to various state-of-the-art pruning techniques.