A Unified Multi-scale Deep Convolutional Neural Network for Fast Object Detection
Not on the map. Why?
Abstract (arXiv)
A unified deep neural network, denoted the multi-scale CNN (MS-CNN), is proposed for fast multi-scale object detection. The MS-CNN consists of a proposal sub-network and a detection sub-network. In the proposal sub-network, detection is performed at multiple output layers, so that receptive fields match objects of different scales. These complementary scale-specific detectors are combined to produce a strong multi-scale object detector. The unified network is learned end-to-end, by optimizing a multi-task loss. Feature upsampling by deconvolution is also explored, as an alternative to input upsampling, to reduce the memory and computation costs. State-of-the-art object detection performance, at up to 15 fps, is reported on datasets, such as KITTI and Caltech, containing a substantial number of small objects.
Key facts. Cited by 83 papers in the map (data through 7 Oct 2026). First posted on arXiv 25 Jul 2016.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 36; 2022: 25; 2023: 10; 2024: 7; 2025: 3; 2026: 2.
83 papers.
Sort:
By area:
- 2021CrossViT: Cross-Attention Multi-Scale Vision Transformer for Image Classificationcited by 806
- 2021DS-TransUNet:Dual Swin Transformer U-Net for Medical Image Segmentationcited by 126
- 2022Towards Large-Scale Small Object Detection: Survey and Benchmarkscited by 119
- 2021Graph Stacked Hourglass Networks for 3D Human Pose Estimationcited by 94
- 2022HiFormer: Hierarchical Multi-scale Representations Using Transformers for Medical Image Segmentationcited by 94
- 2021QueryDet: Cascaded Sparse Query for Accelerating High-Resolution Small Object Detectioncited by 70
- 2022Unbiased Teacher v2: Semi-supervised Object Detection for Anchor-free and Anchor-based Detectorscited by 69
- 20223D Object Detection from Images for Autonomous Driving: A Surveycited by 66
- 2022Shifting More Attention to Visual Backbone: Query-modulated Refinement Networks for End-to-End Visual Groundingcited by 52
- 2022MVSFormer: Multi-View Stereo by Learning Robust Image Features and Temperature-based Depthcited by 50
- 2022A Data-scalable Transformer for Medical Image Segmentation: Architecture, Model Efficiency, and Benchmarkcited by 45
- 20214D-Net for Learned Multi-Modal Alignmentcited by 44
38 more
- 2021Deep Learning for UAV-based Object Detection and Tracking: A Surveycited by 33
- 2022Dense Learning based Semi-Supervised Object Detectioncited by 32
- 2022Learning Visual Representation from Modality-Shared Contrastive Language-Image Pre-trainingcited by 32
- 2022Towards Efficient and Scale-Robust Ultra-High-Definition Image Demoireingcited by 30
- 2021Domain-Specific Suppression for Adaptive Object Detectioncited by 26
- 2021Pre-training strategies and datasets for facial representation learningcited by 25
- 2021Joint Visual Semantic Reasoning: Multi-Stage Decoder for Text Recognitioncited by 24
- 2024SFOD: Spiking Fusion Object Detectorcited by 19
- 2023Weakly Supervised Monocular 3D Object Detection using Multi-View Projection and Direction Consistencycited by 18
- 2021Scale-invariant scale-channel networks: Deep networks that generalise to previously unseen scalescited by 17
- 2023Cascaded Zoom-in Detector for High Resolution Aerial Imagescited by 17
- 2021Circle Representation for Medical Object Detectioncited by 15
- 2022Detection Recovery in Online Multi-Object Tracking with Sparse Graph Trackercited by 15
- 2021Local-to-Global Self-Attention in Vision Transformerscited by 13
- 2022Deep Learning Serves Traffic Safety Analysis: A Forward-looking Reviewcited by 13
- 2021AdaZoom: Adaptive Zoom Network for Multi-Scale Object Detection in Large Scenescited by 11
- 2021MogFace: Towards a Deeper Appreciation on Face Detectioncited by 9
- 2021Towards Balanced Learning for Instance Recognitioncited by 9
- 2022Efficient High-Resolution Deep Learning: A Surveycited by 9
- 2021Six-channel Image Representation for Cross-domain Object Detectioncited by 8
- 2021Progressive-Scale Boundary Blackbox Attack via Projective Gradient Estimationcited by 8
- 2022Pedestrian Detection: Domain Generalization, CNNs, Transformers and Beyondcited by 8
- 2023Riesz networks: scale invariant neural networks in a single forward passcited by 8
- 2021Few-Shot Video Object Detectioncited by 7
- 2021NMS-Loss: Learning with Non-Maximum Suppression for Crowded Pedestrian Detectioncited by 7
- 2021Two Eyes Are Better Than One: Exploiting Binocular Correlation for Diabetic Retinopathy Severity Gradingcited by 7
- 2021Multi-layered Semantic Representation Network for Multi-label Image Classificationcited by 6
- 2022Dynamic Label Assignment for Object Detection by Combining Predicted IoUs and Anchor IoUscited by 6
- 2021Scale Normalized Image Pyramids with AutoFocus for Object Detectioncited by 5
- 2022Pooling Revisited: Your Receptive Field is Suboptimalcited by 5
- 2022Transformer-based Context Condensation for Boosting Feature Pyramids in Object Detectioncited by 5
- 2022Foreground Guidance and Multi-Layer Feature Fusion for Unsupervised Object Discovery with Transformerscited by 4
- 2022Feature Calibration Network for Occluded Pedestrian Detectioncited by 4
- 2021Target Detection and Segmentation in Circular-Scan Synthetic-Aperture-Sonar Images using Semi-Supervised Convolutional Encoder-Decoderscited by 3
- 2021Box Re-Ranking: Unsupervised False Positive Suppression for Domain Adaptive Pedestrian Detectioncited by 3
- 2021A Survey on Deep Domain Adaptation and Tiny Object Detection Challenges, Techniques and Datasetscited by 3
- 2023Small but Mighty: Enhancing 3D Point Clouds Semantic Segmentation with U-Next Frameworkcited by 3
- 2024Performance Evaluation of Semi-supervised Learning Frameworks for Multi-Class Weed Detectioncited by 3
50 most cited of 83 All 83 (JSON)
- 2026ETHEREAL: A 25.6-μs/inf. Low-latency Event-driven Graph-neural-network Processor for High-resolution Vision at the Edge18 Aug 2026
- 2026Spatially Conditioned Diffusion Policy: Learning Precise and Robust Manipulation with a Single RGB Camera12 Jun 2026
- 2025All You Need for Object Detection: From Pixels, Points, and Prompts to Next-Gen Fusion and Multimodal LLMs/VLMs in Autonomous Vehicles30 Oct 2025
- 2025YOLOv11-Litchi: Efficient Litchi Fruit Detection based on UAV-Captured Agricultural Imagery in Complex Orchard Environments11 Oct 2025
- 2025DPNet: Dynamic Pooling Network for Tiny Object Detection5 May 2025
- 2024AI-based Density Recognition24 Jul 2024
- 2024GMC: A General Framework of Multi-stage Context Learning and Utilization for Visual Detection Tasks8 Jul 2024
- 2024Rethinking the Elementary Function Fusion for Single-Image Dehazing23 May 2024
- 2024Imagine the Unseen: Occluded Pedestrian Detection via Adversarial Feature Completion2 May 2024
- 2024SFOD: Spiking Fusion Object Detector22 Mar 2024
- 2024Performance Evaluation of Semi-supervised Learning Frameworks for Multi-Class Weed Detection6 Mar 2024
- 2024BAdaCost: Multi-class Boosting with Costs6 Feb 2024
38 more
- 2023Data-Driven but Privacy-Conscious: Pedestrian Dataset De-identification via Full-Body Person Synthesis20 Jun 2023
- 2023Knowledge Detection by Relevant Question and Image Attributes in Visual Question Answering8 Jun 2023
- 2023t-RAIN: Robust generalization under weather-aliasing label shift attacks15 May 2023
- 2023Riesz networks: scale invariant neural networks in a single forward pass8 May 2023
- 2023OriCon3D: Effective 3D Object Detection using Orientation and Confidence27 Apr 2023
- 2023Robust and Fast Vehicle Detection using Augmented Confidence Map27 Apr 2023
- 2023Small but Mighty: Enhancing 3D Point Clouds Semantic Segmentation with U-Next Framework3 Apr 2023
- 2023Cascaded Zoom-in Detector for High Resolution Aerial Images15 Mar 2023
- 2023Weakly Supervised Monocular 3D Object Detection using Multi-View Projection and Direction Consistency15 Mar 2023
- 2023MM-SFENet: Multi-scale Multi-task Localization and Classification of Bladder Cancer in MRI with Spatial Feature Encoder Network22 Feb 2023
- 2022Feature Calibration Network for Occluded Pedestrian Detection12 Dec 2022
- 2022CircleNet: Reciprocating Feature Adaptation for Robust Pedestrian Detection12 Dec 2022
- 2022Just a Matter of Scale? Reevaluating Scale Equivariance in Convolutional Neural Networks18 Nov 2022
- 2022Foreground Guidance and Multi-Layer Feature Fusion for Unsupervised Object Discovery with Transformers24 Oct 2022
- 2022MVSFormer: Multi-View Stereo by Learning Robust Image Features and Temperature-based Depth4 Aug 2022
- 2022Towards Large-Scale Small Object Detection: Survey and Benchmarks28 Jul 2022
- 2022Efficient High-Resolution Deep Learning: A Survey26 Jul 2022
- 2022Learning Visual Representation from Modality-Shared Contrastive Language-Image Pre-training26 Jul 2022
- 2022Towards Efficient and Scale-Robust Ultra-High-Definition Image Demoireing20 Jul 2022
- 2022HiFormer: Hierarchical Multi-scale Representations Using Transformers for Medical Image Segmentation18 Jul 2022
- 2022Transformer-based Context Condensation for Boosting Feature Pyramids in Object Detection14 Jul 2022
- 2022Should All Proposals be Treated Equally in Object Detection?7 Jul 2022
- 2022Unbiased Teacher v2: Semi-supervised Object Detection for Anchor-free and Anchor-based Detectors19 Jun 2022
- 2022Deep Learning Techniques for Visual Counting7 Jun 2022
- 2022Pooling Revisited: Your Receptive Field is Suboptimal30 May 2022
- 2022Domain Adaptation for Object Detection using SE Adaptors and Center Loss25 May 2022
- 2022Detection Recovery in Online Multi-Object Tracking with Sparse Graph Tracker2 May 2022
- 2022Dense Learning based Semi-Supervised Object Detection15 Apr 2022
- 2022Shifting More Attention to Visual Backbone: Query-modulated Refinement Networks for End-to-End Visual Grounding29 Mar 2022
- 2022Knee arthritis severity measurement using deep learning: a publicly available algorithm with a multi-institutional validation showing radiologist-level performance16 Mar 2022
- 2022Deep Learning Serves Traffic Safety Analysis: A Forward-looking Review7 Mar 2022
- 2022A Data-scalable Transformer for Medical Image Segmentation: Architecture, Model Efficiency, and Benchmark28 Feb 2022
- 20223D Object Detection from Images for Autonomous Driving: A Survey7 Feb 2022
- 2022Dynamic Label Assignment for Object Detection by Combining Predicted IoUs and Anchor IoUs23 Jan 2022
- 2022Pedestrian Detection: Domain Generalization, CNNs, Transformers and Beyond10 Jan 2022
- 2021Pedestrian Detection by Exemplar-Guided Contrastive Learning17 Nov 2021
- 2021Hierarchical Image Classification with A Literally Toy Dataset1 Nov 2021
- 2021Beyond Classification: Knowledge Distillation using Multi-Object Impressions27 Oct 2021
50 newest of 83 All 83 (JSON)
- 2021CrossViT: Cross-Attention Multi-Scale Vision Transformer for Image Classificationcited by 806
- 2021DS-TransUNet:Dual Swin Transformer U-Net for Medical Image Segmentationcited by 126
- 2022Towards Large-Scale Small Object Detection: Survey and Benchmarkscited by 119
- 2021Graph Stacked Hourglass Networks for 3D Human Pose Estimationcited by 94
- 2022HiFormer: Hierarchical Multi-scale Representations Using Transformers for Medical Image Segmentationcited by 94
- 2021QueryDet: Cascaded Sparse Query for Accelerating High-Resolution Small Object Detectioncited by 70
- 2022Unbiased Teacher v2: Semi-supervised Object Detection for Anchor-free and Anchor-based Detectorscited by 69
- 20223D Object Detection from Images for Autonomous Driving: A Surveycited by 66
- 2022MVSFormer: Multi-View Stereo by Learning Robust Image Features and Temperature-based Depthcited by 50
- 2022A Data-scalable Transformer for Medical Image Segmentation: Architecture, Model Efficiency, and Benchmarkcited by 45
- 20214D-Net for Learned Multi-Modal Alignmentcited by 44
- 2021Deep Learning for UAV-based Object Detection and Tracking: A Surveycited by 33
12 most cited of 80 All 80 (JSON)
- 2026ETHEREAL: A 25.6-μs/inf. Low-latency Event-driven Graph-neural-network Processor for High-resolution Vision at the Edge18 Aug 2026
- 2025YOLOv11-Litchi: Efficient Litchi Fruit Detection based on UAV-Captured Agricultural Imagery in Complex Orchard Environments11 Oct 2025
- 2025DPNet: Dynamic Pooling Network for Tiny Object Detection5 May 2025
- 2024AI-based Density Recognition24 Jul 2024
- 2024GMC: A General Framework of Multi-stage Context Learning and Utilization for Visual Detection Tasks8 Jul 2024
- 2024Rethinking the Elementary Function Fusion for Single-Image Dehazing23 May 2024
- 2024Imagine the Unseen: Occluded Pedestrian Detection via Adversarial Feature Completion2 May 2024
- 2024SFOD: Spiking Fusion Object Detector22 Mar 2024
- 2024Performance Evaluation of Semi-supervised Learning Frameworks for Multi-Class Weed Detection6 Mar 2024
- 2024BAdaCost: Multi-class Boosting with Costs6 Feb 2024
- 2023Data-Driven but Privacy-Conscious: Pedestrian Dataset De-identification via Full-Body Person Synthesis20 Jun 2023
- 2023Knowledge Detection by Relevant Question and Image Attributes in Visual Question Answering8 Jun 2023
12 newest of 80 All 80 (JSON)