mlsanityData to 7 Oct 2026

SplitNets: Designing Neural Architectures for Efficient Distributed Computing on Head-Mounted Systems

arXiv 2204.04705 ↗First posted 10 Apr 2022cs.LG cs.AI cs.DCcited by 13

Not on the map. Why?

Abstract (arXiv)

We design deep neural networks (DNNs) and corresponding networks' splittings to distribute DNNs' workload to camera sensors and a centralized aggregator on head mounted devices to meet system performance targets in inference accuracy and latency under the given hardware resource constraints. To achieve an optimal balance among computation, communication, and performance, a split-aware neural architecture search framework, SplitNets, is introduced to conduct model designing, splitting, and communication reduction simultaneously. We further extend the framework to multi-view systems for learning to fuse inputs from multiple camera sensors with optimal performance and systemic efficiency. We validate SplitNets for single-view system on ImageNet as well as multi-view system on 3D classification, and show that the SplitNets framework achieves state-of-the-art (SOTA) performance and system latency compared with existing approaches.

Key facts. Cited by 13 papers in the map (data through 7 Oct 2026). Builds on 40 of its 66 references that are in the map. First posted on arXiv 10 Apr 2022.

Builds on

40 of 66 references.

References · 40

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
  3. 2015Distilling the Knowledge in a Neural Networkcited by 10,076
  4. 2016Densely Connected Convolutional Networkscited by 6,691
  5. 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,415
  6. 2015Rethinking the Inception Architecture for Computer Visioncited by 5,451
  7. 2018MobileNetV2: Inverted Residuals and Linear Bottleneckscited by 4,773
  8. 2015Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classificationcited by 3,590
  9. 2019Searching for MobileNetV3cited by 1,984
  10. 2016Neural Architecture Search with Reinforcement Learningcited by 1,489
  11. 2017Learning Transferable Architectures for Scalable Image Recognitioncited by 1,097
  12. 2015ORB-SLAM: a Versatile and Accurate Monocular SLAM Systemcited by 983
28 more
  1. 2020Designing Network Design Spacescited by 954
  2. 2018MnasNet: Platform-Aware Neural Architecture Search for Mobilecited by 937
  3. 2018Regularized Evolution for Image Classifier Architecture Searchcited by 902
  4. 2019Once-for-All: Train One Network and Specialize it for Efficient Deploymentcited by 778
  5. 2019Learned Step Size Quantizationcited by 604
  6. 2015Multi-view Convolutional Neural Networks for 3D Shape Recognitioncited by 564
  7. 2018HAQ: Hardware-Aware Automated Quantization with Mixed Precisioncited by 426
  8. 2019Single Path One-Shot Neural Architecture Search with Uniform Samplingcited by 411
  9. 2017Large-Scale Evolution of Image Classifierscited by 348
  10. 2020BigNAS: Scaling Up Neural Architecture Search with Big Single-Stage Modelscited by 187
  11. 2020Training with Quantization Noise for Extreme Model Compressioncited by 145
  12. 2019Additive Powers-of-Two Quantization: An Efficient Non-uniform Discretization for Neural Networkscited by 143
  13. 2020HAT: Hardware-Aware Transformers for Efficient Natural Language Processingcited by 136
  14. 2019FairNAS: Rethinking Evaluation Fairness of Weight Sharing Neural Architecture Searchcited by 129
  15. 2017Genetic CNNcited by 124
  16. 2021Split Computing and Early Exiting for Deep Learning Applications: Survey and Research Challengescited by 114
  17. 2019BottleNet++: An End-to-End Approach for Feature Compression in Device-Edge Co-Inference Systemscited by 94
  18. 2018JointDNN: An Efficient Training and Inference Engine for Intelligent Mobile Cloud Computing Servicescited by 79
  19. 2019BottleNet: A Deep Learning Architecture for Intelligent Mobile Cloud Computing Servicescited by 67
  20. 2020AttentiveNAS: Improving Neural Architecture Search via Attentive Samplingcited by 65
  21. 2018Deep feature compression for collaborative object detectioncited by 48
  22. 2020FBNetV3: Joint Architecture-Recipe Search using Predictor Pretrainingcited by 35
  23. 2018A Deeper Look at 3D Shape Classifierscited by 25
  24. 2018Auto-tuning Neural Network Quantization Framework for Collaborative Inference Between the Cloud and Edgecited by 20
  25. 2018Exploiting the Potential of Standard Convolutional Autoencoders for Image Restoration by Evolutionary Searchcited by 19
  26. 2021Lightweight compression of neural network feature tensors for collaborative intelligencecited by 17
  27. 2021Single-Training Collaborative Object Detectors Adaptive to Bandwidth and Computationcited by 6
  28. 2020Auto-MVCNN: Neural Architecture Search for Multi-view 3D Shape Recognitioncited by 3

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2022: 2; 2023: 6; 2024: 3; 2025: 1; 2026: 1.

13 papers.

Sort:

By area:

  1. 2023Bounding the Invertibility of Privacy-preserving Instance Encoding using Fisher Informationcited by 11
  2. 2023Marsellus: A Heterogeneous RISC-V AI-IoT End-Node SoC with 2-to-8b DNN Acceleration and 30%-Boost Adaptive Body Biasingcited by 8
  3. 2023PixelRNN: In-pixel Recurrent Neural Networks for End-to-end-optimized Perception with Neural Sensorscited by 6
  4. 2024Unlocking Visual Secrets: Inverting Features with Diffusion Priors for Image Reconstructioncited by 5
  5. 2022Measuring and Controlling Split Layer Privacy Leakage Using Fisher Informationcited by 3
  6. 2023Slimmable Encoders for Flexible Split DNNs in Bandwidth and Resource Constrained IoT Systemscited by 3
  7. 2023Salted Inference: Enhancing Privacy while Maintaining Efficiency of Split Inference in Mobile Computingcited by 3
  8. 2023DISCO: Distributed Inference with Sparse Communicationscited by 2
  9. 2024Edge-Only Universal Adversarial Attacks in Distributed Learningcited by 2
  10. 2024Neural Architecture Search of Hybrid Models for NPU-CIM Heterogeneous AR/VR Devicescited by 1
  11. 2022Fault-Tolerant Collaborative Inference through the Edge-PRUNE Frameworkcited by 0
  12. 2025DeepEOSNet: Capturing the dependency on thermodynamic state in property prediction taskscited by 0
1 more
  1. 2026Spectrum-Aware Bounds on Invertibility for Privacy-Enhancing Instance Encodingcited by 0