DCA-MoE: Spatially Adaptive Cross-Layer Fusion and Density-Routed Experts for Crowd Counting
On the map: Mixture-of-experts → Vision mixture-of-experts
Abstract (arXiv)
Crowd counting must recover reliable local density under severe variations in perspective, head scale, occlusion, and background clutter. Although modern counting objectives provide strong spatial supervision, many multi-level decoders still use spatially invariant feature fusion and apply one receptive-field pattern to every location. We propose DCA-MoE, a framework that makes both decisions content dependent while retaining a frozen DINOv3 encoder. Spatially Adaptive Layer Fusion (SALF) predicts position-wise weights over four aligned backbone features, and Density-Routed Multi-Receptive-Field Experts (DR-MoE) assigns each location a soft mixture of local, mid-range, and large-context residual experts. An EBC-style head reconstructs block density, while DMCount supervision and an auxiliary routing-balance term train the decoder without updating the backbone. On the NWPU-Crowd validation split, the strongest paired configuration, based on DINOv3 ViT-L/16, obtains 31.7 MAE and 72.2 RMSE; the matched ViT-B/16 full model obtains a paired 32.2/75.9. Cross-dataset results remain mixed, and several component baselines currently report independently selected minima from a single seed. The evidence therefore supports the feasibility of spatially adaptive fusion and routing, while broader paired and multi-seed evaluation remains necessary for causal attribution.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Vision mixture-of-experts, one of 12 directions in Mixture-of-experts. Builds on 27 of its 33 references that are in the map. First posted on arXiv 15 Aug 2026.
Builds on
27 of 33 references.
Closest ancestors · 1
Same direction, newest first
Other references · 26
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
- 2016Feature Pyramid Networks for Object Detectioncited by 5,021
- 2022A ConvNet for the 2020scited by 3,545
- 2017Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layercited by 3,413
- 2021Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsitycited by 3,014
- 2025DINOv3cited by 1,297
- 2019Dynamic Convolution: Attention over Convolution Kernelscited by 355
- 2018CSRNet: Dilated Convolutional Neural Networks for Understanding the Highly Congested Scenescited by 267
- 2018Composition Loss for Counting, Density Map Estimation and Localization in Dense Crowdscited by 186
14 more
- 2019Bayesian Loss for Crowd Count Estimation with Point Supervisioncited by 162
- 2021Rethinking Counting and Localization in Crowds:A Purely Point-Based Frameworkcited by 152
- 2020NWPU-Crowd: A Large-Scale Benchmark for Crowd Counting and Localizationcited by 151
- 2018Context-Aware Crowd Countingcited by 150
- 2020Distribution Matching for Crowd Countingcited by 143
- 2023CLIP-Count: Towards Text-Guided Zero-Shot Object Countingcited by 82
- 2022An End-to-End Transformer Model for Crowd Localizationcited by 74
- 2022Boosting Crowd Counting via Multifaceted Attentioncited by 73
- 2019From Open Set to Closed Set: Counting Objects by Spatial Divide-and-Conquercited by 48
- 2023CrowdCLIP: Unsupervised Crowd Counting via Vision-Language Modelcited by 47
- 2023STEERER: Resolving Scale Variations for Counting and Localization via Selective Inheritance Learningcited by 41
- 2023Regressor-Segmenter Mutual Prompt Learning for Crowd Countingcited by 16
- 2022FusionCount: Efficient Crowd Counting via Multiscale Feature Fusioncited by 13
- 2024CLIP-EBC: CLIP Can Count Accurately through Enhanced Blockwise Classificationcited by 12
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026CrowdCue: Specialist-Cue Conditioning for Vision-Language Crowd Counting
- 2024Multi-modal Crowd Counting via a Broker Modality
- 2024VMambaCC: A Visual State Space Model for Crowd Counting
- 2026ABACUS: Adapting Unified Foundation Model for Bridging Image Count Understanding and Generation
- 2024Diffusion-based Data Augmentation for Object Counting Problems
- 2023CrowdDiff: Multi-hypothesis Crowd Density Estimation using Diffusion Models
- 2023SYRAC: Synthesize, Rank, and Count
- 2026Dense Point-to-Mask Optimization with Reinforced Point Selection for Crowd Instance Segmentation