Dual-Domain Representation Alignment: Bridging 2D and 3D Vision via Geometry-Aware Architecture Search
Not on the map. Why?
Abstract (arXiv)
Modern computer vision requires balancing predictive accuracy with real-time efficiency, yet the high inference cost of large vision models (LVMs) limits deployment on resource-constrained edge devices. Although Evolutionary Neural Architecture Search (ENAS) is well suited for multi-objective optimization, its practical use is hindered by two issues: expensive candidate evaluation and ranking inconsistency among subnetworks. To address them, we propose EvoNAS, an efficient distributed framework for multi-objective evolutionary architecture search. We build a hybrid supernet that integrates Vision State Space and Vision Transformer (VSS-ViT) modules, and optimize it with a Cross-Architecture Dual-Domain Knowledge Distillation (CA-DDKD) strategy. By coupling the computational efficiency of VSS blocks with the semantic expressiveness of ViT modules, CA-DDKD improves the representational capacity of the shared supernet and enhances ranking consistency, enabling reliable fitness estimation during evolution without extra fine-tuning. To reduce the cost of large-scale validation, we further introduce a Distributed Multi-Model Parallel Evaluation (DMMPE) framework based on GPU resource pooling and asynchronous scheduling. Compared with conventional data-parallel evaluation, DMMPE improves efficiency by over 70% through concurrent multi-GPU, multi-model execution. Experiments on COCO, ADE20K, KITTI, and NYU-Depth v2 show that the searched architectures, termed EvoNets, consistently achieve Pareto-optimal trade-offs between accuracy and efficiency. Compared with representative CNN-, ViT-, and Mamba-based models, EvoNets deliver lower inference latency and higher throughput under strict computational budgets while maintaining strong generalization on downstream tasks such as novel view synthesis. Code is available at https://github.com/EMI-Group/evonas
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 59 of its 83 references that are in the map. First posted on arXiv 20 Mar 2026.
Builds on
59 of 83 references.
References · 59
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2014Microsoft COCO: Common Objects in Contextcited by 17,498
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
- 2014ImageNet Large Scale Visual Recognition Challengecited by 8,441
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
- 2017Mask R-CNNcited by 7,259
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
- 2022A ConvNet for the 2020scited by 3,545
- 2021Vision Transformers for Dense Predictioncited by 1,789
- 2020pixelNeRF: Neural Radiance Fields from One or Few Imagescited by 1,574
- 2024Depth Anything V2cited by 1,385
- 2018Unified Perceptual Parsing for Scene Understandingcited by 1,265
38 more
- 2014Depth Map Prediction from a Single Image using a Multi-Scale Deep Networkcited by 1,264
- 2017Learning Transferable Architectures for Scalable Image Recognitioncited by 1,097
- 2024VMamba: Visual State Space Modelcited by 955
- 2018Regularized Evolution for Image Classifier Architecture Searchcited by 902
- 2018Efficient Neural Architecture Search via Parameter Sharingcited by 831
- 2019Once-for-All: Train One Network and Specialize it for Efficient Deploymentcited by 778
- 2021PVT v2: Improved Baselines with Pyramid Vision Transformercited by 749
- 2023pixelSplat: 3D Gaussian Splats from Image Pairs for Scalable Generalizable 3D Reconstructioncited by 668
- 2025Depth Anything 3: Recovering the Visual Space from Any Viewscited by 626
- 2020AdaBins: Depth Estimation using Adaptive Binscited by 596
- 2022Vision Transformer Adapter for Dense Predictionscited by 564
- 2024MVSplat: Efficient 3D Gaussian Splatting from Sparse Multi-View Imagescited by 553
- 2019From Big to Small: Multi-Scale Local Planar Guidance for Monocular Depth Estimationcited by 379
- 2016Unsupervised CNN for Single View Depth Estimation: Geometry to the Rescuecited by 368
- 2024DepthSplat: Connecting Gaussian Splatting and Depthcited by 275
- 2019Auto-DeepLab: Hierarchical Neural Architecture Search for Semantic Image Segmentationcited by 258
- 2022Neighborhood Attention Transformercited by 235
- 2024LocalMamba: Visual State Space Model with Windowed Selective Scancited by 235
- 2022BinsFormer: Revisiting Adaptive Bins for Monocular Depth Estimationcited by 166
- 2022NeW CRFs: Neural Window Fully-connected CRFs for Monocular Depth Estimationcited by 151
- 2020A Survey on Evolutionary Neural Architecture Searchcited by 142
- 2021MPViT: Multi-Path Vision Transformer for Dense Predictioncited by 122
- 2022Generalizable Patch-Based Neural Renderingcited by 121
- 2020Strip Pooling: Rethinking Spatial Pooling for Scene Parsingcited by 114
- 2022P3Depth: Monocular Depth Estimation with a Piecewise Planarity Priorcited by 106
- 2023Learning to Render Novel Views from Wide-Baseline Stereo Pairscited by 103
- 2024Demystify Mamba in Vision: A Linear Attention Perspectivecited by 101
- 2022LocalBins: Improving Depth Estimation by Learning Local Distributionscited by 92
- 2022Attention Attention Everywhere: Monocular Depth Prediction with Skip Attentioncited by 92
- 2019DetNAS: Backbone Search for Object Detectioncited by 80
- 2023iDisc: Internal Discretization for Monocular Depth Estimationcited by 71
- 2023MuRF: Multi-Baseline Radiance Fieldscited by 70
- 2020Neural Architecture Transfercited by 59
- 2022Global-Local Path Networks for Monocular Depth Estimation with Vertical CutDepthcited by 58
- 2023IEBins: Iterative Elastic Bins for Monocular Depth Estimationcited by 53
- 2024Spatial-Mamba: Effective Visual State Space Models via Structure-aware State Fusioncited by 40
- 2021Searching the Search Space of Vision Transformercited by 39
- 2022evosax: JAX-based Evolution Strategiescited by 39
50 most cited of 59 All 59 (JSON)
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025RevoNAD: Reflective Evolutionary Exploration for Neural Architecture Design
- 2026MOSAIC: Adaptive Inter-layer Composition for Efficient Heterogeneous Vision-Language Models
- 2026Searching for Task-Specific Vision Paths: Evolutionary Block Pruning Across Vision-Language Models
- 2025Structure-Aware Cooperative Ensemble Evolutionary Optimization on Combinatorial Problems with Multimodal Large Language Models
- 2024Promoting AI Equity in Science: Generalized Domain Prompt Learning for Accessible VLM Research
- 2025ViT-Linearizer: Distilling Quadratic Knowledge into Linear-Time Vision Models
- 2026Beyond Point-Wise Matching: Structural Representation Alignment for Accelerating Diffusion Transformers
- 2026Two Sides of the Same Coin: Co-Evolving Search for Cross-Task Attacks on Vision-Language Models