mlsanityData to 7 Oct 2026

Dual-Domain Representation Alignment: Bridging 2D and 3D Vision via Geometry-Aware Architecture Search

arXiv 2603.19563 ↗First posted 20 Mar 2026cs.CV cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Modern computer vision requires balancing predictive accuracy with real-time efficiency, yet the high inference cost of large vision models (LVMs) limits deployment on resource-constrained edge devices. Although Evolutionary Neural Architecture Search (ENAS) is well suited for multi-objective optimization, its practical use is hindered by two issues: expensive candidate evaluation and ranking inconsistency among subnetworks. To address them, we propose EvoNAS, an efficient distributed framework for multi-objective evolutionary architecture search. We build a hybrid supernet that integrates Vision State Space and Vision Transformer (VSS-ViT) modules, and optimize it with a Cross-Architecture Dual-Domain Knowledge Distillation (CA-DDKD) strategy. By coupling the computational efficiency of VSS blocks with the semantic expressiveness of ViT modules, CA-DDKD improves the representational capacity of the shared supernet and enhances ranking consistency, enabling reliable fitness estimation during evolution without extra fine-tuning. To reduce the cost of large-scale validation, we further introduce a Distributed Multi-Model Parallel Evaluation (DMMPE) framework based on GPU resource pooling and asynchronous scheduling. Compared with conventional data-parallel evaluation, DMMPE improves efficiency by over 70% through concurrent multi-GPU, multi-model execution. Experiments on COCO, ADE20K, KITTI, and NYU-Depth v2 show that the searched architectures, termed EvoNets, consistently achieve Pareto-optimal trade-offs between accuracy and efficiency. Compared with representative CNN-, ViT-, and Mamba-based models, EvoNets deliver lower inference latency and higher throughput under strict computational budgets while maintaining strong generalization on downstream tasks such as novel view synthesis. Code is available at https://github.com/EMI-Group/evonas

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 59 of its 83 references that are in the map. First posted on arXiv 20 Mar 2026.

Builds on

59 of 83 references.

References · 59

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2014Microsoft COCO: Common Objects in Contextcited by 17,498
  3. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
  4. 2014ImageNet Large Scale Visual Recognition Challengecited by 8,441
  5. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
  6. 2017Mask R-CNNcited by 7,259
  7. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
  8. 2022A ConvNet for the 2020scited by 3,545
  9. 2021Vision Transformers for Dense Predictioncited by 1,789
  10. 2020pixelNeRF: Neural Radiance Fields from One or Few Imagescited by 1,574
  11. 2024Depth Anything V2cited by 1,385
  12. 2018Unified Perceptual Parsing for Scene Understandingcited by 1,265
38 more
  1. 2014Depth Map Prediction from a Single Image using a Multi-Scale Deep Networkcited by 1,264
  2. 2017Learning Transferable Architectures for Scalable Image Recognitioncited by 1,097
  3. 2024VMamba: Visual State Space Modelcited by 955
  4. 2018Regularized Evolution for Image Classifier Architecture Searchcited by 902
  5. 2018Efficient Neural Architecture Search via Parameter Sharingcited by 831
  6. 2019Once-for-All: Train One Network and Specialize it for Efficient Deploymentcited by 778
  7. 2021PVT v2: Improved Baselines with Pyramid Vision Transformercited by 749
  8. 2023pixelSplat: 3D Gaussian Splats from Image Pairs for Scalable Generalizable 3D Reconstructioncited by 668
  9. 2025Depth Anything 3: Recovering the Visual Space from Any Viewscited by 626
  10. 2020AdaBins: Depth Estimation using Adaptive Binscited by 596
  11. 2022Vision Transformer Adapter for Dense Predictionscited by 564
  12. 2024MVSplat: Efficient 3D Gaussian Splatting from Sparse Multi-View Imagescited by 553
  13. 2019From Big to Small: Multi-Scale Local Planar Guidance for Monocular Depth Estimationcited by 379
  14. 2016Unsupervised CNN for Single View Depth Estimation: Geometry to the Rescuecited by 368
  15. 2024DepthSplat: Connecting Gaussian Splatting and Depthcited by 275
  16. 2019Auto-DeepLab: Hierarchical Neural Architecture Search for Semantic Image Segmentationcited by 258
  17. 2022Neighborhood Attention Transformercited by 235
  18. 2024LocalMamba: Visual State Space Model with Windowed Selective Scancited by 235
  19. 2022BinsFormer: Revisiting Adaptive Bins for Monocular Depth Estimationcited by 166
  20. 2022NeW CRFs: Neural Window Fully-connected CRFs for Monocular Depth Estimationcited by 151
  21. 2020A Survey on Evolutionary Neural Architecture Searchcited by 142
  22. 2021MPViT: Multi-Path Vision Transformer for Dense Predictioncited by 122
  23. 2022Generalizable Patch-Based Neural Renderingcited by 121
  24. 2020Strip Pooling: Rethinking Spatial Pooling for Scene Parsingcited by 114
  25. 2022P3Depth: Monocular Depth Estimation with a Piecewise Planarity Priorcited by 106
  26. 2023Learning to Render Novel Views from Wide-Baseline Stereo Pairscited by 103
  27. 2024Demystify Mamba in Vision: A Linear Attention Perspectivecited by 101
  28. 2022LocalBins: Improving Depth Estimation by Learning Local Distributionscited by 92
  29. 2022Attention Attention Everywhere: Monocular Depth Prediction with Skip Attentioncited by 92
  30. 2019DetNAS: Backbone Search for Object Detectioncited by 80
  31. 2023iDisc: Internal Discretization for Monocular Depth Estimationcited by 71
  32. 2023MuRF: Multi-Baseline Radiance Fieldscited by 70
  33. 2020Neural Architecture Transfercited by 59
  34. 2022Global-Local Path Networks for Monocular Depth Estimation with Vertical CutDepthcited by 58
  35. 2023IEBins: Iterative Elastic Bins for Monocular Depth Estimationcited by 53
  36. 2024Spatial-Mamba: Effective Visual State Space Models via Structure-aware State Fusioncited by 40
  37. 2021Searching the Search Space of Vision Transformercited by 39
  38. 2022evosax: JAX-based Evolution Strategiescited by 39

50 most cited of 59 All 59 (JSON)

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025RevoNAD: Reflective Evolutionary Exploration for Neural Architecture Design
  2. 2026MOSAIC: Adaptive Inter-layer Composition for Efficient Heterogeneous Vision-Language Models
  3. 2026Searching for Task-Specific Vision Paths: Evolutionary Block Pruning Across Vision-Language Models
  4. 2025Structure-Aware Cooperative Ensemble Evolutionary Optimization on Combinatorial Problems with Multimodal Large Language Models
  5. 2024Promoting AI Equity in Science: Generalized Domain Prompt Learning for Accessible VLM Research
  6. 2025ViT-Linearizer: Distilling Quadratic Knowledge into Linear-Time Vision Models
  7. 2026Beyond Point-Wise Matching: Structural Representation Alignment for Accelerating Diffusion Transformers
  8. 2026Two Sides of the Same Coin: Co-Evolving Search for Cross-Task Attacks on Vision-Language Models