Vision without Images: End-to-End Computer Vision from Single Compressive Measurements
Not on the map. Why?
Abstract (arXiv)
Snapshot Compressed Imaging (SCI) offers high-speed, low-bandwidth, and energy-efficient image acquisition, but remains challenged by low-light and low signal-to-noise ratio (SNR) conditions. Moreover, practical hardware constraints in high-resolution sensors limit the use of large frame-sized masks, necessitating smaller, hardware-friendly designs. In this work, we present a novel SCI-based computer vision framework using pseudo-random binary masks of only 8×8 in size for physically feasible implementations. At its core is CompDAE, a Compressive Denoising Autoencoder built on the STFormer architecture, designed to perform downstream tasks--such as edge detection and depth estimation--directly from noisy compressive raw pixel measurements without image reconstruction. CompDAE incorporates a rate-constrained training strategy inspired by BackSlash to promote compact, compressible models. A shared encoder paired with lightweight task-specific decoders enables a unified multi-task platform. Extensive experiments across multiple datasets demonstrate that CompDAE achieves state-of-the-art performance with significantly lower complexity, especially under ultra-low-light conditions where traditional CMOS and SCI pipelines fail.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 29 of its 70 references that are in the map. First posted on arXiv 25 Jan 2025.
Builds on
29 of 70 references.
References · 29
- 2017Attention Is All You Needcited by 60,361
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,403
- 2016The Cityscapes Dataset for Semantic Urban Scene Understandingcited by 4,444
- 2016Pyramid Scene Parsing Networkcited by 2,479
- 2013Rich feature hierarchies for accurate object detection and semantic segmentationcited by 2,162
- 2016Context Encoders: Feature Learning by Inpaintingcited by 1,428
- 2016Colorful Image Colorizationcited by 1,114
- 2017The 2017 DAVIS Challenge on Video Object Segmentationcited by 957
- 2024Metric3Dv2: A Versatile Monocular Geometric Foundation Model for Zero-shot Metric Depth and Surface Normal Estimationcited by 395
- 2024UniDepth: Universal Monocular Metric Depth Estimationcited by 382
- 2017Sparsity Invariant CNNscited by 326
17 more
- 2023MiDaS v3.1 -- A Model Zoo for Robust Monocular Relative Depth Estimationcited by 174
- 2016Richer Convolutional Features for Edge Detectioncited by 143
- 2019Dense Extreme Inception Network: Towards a Robust CNN Model for Edge Detectioncited by 104
- 2018Rank Minimization for Snapshot Compressive Imagingcited by 99
- 2020Plug-and-Play Algorithms for Large-scale Snapshot Compressive Imagingcited by 78
- 2019Bi-Directional Cascade Network for Perceptual Edge Detectioncited by 72
- 2013Coded aperture compressive temporal imagingcited by 57
- 2021Dense Deep Unfolding Network with 3D-CNN Prior for Snapshot Compressive Imagingcited by 31
- 2021Memory-Efficient Network for Large-scale Video Compressive Sensingcited by 30
- 2022Spatial-Temporal Transformer for Video Snapshot Compressive Imagingcited by 21
- 2016DeepBinaryMask: Learning a Binary Mask for Video Compressive Sensingcited by 20
- 2023EfficientSCI: Densely Connected Network with Space-time Factorization for Large-scale Video Snapshot Compressive Imagingcited by 18
- 2020Self-Supervised Poisson-Gaussian Denoisingcited by 9
- 2024Deep Optics for Video Snapshot Compressive Imagingcited by 8
- 2020Learning Model-Blind Temporal Denoisers without Ground Truthscited by 3
- 2022Two-Stage is Enough: A Concise Deep Unfolding Reconstruction Network for Flexible Video Compressive Sensingcited by 3
- 2023Theoretical Analysis of Binary Masks in Snapshot Compressive Imaging Systemscited by 2
Built on by
Not cited yet.