LFX: Towards Unified Light Field Dense Semantic Segmentation and Salient Object Detection
Not on the map. Why?
Abstract (arXiv)
Light field cameras capture multi-view observations within a single exposure. However, existing studies are typically tailored to specific LF representations, leaving the field without a unified learning framework. To bridge this gap, we present LFX, the first unified framework for LF perception. LFX establishes a representation-invariant feature modulation space, enabling it to adapt to heterogeneous LF representations and diverse perception tasks. Specifically, we propose Field-of-Parallax Angular Subspace Modeling (FoP-ASM), which assigns an independent angular marker to each auxiliary view, enabling view-wise independent modeling. Meanwhile, shared manifold subspace constraints and regularization losses enforce globally consistent semantic modulation across views. Extensive evaluations across three LF benchmarks show that LFX achieves state-of-the-art results across distinct LF representations, outperforming representation-specific methods by up to 12% and 20% with 0.029/0.027 MAE for salient object detection, and achieving 84.37 mIoU for semantic segmentation. The source code will be made publicly available at https://github.com/FeiT-FeiTeng/LFX.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 30 of its 74 references that are in the map. First posted on arXiv 2 Mar 2025.
Builds on
30 of 74 references.
References · 30
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
- 2021SegFormer: Simple and Efficient Design for Semantic Segmentation with Transformerscited by 2,923
- 2016Pyramid Scene Parsing Networkcited by 2,472
- 2021Pyramid Vision Transformer: A Versatile Backbone for Dense Prediction without Convolutionscited by 1,960
- 2022Visual Prompt Tuningcited by 1,674
- 2019Deep High-Resolution Representation Learning for Visual Recognitioncited by 1,417
- 2022AdaptFormer: Adapting Vision Transformers for Scalable Visual Recognitioncited by 714
- 2019Segmentation Transformer: Object-Contextual Representations for Semantic Segmentationcited by 573
- 2022Vision Transformer Adapter for Dense Predictionscited by 564
- 2020Understanding the Behaviour of Contrastive Losscited by 397
- 2022CMX: Cross-Modal Fusion for RGB-X Semantic Segmentation with Transformerscited by 229
18 more
- 2022ST-Adapter: Parameter-Efficient Image-to-Video Transfer Learningcited by 192
- 2021MPViT: Multi-Path Vision Transformer for Dense Predictioncited by 122
- 2023Delivering Arbitrary-Modal Semantic Segmentationcited by 115
- 2024Sigma: Siamese Mamba Network for Multi-Modal Semantic Segmentationcited by 71
- 2024ViT-CoMer: Vision Transformer with Convolutional Multi-scale Feature Interaction for Dense Predictionscited by 65
- 2024StitchFusion: Weaving Any Visual Modalities to Enhance Multimodal Semantic Segmentationcited by 38
- 2024Multi-Scale and Detail-Enhanced Segment Anything Model for Salient Object Detectioncited by 29
- 2024Parameter-Efficient Fine-Tuning for Pre-Trained Vision Models: A Survey and Benchmarkcited by 21
- 2024A social path to human-like artificial intelligencecited by 20
- 2020Light Field Salient Object Detection: A Review and Benchmarkcited by 19
- 2021Light Field Saliency Detection with Dual Local Graph Learning andReciprocative Guidancecited by 12
- 2019Light Field Saliency Detection with Deep Convolutional Networkscited by 10
- 2020DUT-LFSaliency: Versatile Dataset and Light Field-to-RGB Saliency Detectioncited by 6
- 2022LeNo: Adversarial Robust Salient Object Detection Networks with Learnable Noisecited by 4
- 2023Guided Focal Stack Refinement Network for Light Field Salient Object Detectioncited by 3
- 2024LFSamba: Marry SAM with Mamba for Light Field Salient Object Detectioncited by 2
- 2023OAFuser: Towards Omni-Aperture Fusion for Light Field Semantic Segmentationcited by 1
- 2024LF Tracy: A Unified Single-Pipeline Approach for Salient Object Detection in Light Field Camerascited by 1
Built on by
Not cited yet.