mlsanityData to 7 Oct 2026

LFX: Towards Unified Light Field Dense Semantic Segmentation and Salient Object Detection

arXiv 2503.00747 ↗First posted 2 Mar 2025cs.CV cs.RO eess.IVcited by 0

Not on the map. Why?

Abstract (arXiv)

Light field cameras capture multi-view observations within a single exposure. However, existing studies are typically tailored to specific LF representations, leaving the field without a unified learning framework. To bridge this gap, we present LFX, the first unified framework for LF perception. LFX establishes a representation-invariant feature modulation space, enabling it to adapt to heterogeneous LF representations and diverse perception tasks. Specifically, we propose Field-of-Parallax Angular Subspace Modeling (FoP-ASM), which assigns an independent angular marker to each auxiliary view, enabling view-wise independent modeling. Meanwhile, shared manifold subspace constraints and regularization losses enforce globally consistent semantic modulation across views. Extensive evaluations across three LF benchmarks show that LFX achieves state-of-the-art results across distinct LF representations, outperforming representation-specific methods by up to 12% and 20% with 0.029/0.027 MAE for salient object detection, and achieving 84.37 mIoU for semantic segmentation. The source code will be made publicly available at https://github.com/FeiT-FeiTeng/LFX.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 30 of its 74 references that are in the map. First posted on arXiv 2 Mar 2025.

Builds on

30 of 74 references.

References · 30

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
  3. 2021SegFormer: Simple and Efficient Design for Semantic Segmentation with Transformerscited by 2,923
  4. 2016Pyramid Scene Parsing Networkcited by 2,472
  5. 2021Pyramid Vision Transformer: A Versatile Backbone for Dense Prediction without Convolutionscited by 1,960
  6. 2022Visual Prompt Tuningcited by 1,674
  7. 2019Deep High-Resolution Representation Learning for Visual Recognitioncited by 1,417
  8. 2022AdaptFormer: Adapting Vision Transformers for Scalable Visual Recognitioncited by 714
  9. 2019Segmentation Transformer: Object-Contextual Representations for Semantic Segmentationcited by 573
  10. 2022Vision Transformer Adapter for Dense Predictionscited by 564
  11. 2020Understanding the Behaviour of Contrastive Losscited by 397
  12. 2022CMX: Cross-Modal Fusion for RGB-X Semantic Segmentation with Transformerscited by 229
18 more
  1. 2022ST-Adapter: Parameter-Efficient Image-to-Video Transfer Learningcited by 192
  2. 2021MPViT: Multi-Path Vision Transformer for Dense Predictioncited by 122
  3. 2023Delivering Arbitrary-Modal Semantic Segmentationcited by 115
  4. 2024Sigma: Siamese Mamba Network for Multi-Modal Semantic Segmentationcited by 71
  5. 2024ViT-CoMer: Vision Transformer with Convolutional Multi-scale Feature Interaction for Dense Predictionscited by 65
  6. 2024StitchFusion: Weaving Any Visual Modalities to Enhance Multimodal Semantic Segmentationcited by 38
  7. 2024Multi-Scale and Detail-Enhanced Segment Anything Model for Salient Object Detectioncited by 29
  8. 2024Parameter-Efficient Fine-Tuning for Pre-Trained Vision Models: A Survey and Benchmarkcited by 21
  9. 2024A social path to human-like artificial intelligencecited by 20
  10. 2020Light Field Salient Object Detection: A Review and Benchmarkcited by 19
  11. 2021Light Field Saliency Detection with Dual Local Graph Learning andReciprocative Guidancecited by 12
  12. 2019Light Field Saliency Detection with Deep Convolutional Networkscited by 10
  13. 2020DUT-LFSaliency: Versatile Dataset and Light Field-to-RGB Saliency Detectioncited by 6
  14. 2022LeNo: Adversarial Robust Salient Object Detection Networks with Learnable Noisecited by 4
  15. 2023Guided Focal Stack Refinement Network for Light Field Salient Object Detectioncited by 3
  16. 2024LFSamba: Marry SAM with Mamba for Light Field Salient Object Detectioncited by 2
  17. 2023OAFuser: Towards Omni-Aperture Fusion for Light Field Semantic Segmentationcited by 1
  18. 2024LF Tracy: A Unified Single-Pipeline Approach for Salient Object Detection in Light Field Camerascited by 1

Built on by

Not cited yet.