Vision-Reasoning-Guided Occlusion Removal from Light Fields
Not on the map. Why?
Abstract (arXiv)
Occlusion-robust scene recovery remains a major challenge in computational imaging, particularly where dense vegetation severely limits visibility. We propose a visionreasoning-guided light field occlusion removal framework combining light field integration (LFI) with vision-language model (VLM) semantic reasoning. Multi-view observations are first integrated via LFI to suppress foreground occlusions, producing an initial visibility-enhanced representation, a VLM then acts as a conditional semantic prior to restore degraded structures and fine details. A multi-sample fusion strategy aggregates multiple generated hypotheses to improve consistency and reduce hallucination. Experimental results on synthetic and real-world datasets show state-of-the-art performance, achieving the highest average SSIM across four synthetic benchmark scenes (4-Syn) and strong generalization across structured and unstructured acquisition settings, with applicability to search-and-rescue and exploratory robotic navigation.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 48 of its 86 references that are in the map. First posted on arXiv 18 Jun 2026.
Builds on
48 of 86 references.
References · 48
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
- 2022Generative Adversarial Networkscited by 5,603
- 2025VGGT: Visual Geometry Grounded Transformercited by 1,475
- 2016Context Encoders: Feature Learning by Inpaintingcited by 1,424
- 2022RePaint: Inpainting using Denoising Diffusion Probabilistic Modelscited by 1,419
- 2025Qwen-Image Technical Reportcited by 973
- 2025SAM 3: Segment Anything with Conceptscited by 835
- 2025Depth Anything 3: Recovering the Visual Space from Any Viewscited by 626
- 2018Free-Form Image Inpainting with Gated Convolutioncited by 594
- 2018Generative Image Inpainting with Contextual Attentioncited by 578
- 2018Image Inpainting for Irregular Holes Using Partial Convolutionscited by 505
- 2022Observation-Centric SORT: Rethinking SORT for Robust Multi-Object Trackingcited by 345
36 more
- 2022Imagen Editor and EditBench: Advancing and Evaluating Text-Guided Image Inpaintingcited by 229
- 2022MAT: Mask-Aware Transformer for Large Hole Image Inpaintingcited by 216
- 2016Semantic Image Inpainting with Deep Generative Modelscited by 156
- 2022Focal Sparse Convolutional Networks for 3D Object Detectioncited by 142
- 2020Recurrent Feature Reasoning for Image Inpaintingcited by 107
- 2016High-Resolution Image Inpainting using Multi-Scale Neural Patch Synthesiscited by 89
- 2022Incremental Transformer Structure Enhanced Image Inpainting with Masking Positional Encodingcited by 83
- 2021Image Inpainting via Conditional Texture and Structure Dual Generationcited by 66
- 2019Image Inpainting with Learnable Bidirectional Attention Mapscited by 64
- 2025GPT-ImgEval: A Comprehensive Benchmark for Diagnosing GPT4o in Image Generationcited by 57
- 2025Pixel-Perfect Depth with Semantics-Prompted Diffusion Transformerscited by 47
- 2023CoordFill: Efficient High-Resolution Image Inpainting via Parameterized Coordinate Queryingcited by 34
- 2021An Autonomous Drone for Search and Rescue in Forests using Airborne Optical Sectioningcited by 31
- 2022Unified Transformer Tracker for Object Trackingcited by 31
- 2020Search and Rescue with Airborne Optical Sectioningcited by 20
- 2025Is Nano Banana Pro a Low-Level Vision All-Rounder? A Comprehensive Evaluation on 14 Tasks and 40 Datasetscited by 19
- 2022Learning Prior Feature and Attention Enhanced Image Inpaintingcited by 16
- 2019A Statistical View on Synthetic Aperture Imaging for Occlusion Removalcited by 15
- 2022Decompose to Adapt: Cross-domain Object Detection via Feature Disentanglementcited by 15
- 2020Fast Automatic Visibility Optimization for Thermal Synthetic Aperture Visualizationcited by 14
- 2020Pose Error Reduction for Focus Enhancement in Thermal Synthetic Aperture Visualizationcited by 13
- 2021Combined Person Classification with Airborne Optical Sectioningcited by 13
- 2021Through-Foliage Tracking with Airborne Optical Sectioningcited by 13
- 2019DeOccNet: Learning to See Through Foreground Occlusions in Light Fieldscited by 11
- 2022Inverse Airborne Optical Sectioningcited by 9
- 2022Evaluation of Color Anomaly Detection in Multispectral Images For Synthetic Aperture Sensingcited by 9
- 2024Transformer based Pluralistic Image Completion with Reduced Information Losscited by 7
- 2023Generative Image Inpainting with Segmentation Confusion Adversarial Training and Contrastive Learningcited by 6
- 2023Fusion of Single and Integral Multispectral Aerial Imagescited by 5
- 2023Stereoscopic Depth Perception Through Foliagecited by 3
- 2024An Autonomous Drone Swarm for Detecting and Tracking Anomalies among Dense Vegetationcited by 3
- 2025DeepForest: Sensing Into Self-Occluding Volumes of Vegetation With Aerial Imagingcited by 3
- 2023I See-Through You: A Framework for Removing Foreground Occlusion in Both Sparse and Dense Light Field Imagescited by 2
- 2025Through-Foliage Surface-Temperature Reconstruction for Early Wildfire Detectioncited by 2
- 2025Light Field Super-Resolution: A Critical Review on Challenges and Opportunitiescited by 1
- 2025How Robot Dogs See the Unseeable: Improving Visual Interpretability via Peering for Exploratory Robotscited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 20253D-R1: Enhancing Reasoning in 3D VLMs for Unified Scene Understanding
- 2026Occ-VLM: Occupancy Grounded Vision Language Model for Indoor Scene Understanding
- 2026GuideGround: VLM-guided Semantic Understanding and Viewpoint-aware Reasoning for 3D Visual Grounding
- 2025CAPTURe: Evaluating Spatial Reasoning in Vision Language Models via Occluded Object Counting
- 2025Bridging Semantics and Geometry: A Decoupled LVLM-SAM Framework for Reasoning Segmentation in Optical Remote Sensing
- 2025VLScene: Vision-Language Guidance Distillation for Camera-Based 3D Semantic Scene Completion
- 2026OVIP-SG: Open-Vocabulary Instance-Preserving Scene Graphs for Mapping and Retrieval of Small, Fine-Grained Objects ↗
- 2026SparseOccVLA: Bridging Occupancy and Vision-Language Models via Sparse Queries for Unified 4D Scene Understanding and Planning