mlsanityData to 7 Oct 2026

Vision-Reasoning-Guided Occlusion Removal from Light Fields

arXiv 2606.19985 ↗First posted 18 Jun 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Occlusion-robust scene recovery remains a major challenge in computational imaging, particularly where dense vegetation severely limits visibility. We propose a visionreasoning-guided light field occlusion removal framework combining light field integration (LFI) with vision-language model (VLM) semantic reasoning. Multi-view observations are first integrated via LFI to suppress foreground occlusions, producing an initial visibility-enhanced representation, a VLM then acts as a conditional semantic prior to restore degraded structures and fine details. A multi-sample fusion strategy aggregates multiple generated hypotheses to improve consistency and reduce hallucination. Experimental results on synthetic and real-world datasets show state-of-the-art performance, achieving the highest average SSIM across four synthetic benchmark scenes (4-Syn) and strong generalization across structured and unstructured acquisition settings, with applicability to search-and-rescue and exploratory robotic navigation.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 48 of its 86 references that are in the map. First posted on arXiv 18 Jun 2026.

Builds on

48 of 86 references.

References · 48

  1. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
  2. 2022Generative Adversarial Networkscited by 5,603
  3. 2025VGGT: Visual Geometry Grounded Transformercited by 1,475
  4. 2016Context Encoders: Feature Learning by Inpaintingcited by 1,424
  5. 2022RePaint: Inpainting using Denoising Diffusion Probabilistic Modelscited by 1,419
  6. 2025Qwen-Image Technical Reportcited by 973
  7. 2025SAM 3: Segment Anything with Conceptscited by 835
  8. 2025Depth Anything 3: Recovering the Visual Space from Any Viewscited by 626
  9. 2018Free-Form Image Inpainting with Gated Convolutioncited by 594
  10. 2018Generative Image Inpainting with Contextual Attentioncited by 578
  11. 2018Image Inpainting for Irregular Holes Using Partial Convolutionscited by 505
  12. 2022Observation-Centric SORT: Rethinking SORT for Robust Multi-Object Trackingcited by 345
36 more
  1. 2022Imagen Editor and EditBench: Advancing and Evaluating Text-Guided Image Inpaintingcited by 229
  2. 2022MAT: Mask-Aware Transformer for Large Hole Image Inpaintingcited by 216
  3. 2016Semantic Image Inpainting with Deep Generative Modelscited by 156
  4. 2022Focal Sparse Convolutional Networks for 3D Object Detectioncited by 142
  5. 2020Recurrent Feature Reasoning for Image Inpaintingcited by 107
  6. 2016High-Resolution Image Inpainting using Multi-Scale Neural Patch Synthesiscited by 89
  7. 2022Incremental Transformer Structure Enhanced Image Inpainting with Masking Positional Encodingcited by 83
  8. 2021Image Inpainting via Conditional Texture and Structure Dual Generationcited by 66
  9. 2019Image Inpainting with Learnable Bidirectional Attention Mapscited by 64
  10. 2025GPT-ImgEval: A Comprehensive Benchmark for Diagnosing GPT4o in Image Generationcited by 57
  11. 2025Pixel-Perfect Depth with Semantics-Prompted Diffusion Transformerscited by 47
  12. 2023CoordFill: Efficient High-Resolution Image Inpainting via Parameterized Coordinate Queryingcited by 34
  13. 2021An Autonomous Drone for Search and Rescue in Forests using Airborne Optical Sectioningcited by 31
  14. 2022Unified Transformer Tracker for Object Trackingcited by 31
  15. 2020Search and Rescue with Airborne Optical Sectioningcited by 20
  16. 2025Is Nano Banana Pro a Low-Level Vision All-Rounder? A Comprehensive Evaluation on 14 Tasks and 40 Datasetscited by 19
  17. 2022Learning Prior Feature and Attention Enhanced Image Inpaintingcited by 16
  18. 2019A Statistical View on Synthetic Aperture Imaging for Occlusion Removalcited by 15
  19. 2022Decompose to Adapt: Cross-domain Object Detection via Feature Disentanglementcited by 15
  20. 2020Fast Automatic Visibility Optimization for Thermal Synthetic Aperture Visualizationcited by 14
  21. 2020Pose Error Reduction for Focus Enhancement in Thermal Synthetic Aperture Visualizationcited by 13
  22. 2021Combined Person Classification with Airborne Optical Sectioningcited by 13
  23. 2021Through-Foliage Tracking with Airborne Optical Sectioningcited by 13
  24. 2019DeOccNet: Learning to See Through Foreground Occlusions in Light Fieldscited by 11
  25. 2022Inverse Airborne Optical Sectioningcited by 9
  26. 2022Evaluation of Color Anomaly Detection in Multispectral Images For Synthetic Aperture Sensingcited by 9
  27. 2024Transformer based Pluralistic Image Completion with Reduced Information Losscited by 7
  28. 2023Generative Image Inpainting with Segmentation Confusion Adversarial Training and Contrastive Learningcited by 6
  29. 2023Fusion of Single and Integral Multispectral Aerial Imagescited by 5
  30. 2023Stereoscopic Depth Perception Through Foliagecited by 3
  31. 2024An Autonomous Drone Swarm for Detecting and Tracking Anomalies among Dense Vegetationcited by 3
  32. 2025DeepForest: Sensing Into Self-Occluding Volumes of Vegetation With Aerial Imagingcited by 3
  33. 2023I See-Through You: A Framework for Removing Foreground Occlusion in Both Sparse and Dense Light Field Imagescited by 2
  34. 2025Through-Foliage Surface-Temperature Reconstruction for Early Wildfire Detectioncited by 2
  35. 2025Light Field Super-Resolution: A Critical Review on Challenges and Opportunitiescited by 1
  36. 2025How Robot Dogs See the Unseeable: Improving Visual Interpretability via Peering for Exploratory Robotscited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 20253D-R1: Enhancing Reasoning in 3D VLMs for Unified Scene Understanding
  2. 2026Occ-VLM: Occupancy Grounded Vision Language Model for Indoor Scene Understanding
  3. 2026GuideGround: VLM-guided Semantic Understanding and Viewpoint-aware Reasoning for 3D Visual Grounding
  4. 2025CAPTURe: Evaluating Spatial Reasoning in Vision Language Models via Occluded Object Counting
  5. 2025Bridging Semantics and Geometry: A Decoupled LVLM-SAM Framework for Reasoning Segmentation in Optical Remote Sensing
  6. 2025VLScene: Vision-Language Guidance Distillation for Camera-Based 3D Semantic Scene Completion
  7. 2026OVIP-SG: Open-Vocabulary Instance-Preserving Scene Graphs for Mapping and Retrieval of Small, Fine-Grained Objects ↗
  8. 2026SparseOccVLA: Bridging Occupancy and Vision-Language Models via Sparse Queries for Unified 4D Scene Understanding and Planning