mlsanityData to 14 Oct 2026

Improved Vision-to-Chart Buoy Association with Learned World-to-Image Projection

arXiv 2605.22942 ↗First posted 21 May 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

This report presents a lightweight modification to the DETR-based fusion transformer baseline for the MaCVi 2026 Vision-to-Chart data association challenge. The challenge baseline decoder receives per-buoy queries encoding world-space distance and bearing, forcing the transformer to implicitly learn the complex geometric projection from world coordinates to image pixels. Instead, this work trains an additional dedicated MLP, QueryMLP, to explicitly predict the buoy's waterline contact point in the image from chart measurements and IMU orientation data. The predicted pixel coordinates are appended to the baseline decoder query vector, providing a direct spatial prior per buoy and reducing the geometric reasoning burden on the transformer decoder. On the challenge leaderboard, the presented approach achieves an Overall score of 0.7386, with F1 = 0.8055 and mIoU = 0.6718, on the held-out test set, placing second among all submissions.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 3 of its 4 references that are in the map. First posted on arXiv 21 May 2026.

Builds on

3 of 4 references.

References · 3

  1. 2020End-to-End Object Detection with Transformerscited by 7,414
  2. 2024Real-time Ship Recognition and Georeferencing for the Improvement of Maritime Situational Awarenesscited by 2
  3. 2025Real-Time Fusion of Visual and Chart Data for Enhanced Maritime Visioncited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2024Orca: Ocean Significant Wave Height Estimation with Spatio-temporally Aware Large Language Models
  2. 2025Da Yu: Towards USV-Based Image Captioning for Waterway Surveillance and Scene Understanding
  3. 2026Increasing the Efficiency of DETR for Maritime High-Resolution Images
  4. 2024Knowledge Distillation in YOLOX-ViT for Side-Scan Sonar Object Detection
  5. 2024Robust Monocular Visual Odometry using Curriculum Learning
  6. 2026StereoAdapter-2: Globally Structure-Consistent Underwater Stereo Depth Estimation
  7. 2023Knowledge Distillation for Feature Extraction in Underwater VSLAM
  8. 2025Knowledge Distillation for Underwater Feature Extraction and Matching via GAN-synthesized Images