mlsanityData to 14 Oct 2026

TriCLE: Tri-Modal Vision-Language Reasoning for Edge-Deployed Fine-Grained Clustering

arXiv 2608.04175 ↗First posted 4 Aug 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Edge platforms used for aerial observation must interpret aircraft imagery under limited memory, limited compute, and intermittent connectivity. This setting is difficult for standard RGB-only recognition models and general-purpose vision-language models, especially when calibrated thermal and LiDAR aircraft data are unavailable. We present TriCLE, an application-oriented tri-modal vision-language system for aircraft taxonomic grouping under edge constraints. From a single RGB aircraft image, TriCLE generates a structure-preserving FLIR-style thermal view and a pseudo-LiDAR depth projection, then fuses the aligned views with task instructions in a compact Qwen3-VL backbone. The model is aligned to an expert aircraft taxonomy based on propulsion, airframe family, size, design era, and configuration, so its outputs reflect engineering-relevant similarity rather than only surface appearance. We evaluate supervised fine-tuning, rotation-preserving SFT, and three policy-alignment strategies: GRPO, GSPO, and DAPO. Sequence-level GSPO gives the strongest validation performance, reaching 88.33% validation accuracy and 0.91 weighted F1 on valid aircraft outputs. On a held-out aircraft test partition, GSPO achieves 78.00% accuracy and 0.793 weighted F1 while preserving 94.00% parseable output formatting. After 4-bit quantization and attention-memory optimization, the aligned 4B model fits an 8GB deployment target and processes each tri-modal triplet in 1.48 seconds. These results support TriCLE as a practical prototype for interpretable, edge-feasible aircraft grouping, while emphasizing the need for further validation on real aligned thermal and LiDAR sensor streams.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 18 of its 20 references that are in the map. First posted on arXiv 4 Aug 2026.

Builds on

18 of 20 references.

References · 18

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,049
  3. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  4. 2023Visual Instruction Tuningcited by 7,869
  5. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
  6. 2020Unsupervised Learning of Visual Features by Contrasting Cluster Assignmentscited by 2,857
  7. 2025DAPO: An Open-Source LLM Reinforcement Learning System at Scalecited by 2,810
  8. 2021Vision Transformers for Dense Predictioncited by 1,803
  9. 2013Fine-Grained Visual Classification of Aircraftcited by 1,726
  10. 2023ImageBind: One Embedding Space To Bind Them Allcited by 1,175
  11. 2018Deep Clustering for Unsupervised Learning of Visual Featurescited by 1,028
  12. 2022TransFusion: Robust LiDAR-Camera Fusion for 3D Object Detection with Transformerscited by 466
6 more
  1. 2018Pseudo-LiDAR from Visual Depth Estimation: Bridging the Gap in 3D Object Detection for Autonomous Drivingcited by 457
  2. 2022Target-aware Dual Adversarial Learning and a Multi-scenario Multi-Modality Benchmark to Fuse Infrared and Visible for Object Detectioncited by 317
  3. 2025YOLOv12: Attention-Centric Real-Time Object Detectorscited by 305
  4. 2020TransPose: Keypoint Localization via Transformercited by 126
  5. 2025R-LiViT: A LiDAR-Visual-Thermal Dataset Enabling Vulnerable Road User Focused Roadside Perceptioncited by 9
  6. 2026DSERT-RoLL: Robust Multi-Modal Perception for Diverse Driving Conditions with Stereo Event-RGB-Thermal Cameras, 4D Radar, and Dual-LiDARcited by 3

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Can Vision-Language Models Think from the Sky? Unifying UAV Reasoning and Generation
  2. 2026PixDLM: A Dual-Path Multimodal Language Model for UAV Reasoning Segmentation
  3. 2025AetherVision-Bench: An Open-Vocabulary RGB-Infrared Benchmark for Multi-Angle Segmentation across Aerial and Ground Perspectives
  4. 2025Falcon: A Remote Sensing Vision-Language Foundation Model (Technical Report)
  5. 2025Light-Weight Cross-Modal Enhancement Method with Benchmark Construction for UAV-based Open-Vocabulary Object Detection
  6. 2026SkyVLaM: Multimodal Large Language Model for UAV Video Understanding in Remote Sensing
  7. 2023RemoteCLIP: A Vision Language Foundation Model for Remote Sensing
  8. 2026SkyLink: A Large Vision-Language Model Driven Re-ranking Framework for Cross-View UAV geolocalization