UniTriGen: Unified Triplet Generation of Aligned Visible-Infrared-Label for Few-Shot RGB-T Semantic Segmentation
Not on the map. Why?
Abstract (arXiv)
RGB-T semantic segmentation requires strictly aligned VIS-IR-Label triplets; however, such aligned triplet data are often scarce in real-world scenarios. Existing generative augmentation methods usually adopt cascaded generation paradigms, decomposing joint triplet generation into local conditional processes. As a result, consistency among VIS, IR, and Label in spatial structure, semantic content, and cross-modal details cannot be reliably maintained. To address this issue, we propose UniTriGen, a unified triplet generation framework that directly generates spatially aligned, semantically consistent, and modality complementary VIS-IR-Label triplets under the guidance of text prompts. UniTriGen first introduces a unified triplet generation mechanism, where VIS, IR, and Label are jointly encoded into a shared latent space and modeled with a diffusion process to enforce global cross-modal consistency. Lightweight modality-specific residual adapters are further integrated into this mechanism to accommodate modality-specific imaging characteristics and output formats. To mitigate generation bias caused by imbalanced scene and class distributions in limited paired triplets, UniTriGen also employs a scene-balanced and class-aware few-shot sampling strategy, which induces a more balanced sampling distribution and enhances the scene and class diversity of generated triplets. Experiments show that UniTriGen generates high-quality aligned triplets from limited real paired data, thereby achieving consistent performance improvements across various RGB-T semantic segmentation models.
Key facts. No citing papers in the map yet (data through 13 Oct 2026). Builds on 30 of its 40 references that are in the map. First posted on arXiv 14 May 2026.
Builds on
30 of 40 references.
References · 30
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,588
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,777
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,484
- 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,516
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,323
- 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,294
- 2023T2I-Adapter: Learning Adapters to Dig out More Controllable Ability for Text-to-Image Diffusion Modelscited by 1,342
- 2017High-Resolution Image Synthesis and Semantic Manipulation with Conditional GANscited by 1,178
- 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Spacecited by 985
- 2024Grounded SAM: Assembling Open-World Models for Diverse Visual Taskscited by 919
- 2023One Transformer Fits All Distributions in Multi-Modal Diffusion at Scalecited by 186
- 2023DiffuMask: Synthesizing Images with Pixel-level Annotations for Semantic Segmentation Using Diffusion Modelscited by 162
18 more
- 2023DatasetDM: Synthesizing Data with Perception Annotations Using Diffusion Modelscited by 122
- 2023Dataset Diffusion: Diffusion-based Synthetic Dataset Generation for Pixel-Level Semantic Segmentationcited by 112
- 2019PST900: RGB-Thermal Calibration, Dataset and Segmentation Networkcited by 85
- 2024Sigma: Siamese Mamba Network for Multi-Modal Semantic Segmentationcited by 71
- 2023FreeMask: Synthetic Images with Dense Annotations Make Stronger Segmentation Modelscited by 61
- 2025Text2Earth: Unlocking Text-driven Remote Sensing Image Generation with a Global-Scale Dataset and a Foundation Modelcited by 46
- 2023Edge-guided Multi-domain RGB-to-TIR image Translation for Training Vision Tasks with Challenging Labelscited by 30
- 2020Variational Interaction Information Maximization for Cross-domain Disentanglementcited by 23
- 2023SegGen: Supercharging Segmentation Models with Text2Mask and Mask2Img Synthesiscited by 18
- 2024PID: Physics-Informed Diffusion Model for Infrared Image Generationcited by 17
- 2025DiffV2IR: Visible-to-Infrared Diffusion Model via Vision-Language Understandingcited by 16
- 2025Diffusion-based Synthetic Data Generation for Visible-Infrared Person Re-Identificationcited by 10
- 2025A Training-free Synthetic Data Selection Method for Semantic Segmentationcited by 9
- 2024TextSSR: Diffusion-based Data Synthesis for Scene Text Recognitioncited by 8
- 2025M-SpecGene: Generalized Foundation Model for RGBT Multispectral Visioncited by 8
- 2025JoDiffusion: Jointly Diffusing Image with Pixel-Level Annotations for Semantic Segmentation Promotioncited by 4
- 2026Any2Any: Unified Arbitrary Modality Translation for Remote Sensingcited by 3
- 2025Paired Image Generation with Diffusion-Guided Diffusion Modelscited by 1
Built on by
Not cited yet.