RailGen: Improving Railway Intrusion Detection via Agent-Guided Small-Scale Foreign Object Generation
Not on the map. Why?
Abstract (arXiv)
Small-object detection under long-tailed data distributions is a fundamental yet challenging problem in multimedia. Railway Foreign Object Detection (RFOD) epitomizes this challenge with easily confused small intrusions and scarce samples. To address these issues, we propose a generative-augmented detection paradigm that leverages multimodal image generation to enrich the feature space of rare and small objects. We first construct RailGen, a multimodal image generation agent based on large models. Under semantic constraints, RailGen automatically invokes tools to generate railway scenes, calibrate intrusion positions, extract foreign objects, and fuse them into realistic intrusion effects. This process produces high-quality synthetic samples that effectively densify the feature representations of tail classes and complete the small-object feature space. Within this paradigm, we further propose FocalDEIM, a detection framework designed to enhance training with generated data. FocalDEIM improves dense matching with Focal Modulation for better small-object discrimination and adopts Focal Loss to emphasize hard samples, thereby alleviating blurred inter-class boundaries in complex railway scenes. Experimental results demonstrate that RailGen can generate high-quality small-scale foreign objects, reducing the object pixel area by up to 58x and 13.85x on average. Equipped with these challenging samples, our paradigm surpasses the baseline DEIM by 5.6% and 7.5% in mAP@50 and mAP@(50-95), respectively, and outperforms existing state-of-the-art methods. Ablation studies verify RailGen's feature-space enrichment and FocalDEIM's boundary discrimination. The paradigm provides an effective multimodal generative solution for long-tailed small-object detection in safety-critical applications.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 30 of its 51 references that are in the map. First posted on arXiv 31 Aug 2026.
Builds on
30 of 51 references.
References · 30
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2023Segment Anythingcited by 8,234
- 2020End-to-End Object Detection with Transformerscited by 7,414
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
- 2022Flow Matching for Generative Modelingcited by 5,702
- 2022Generative Adversarial Networkscited by 5,627
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
- 2013Auto-Encoding Variational Bayescited by 4,053
- 2020Deformable DETR: Deformable Transformers for End-to-End Object Detectioncited by 3,422
- 2025Gemma 3 Technical Reportcited by 1,824
18 more
- 2024A Survey on LLM-as-a-Judgecited by 1,423
- 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Spacecited by 1,006
- 2023DETRs Beat YOLOs on Real-time Object Detectioncited by 533
- 2021Image Segmentation Using Text and Image Promptscited by 512
- 2024YOLO-World: Real-Time Open-Vocabulary Object Detectioncited by 503
- 2025YOLOv12: Attention-Centric Real-Time Object Detectorscited by 305
- 2022DETRs with Collaborative Hybrid Assignments Trainingcited by 274
- 2022Focal Modulation Networkscited by 186
- 2022Semantic Image Synthesis via Diffusion Modelscited by 132
- 2022A Survey on Long-Tailed Visual Recognitioncited by 75
- 2024DEIM: DETR with Improved Matching for Fast Convergencecited by 68
- 2025YOLOv13: Real-Time Object Detection with Hypergraph-Enhanced Adaptive Visual Perceptioncited by 58
- 2021SODA10M: A Large-Scale 2D Self/Semi-Supervised Object Detection Dataset for Autonomous Drivingcited by 43
- 2023FoodLMM: A Versatile Food Assistant using Large Multi-modal Modelcited by 32
- 2020Extended Feature Pyramid Network for Small Object Detectioncited by 27
- 2023Object Detection with Transformers: A Reviewcited by 22
- 2025YOLO-Master: MOE-Accelerated with Specialized Transformers for Enhanced Real-time Detectioncited by 4
- 2024Detailed Object Description with Controllable Dimensionscited by 3
Built on by
Not cited yet.