mlsanityData to 14 Oct 2026

KDMOS:Knowledge Distillation for Motion Segmentation

arXiv 2506.14130 ↗First posted 17 Jun 2025cs.CV cs.AI cs.ROcited by 0

On the map: Knowledge distillation → Detection and dense prediction distillation

Abstract (arXiv)

Motion Object Segmentation (MOS) is crucial for autonomous driving, as it enhances localization, path planning, map construction, scene flow estimation, and future state prediction. While existing methods achieve strong performance, balancing accuracy and real-time inference remains a challenge. To address this, we propose a logits-based knowledge distillation framework for MOS, aiming to improve accuracy while maintaining real-time efficiency. Specifically, we adopt a Bird's Eye View (BEV) projection-based model as the student and a non-projection model as the teacher. To handle the severe imbalance between moving and non-moving classes, we decouple them and apply tailored distillation strategies, allowing the teacher model to better learn key motion-related features. This approach significantly reduces false positives and false negatives. Additionally, we introduce dynamic upsampling, optimize the network architecture, and achieve a 7.69% reduction in parameter count, mitigating overfitting. Our method achieves a notable IoU of 78.8% on the hidden test set of the SemanticKITTI-MOS dataset and delivers competitive results on the Apollo dataset. The KDMOS implementation is available at https://github.com/SCNU-RISLAB/KDMOS.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Detection and dense prediction distillation, one of 12 directions in Knowledge distillation. Builds on 22 of its 28 references that are in the map. First posted on arXiv 17 Jun 2025.

Builds on

22 of 28 references.

Closest ancestors · 2

Same direction, newest first

  1. 2023Knowledge Distillation from 3D to Bird's-Eye-View for LiDAR Semantic Segmentation22 Apr
  2. 2022Point-to-Voxel Knowledge Distillation for LiDAR Semantic Segmentation5 Jun

Other references · 20

  1. 2015Distilling the Knowledge in a Neural Networkcited by 10,324
  2. 2019Improved Knowledge Distillation via Teacher Assistantcited by 573
  3. 2020Cylindrical and Asymmetrical 3D Convolution Networks for LiDAR Segmentationcited by 389
  4. 2022Decoupled Knowledge Distillationcited by 388
  5. 2019On the Efficacy of Knowledge Distillationcited by 381
  6. 20222DPASS: 2D Priors Assisted Semantic Segmentation on LiDAR Point Cloudscited by 158
  7. 2024Logit Standardization in Knowledge Distillationcited by 102
  8. 2023One-for-All: Bridge the Gap Between Heterogeneous Architectures in Knowledge Distillationcited by 78
  9. 2021Moving Object Segmentation in 3D LiDAR Data: A Learning-based Approach Exploiting Sequential Datacited by 64
  10. 2023Learning to Upsample by Learning to Samplecited by 57
  11. 2022Receding Moving Object Segmentation in 3D LiDAR Data Using Sparse 4D Convolutionscited by 35
  12. 2022Efficient Spatial-Temporal Information Fusion for LiDAR-Based 3D Moving Object Segmentationcited by 29
8 more
  1. 2022Automatic Labeling to Generate Training Data for Online LiDAR-based Moving Object Segmentationcited by 27
  2. 2024MF-MOS: A Motion-Focused Model for Moving Object Segmentationcited by 23
  3. 2023InsMOS: Instance-Aware Moving Object Segmentation in LiDAR Datacited by 18
  4. 2021LiMoSeg: Real-time Bird's Eye View based LiDAR Motion Segmentationcited by 15
  5. 2020Self-Supervised Learning of Lidar Segmentation for Autonomous Indoor Navigationcited by 12
  6. 2024MambaMOS: LiDAR-based 3D Moving Object Segmentation with Motion-aware State Space Modelcited by 12
  7. 2023MotionBEV: Attention-Aware Online LiDAR Moving Object Segmentation with Bird's Eye View based Appearance and Motion Featurescited by 10
  8. 2024CV-MOS: A Cross-View Model for Motion Segmentationcited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026KDTwin: Task-Aware Knowledge Distillation for Lightweight Multi-Task Driving Scene Segmentation
  2. 2025BridgeTA: Bridging the Representation Gap in Knowledge Distillation via Teacher Assistant for Bird's Eye View Map Segmentation
  3. 2022Adaptive Instance Distillation for Object Detection in Autonomous Driving
  4. 2022TransKD: Transformer Knowledge Distillation for Efficient Semantic Segmentation
  5. 2021Spirit Distillation: Precise Real-time Semantic Segmentation of Road Scenes with Insufficient Data
  6. 2025Distilling Future Temporal Knowledge with Masked Feature Reconstruction for 3D Object Detection
  7. 2026Difference Feature Map Distillation: Transferring Inter-Sample Relational Knowledge Towards Efficient Transformer-Based Tracking
  8. 2025Knowledge Distillation for Semantic Segmentation: A Label Space Unification Approach