mlsanityData to 7 Oct 2026

FedCKA: Representation-Guided Layer Personalization for Federated 3D Perception Across Driving Domains

arXiv 2610.01510 ↗First posted 1 Oct 2026cs.CV cs.ROcited by 0

Not on the map. Why?

Abstract (arXiv)

Robust perception in intelligent vehicles demands 3D object detectors that remain dependable under domain shifts, such as changes in time of day, location, or weather. However, due to costly annotation and rare shifts, some environments lack sufficient data to train a standalone detector. Federated learning offers a privacy-preserving framework for collaborative model training, enabling clients to benefit from shared learning across diverse environments. Yet, this framework traditionally relies on a single global consensus model, which struggles to perform across heterogeneous local data distributions. Local conditions are better captured by adapting a subset of the model, but many personalization approaches rely on predefined layer partitions or fixed personalization ratios, thereby limiting adaptation to client-specific divergence. To reduce this rigidity, we propose FedCKA, a Centered Kernel Alignment (CKA)-based strategy that dynamically handles the personalization-globalization trade-off. Specifically, FedCKA computes layer-wise feature similarities between local client models and the global consensus model during training. By converting layer-wise similarity scores into client-specific aggregation masks, FedCKA selectively shares representation-consistent layers. Evaluation on a unified multi-domain benchmark based on nuScenes shows that FedCKA outperforms established federated baselines, including FedBN, FedRep, and FedSelect, improving average NDS by 7 percentage points over the strongest baseline. The findings offer both a comparative benchmark and a promising direction for robust federated 3D perception across shifts in location, weather, and illumination. Code is available at https://github.com/j-verhoog/FedCKA.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 22 of its 31 references that are in the map. First posted on arXiv 1 Oct 2026.

Builds on

22 of 31 references.

References · 22

  1. 2016Communication-Efficient Learning of Deep Networks from Decentralized Datacited by 7,592
  2. 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,485
  3. 2018Federated Optimization in Heterogeneous Networkscited by 2,971
  4. 2019Similarity of Neural Network Representations Revisitedcited by 1,695
  5. 2019Energy and Policy Considerations for Deep Learning in NLPcited by 1,242
  6. 2014How transferable are features in deep neural networks?cited by 1,216
  7. 2020Gradient Surgery for Multi-Task Learningcited by 1,210
  8. 2022Editing Models with Task Arithmeticcited by 1,076
  9. 2021Do Vision Transformers See Like Convolutional Neural Networks?cited by 671
  10. 2021FedBN: Federated Learning on Non-IID Features via Local Batch Normalizationcited by 565
  11. 2021Federated Learning Based on Dynamic Regularizationcited by 555
  12. 2021Exploiting Shared Representations for Personalized Federated Learningcited by 537
10 more
  1. 2019Model Fusion via Optimal Transportcited by 217
  2. 2020Federated Visual Classification with Real-World Data Distributioncited by 126
  3. 2023Benchmarking Robustness of 3D Object Detection to Common Corruptions in Autonomous Drivingcited by 112
  4. 2023Cross Modal Transformer: Towards Fast and Robust 3D Object Detectioncited by 68
  5. 2024A Survey on Autonomous Driving Datasets: Statistics, Annotation Quality, and a Future Outlookcited by 65
  6. 2024FedSelect: Personalized Federated Learning with Customized Selection of Parameters for Fine-Tuningcited by 27
  7. 2023Federated Domain Generalization: A Surveycited by 25
  8. 2024MultiCorrupt: A Multi-Modal Robustness Dataset and Benchmark of LiDAR-Camera Fusion for 3D Object Detectioncited by 17
  9. 2025Federated Domain Generalization with Data-free On-server Matching Gradientcited by 7
  10. 2023Tackling the Non-IID Issue in Heterogeneous Federated Learning by Gradient Harmonizationcited by 4

Built on by

Not cited yet.