Personalized Federated Learning for Egocentric Video Gaze Estimation with Comprehensive Parameter Frezzing
Not on the map. Why?
Abstract (arXiv)
Egocentric video gaze estimation requires models to capture individual gaze patterns while adapting to diverse user data. Our approach leverages a transformer-based architecture, integrating it into a PFL framework where only the most significant parameters, those exhibiting the highest rate of change during training, are selected and frozen for personalization in client models. Through extensive experimentation on the EGTEA Gaze+ and Ego4D datasets, we demonstrate that FedCPF significantly outperforms previously reported federated learning methods, achieving superior recall, precision, and F1-score. These results confirm the effectiveness of our comprehensive parameters freezing strategy in enhancing model personalization, making FedCPF a promising approach for tasks requiring both adaptability and accuracy in federated learning settings.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 20 of its 27 references that are in the map. First posted on arXiv 25 Feb 2025.
Builds on
20 of 27 references.
References · 20
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
- 2016Communication-Efficient Learning of Deep Networks from Decentralized Datacited by 7,669
- 2018The Lottery Ticket Hypothesis: Finding Sparse, Trainable Neural Networkscited by 2,262
- 2021Ego4D: Around the World in 3,000 Hours of Egocentric Videocited by 1,556
- 2019Federated Learning: Challenges, Methods, and Future Directionscited by 1,538
- 2016Federated Learning: Strategies for Improving Communication Efficiencycited by 1,475
- 2019Linear Mode Connectivity and the Lottery Ticket Hypothesiscited by 637
- 2019Federated Learning with Personalization Layerscited by 541
- 2021Exploiting Shared Representations for Personalized Federated Learningcited by 541
- 2020Think Locally, Act Globally: Federated Learning with Local and Global Representationscited by 325
- 2020Comparing Rewinding and Fine-tuning in Neural Network Pruningcited by 240
8 more
- 2021FedBABU: Towards Enhanced Representation for Federated Image Classificationcited by 182
- 2023Personalized Federated Learning with Feature Alignment and Classifier Collaborationcited by 97
- 2018Predicting Gaze in Egocentric Video by Learning Task-dependent Attention Transitioncited by 78
- 2020In the Eye of the Beholder: Gaze and Actions in First Person Videocited by 69
- 2020LotteryFL: Personalized and Communication-Efficient Federated Learning with Lottery Ticket Hypothesis on Non-IID Datasetscited by 60
- 2022In the Eye of Transformer: Global-Local Correlation for Egocentric Gaze Estimationcited by 51
- 2024FedSelect: Personalized Federated Learning with Customized Selection of Parameters for Fine-Tuningcited by 27
- 2014The Evolution of First Person Vision Methods: A Surveycited by 19
Built on by
Not cited yet.