Mirror-Fusion Attention for Reflection-Aware Self-Supervised Representation Learning
Not on the map. Why?
Abstract (arXiv)
Most self-supervised learning (SSL) methods encourage invariance across augmentations, but strict flip invariance can suppress informative left--right correspondences in approximately bilateral data such as medical images and human faces. We propose Mirror-Fusion-Augmented Self-Supervised Learning (MFASSL), a Vision Transformer framework that injects a soft reflection prior into standard SSL without redesigning the backbone. MFASSL constructs mirror-paired views aligned to an estimated symmetry axis and introduces a lightweight Mirror-Fusion Attention (MFA) module for adaptive token-level interaction between mirrored regions while preserving asymmetric cues. The base SSL objective is further coupled with reflection-consistency and mid-layer token-alignment losses. Across CheXpert, BraTS, CelebA-HQ, and WFLW, MFASSL improves downstream performance, calibration, and reflection robustness over MoCo-v3, DINO, and MAE baselines under matched ViT-B/16 settings. It also achieves stronger and more consistent gains than recent equivariant SSL approaches with only approximately 2.7% additional parameters. These results show that lightweight geometry-aware priors can effectively complement invariance-based SSL.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 39 of its 52 references that are in the map. First posted on arXiv 1 Jul 2026.
Builds on
39 of 52 references.
References · 39
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
- 2017On Calibration of Modern Neural Networkscited by 4,860
- 2020Bootstrap your own latent: A new approach to self-supervised Learningcited by 4,712
- 2020Exploring Simple Siamese Representation Learningcited by 2,853
- 2021BEiT: BERT Pre-Training of Image Transformerscited by 2,360
- 2014FitNets: Hints for Thin Deep Netscited by 1,619
- 2021An Empirical Study of Training Self-Supervised Vision Transformerscited by 1,610
- 2019CheXpert: A Large Chest Radiograph Dataset with Uncertainty Labels and Expert Comparisoncited by 1,410
- 2016Group Equivariant Convolutional Networkscited by 1,154
- 2021iBOT: Image BERT Pre-Training with Online Tokenizercited by 891
27 more
- 2018BiSeNet: Bilateral Segmentation Network for Real-time Semantic Segmentationcited by 645
- 2020SE(3)-Transformers: 3D Roto-Translation Equivariant Attention Networkscited by 602
- 2021Masked Feature Prediction for Self-Supervised Visual Pre-Trainingcited by 573
- 2019General E(2)-Equivariant Steerable CNNscited by 441
- 2021Revisiting the Calibration of Modern Neural Networkscited by 387
- 2020Contrastive learning of global and local features for medical image segmentation with limited annotationscited by 309
- 2016Steerable CNNscited by 298
- 2020BiSeNet V2: Bilateral Network with Guided Aggregation for Real-time Semantic Segmentationcited by 294
- 2022Equiformer: Equivariant Graph Attention Transformer for 3D Atomistic Graphscited by 258
- 2021A Practical Method for Constructing Equivariant Multilayer Perceptrons for Arbitrary Matrix Groupscited by 185
- 2019Models Genesis: Generic Autodidactic Models for 3D Medical Image Analysiscited by 159
- 2018Look at Boundary: A Boundary-Aware Face Alignment Algorithmcited by 137
- 2021Self-supervised learning methods and applications in medical imaging analysis: A surveycited by 76
- 2022Self Pre-training with Masked Autoencoders for Medical Image Classification and Segmentationcited by 69
- 2021Transferable Visual Words: Exploiting the Semantics of Anatomical Patterns for Self-supervised Learningcited by 68
- 2021Equivariant Contrastive Learningcited by 65
- 2020Group Equivariant Stand-Alone Self-Attention For Visioncited by 63
- 2022CaDeX: Learning Canonical Deformation Coordinate Space for Dynamic Surface Representation via Neural Homeomorphismcited by 56
- 2021Reconstructing 3D Human Pose by Watching Humans in the Mirrorcited by 47
- 2021Deep Symmetric Adaptation Network for Cross-modality Medical Image Segmentationcited by 39
- 2022Unsupervised Pre-training for Temporal Action Localization Taskscited by 31
- 2023E(2)-Equivariant Vision Transformercited by 27
- 2024EVA-X: A Foundation Model for General Chest X-ray Analysis with Self-supervised Learningcited by 22
- 2022EquiMod: An Equivariance Module to Improve Self-Supervised Learningcited by 20
- 2024Advancing human-centric AI for robust X-ray analysis through holistic self-supervised learningcited by 18
- 2021Learning Canonical 3D Object Representation for Fine-Grained Recognitioncited by 7
- 2024Symmetry Awareness Encoded Deep Learning Framework for Brain Imaging Analysiscited by 3
Built on by
Not cited yet.