mlsanityData to 7 Oct 2026

Mirror-Fusion Attention for Reflection-Aware Self-Supervised Representation Learning

arXiv 2607.00850 ↗First posted 1 Jul 2026cs.CV cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Most self-supervised learning (SSL) methods encourage invariance across augmentations, but strict flip invariance can suppress informative left--right correspondences in approximately bilateral data such as medical images and human faces. We propose Mirror-Fusion-Augmented Self-Supervised Learning (MFASSL), a Vision Transformer framework that injects a soft reflection prior into standard SSL without redesigning the backbone. MFASSL constructs mirror-paired views aligned to an estimated symmetry axis and introduces a lightweight Mirror-Fusion Attention (MFA) module for adaptive token-level interaction between mirrored regions while preserving asymmetric cues. The base SSL objective is further coupled with reflection-consistency and mid-layer token-alignment losses. Across CheXpert, BraTS, CelebA-HQ, and WFLW, MFASSL improves downstream performance, calibration, and reflection robustness over MoCo-v3, DINO, and MAE baselines under matched ViT-B/16 settings. It also achieves stronger and more consistent gains than recent equivariant SSL approaches with only approximately 2.7% additional parameters. These results show that lightweight geometry-aware priors can effectively complement invariance-based SSL.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 39 of its 52 references that are in the map. First posted on arXiv 1 Jul 2026.

Builds on

39 of 52 references.

References · 39

  1. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
  2. 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
  3. 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
  4. 2017On Calibration of Modern Neural Networkscited by 4,860
  5. 2020Bootstrap your own latent: A new approach to self-supervised Learningcited by 4,712
  6. 2020Exploring Simple Siamese Representation Learningcited by 2,853
  7. 2021BEiT: BERT Pre-Training of Image Transformerscited by 2,360
  8. 2014FitNets: Hints for Thin Deep Netscited by 1,619
  9. 2021An Empirical Study of Training Self-Supervised Vision Transformerscited by 1,610
  10. 2019CheXpert: A Large Chest Radiograph Dataset with Uncertainty Labels and Expert Comparisoncited by 1,410
  11. 2016Group Equivariant Convolutional Networkscited by 1,154
  12. 2021iBOT: Image BERT Pre-Training with Online Tokenizercited by 891
27 more
  1. 2018BiSeNet: Bilateral Segmentation Network for Real-time Semantic Segmentationcited by 645
  2. 2020SE(3)-Transformers: 3D Roto-Translation Equivariant Attention Networkscited by 602
  3. 2021Masked Feature Prediction for Self-Supervised Visual Pre-Trainingcited by 573
  4. 2019General E(2)-Equivariant Steerable CNNscited by 441
  5. 2021Revisiting the Calibration of Modern Neural Networkscited by 387
  6. 2020Contrastive learning of global and local features for medical image segmentation with limited annotationscited by 309
  7. 2016Steerable CNNscited by 298
  8. 2020BiSeNet V2: Bilateral Network with Guided Aggregation for Real-time Semantic Segmentationcited by 294
  9. 2022Equiformer: Equivariant Graph Attention Transformer for 3D Atomistic Graphscited by 258
  10. 2021A Practical Method for Constructing Equivariant Multilayer Perceptrons for Arbitrary Matrix Groupscited by 185
  11. 2019Models Genesis: Generic Autodidactic Models for 3D Medical Image Analysiscited by 159
  12. 2018Look at Boundary: A Boundary-Aware Face Alignment Algorithmcited by 137
  13. 2021Self-supervised learning methods and applications in medical imaging analysis: A surveycited by 76
  14. 2022Self Pre-training with Masked Autoencoders for Medical Image Classification and Segmentationcited by 69
  15. 2021Transferable Visual Words: Exploiting the Semantics of Anatomical Patterns for Self-supervised Learningcited by 68
  16. 2021Equivariant Contrastive Learningcited by 65
  17. 2020Group Equivariant Stand-Alone Self-Attention For Visioncited by 63
  18. 2022CaDeX: Learning Canonical Deformation Coordinate Space for Dynamic Surface Representation via Neural Homeomorphismcited by 56
  19. 2021Reconstructing 3D Human Pose by Watching Humans in the Mirrorcited by 47
  20. 2021Deep Symmetric Adaptation Network for Cross-modality Medical Image Segmentationcited by 39
  21. 2022Unsupervised Pre-training for Temporal Action Localization Taskscited by 31
  22. 2023E(2)-Equivariant Vision Transformercited by 27
  23. 2024EVA-X: A Foundation Model for General Chest X-ray Analysis with Self-supervised Learningcited by 22
  24. 2022EquiMod: An Equivariance Module to Improve Self-Supervised Learningcited by 20
  25. 2024Advancing human-centric AI for robust X-ray analysis through holistic self-supervised learningcited by 18
  26. 2021Learning Canonical 3D Object Representation for Fine-Grained Recognitioncited by 7
  27. 2024Symmetry Awareness Encoded Deep Learning Framework for Brain Imaging Analysiscited by 3

Built on by

Not cited yet.