mlsanityData to 7 Oct 2026

HQ-JEPA: Hybrid Quantum Joint-Embedding Predictive Architecture for Cross-Modal Remote Sensing Representation Learning

arXiv 2605.31068 ↗First posted 29 May 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

We introduce HQ-JEPA, a hybrid quantum-classical joint-embedding predictive architecture for cross-modal remote sensing representation learning. The proposed framework extends JEPA-style masked latent prediction to paired Sentinel-1 and Sentinel-2 imagery by predicting masked target representations from visible context regions while aligning heterogeneous modality features in a shared embedding space. To improve representation quality, HQ-JEPA combines four complementary objectives: latent token prediction, cross-modal token alignment, SIGReg-based Gaussian regularization in the fused latent space, and a differentiable SWAP-test-based Fidelity Quantum Similarity (FQS) loss. Unlike pixel reconstruction methods, HQ-JEPA learns semantic representations directly in latent space and uses quantum state-overlap-based similarity as an additional regularization signal. We evaluate the pretrained encoder on GeoBench classification and segmentation tasks under linear probing and fine-tuning settings. Results show that HQ-JEPA achieves competitive and often superior performance over strong self-supervised and remote sensing foundation-model baselines, demonstrating the benefit of integrating predictive self-supervision, cross-modal geometric regularization, and quantum fidelity-based representation learning for remote sensing applications.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 42 of its 56 references that are in the map. First posted on arXiv 29 May 2026.

Builds on

42 of 56 references.

References · 42

  1. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
  2. 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,482
  3. 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
  4. 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
  5. 2020Bootstrap your own latent: A new approach to self-supervised Learningcited by 4,712
  6. 2020Exploring Simple Siamese Representation Learningcited by 2,853
  7. 2021BEiT: BERT Pre-Training of Image Transformerscited by 2,360
  8. 2021Barlow Twins: Self-Supervised Learning via Redundancy Reductioncited by 1,818
  9. 2025DINOv3cited by 1,297
  10. 2021VICReg: Variance-Invariance-Covariance Regularization for Self-Supervised Learningcited by 1,013
  11. 2023Self-Supervised Learning from Images with a Joint-Embedding Predictive Architecturecited by 982
  12. 2020Variational Quantum Algorithmscited by 687
30 more
  1. 2020A Survey on Contrastive Self-supervised Learningcited by 553
  2. 2022SatMAE: Pre-training Transformers for Temporal and Multi-Spectral Satellite Imagerycited by 402
  3. 2021Understanding Dimensional Collapse in Contrastive Self-supervised Learningcited by 374
  4. 2022Scale-MAE: A Scale-Aware Masked Autoencoder for Multiscale Geospatial Representation Learningcited by 302
  5. 2020Whitening for Self-Supervised Representation Learningcited by 278
  6. 2025LeJEPA: Provable and Scalable Self-Supervised Learning Without the Heuristicscited by 227
  7. 2023A Survey on Self-supervised Learning: Algorithms, Applications, and Future Trendscited by 205
  8. 2022SatlasPretrain: A Large-Scale Dataset for Remote Sensing Image Understandingcited by 164
  9. 2024Prithvi-EO-2.0: A Versatile Multi-Temporal Foundation Model for Earth Observation Applicationscited by 139
  10. 2023GEO-Bench: Toward Foundation Models for Earth Monitoringcited by 122
  11. 2026V-JEPA 2.1: Unlocking Dense Features in Video Self-Supervised Learningcited by 104
  12. 2024Neural Plasticity-Inspired Multimodal Foundation Model for Earth Observationcited by 97
  13. 2024MMEarth: Exploring Multi-Modal Pretext Tasks For Geospatial Representation Learningcited by 76
  14. 2024AnySat: One Earth Observation Model for Many Resolutions, Scales, and Modalitiescited by 73
  15. 2025VL-JEPA: Joint Embedding Predictive Architecture for Vision-languagecited by 61
  16. 2023Self-Supervised Multimodal Learning: A Surveycited by 58
  17. 2019Self-Supervised Learning For Few-Shot Image Classificationcited by 44
  18. 2023Decoupling Common and Unique Representations for Multimodal Self-supervised Learningcited by 36
  19. 2021A Survey of Self-Supervised and Few-Shot Object Detectioncited by 35
  20. 2024Masked Image Modeling: A Surveycited by 28
  21. 2021Contrastive Learning with Large Memory Bank and Negative Embedding Subtraction for Accurate Copy Detectioncited by 23
  22. 2022SimReg: Regression as a Simple Yet Effective Tool for Self-supervised Knowledge Distillationcited by 21
  23. 2021Quantum Self-Supervised Learningcited by 20
  24. 2020Qutrit-inspired Fully Self-supervised Shallow Quantum Learning Network for Brain Tumor Segmentationcited by 7
  25. 2022The Geometry of Self-supervised Learning Models and its Impact on Transfer Learningcited by 7
  26. 2024The Hidden Pitfalls of the Cosine Similarity Losscited by 7
  27. 2024Collapse-Proof Non-Contrastive Self-Supervised Learningcited by 7
  28. 2026HQF-Net: A Hybrid Quantum-Classical Multi-Scale Fusion Network for Remote Sensing Image Segmentationcited by 3
  29. 2026QMC-Net: Data-Aware Quantum Representations for Remote Sensing Image Classificationcited by 2
  30. 2026HQ-UNet: A Hybrid Quantum-Classical U-Net with a Quantum Bottleneck for Remote Sensing Image Segmentationcited by 1

Built on by

Not cited yet.