HQ-JEPA: Hybrid Quantum Joint-Embedding Predictive Architecture for Cross-Modal Remote Sensing Representation Learning
Not on the map. Why?
Abstract (arXiv)
We introduce HQ-JEPA, a hybrid quantum-classical joint-embedding predictive architecture for cross-modal remote sensing representation learning. The proposed framework extends JEPA-style masked latent prediction to paired Sentinel-1 and Sentinel-2 imagery by predicting masked target representations from visible context regions while aligning heterogeneous modality features in a shared embedding space. To improve representation quality, HQ-JEPA combines four complementary objectives: latent token prediction, cross-modal token alignment, SIGReg-based Gaussian regularization in the fused latent space, and a differentiable SWAP-test-based Fidelity Quantum Similarity (FQS) loss. Unlike pixel reconstruction methods, HQ-JEPA learns semantic representations directly in latent space and uses quantum state-overlap-based similarity as an additional regularization signal. We evaluate the pretrained encoder on GeoBench classification and segmentation tasks under linear probing and fine-tuning settings. Results show that HQ-JEPA achieves competitive and often superior performance over strong self-supervised and remote sensing foundation-model baselines, demonstrating the benefit of integrating predictive self-supervision, cross-modal geometric regularization, and quantum fidelity-based representation learning for remote sensing applications.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 42 of its 56 references that are in the map. First posted on arXiv 29 May 2026.
Builds on
42 of 56 references.
References · 42
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
- 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,482
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
- 2020Bootstrap your own latent: A new approach to self-supervised Learningcited by 4,712
- 2020Exploring Simple Siamese Representation Learningcited by 2,853
- 2021BEiT: BERT Pre-Training of Image Transformerscited by 2,360
- 2021Barlow Twins: Self-Supervised Learning via Redundancy Reductioncited by 1,818
- 2025DINOv3cited by 1,297
- 2021VICReg: Variance-Invariance-Covariance Regularization for Self-Supervised Learningcited by 1,013
- 2023Self-Supervised Learning from Images with a Joint-Embedding Predictive Architecturecited by 982
- 2020Variational Quantum Algorithmscited by 687
30 more
- 2020A Survey on Contrastive Self-supervised Learningcited by 553
- 2022SatMAE: Pre-training Transformers for Temporal and Multi-Spectral Satellite Imagerycited by 402
- 2021Understanding Dimensional Collapse in Contrastive Self-supervised Learningcited by 374
- 2022Scale-MAE: A Scale-Aware Masked Autoencoder for Multiscale Geospatial Representation Learningcited by 302
- 2020Whitening for Self-Supervised Representation Learningcited by 278
- 2025LeJEPA: Provable and Scalable Self-Supervised Learning Without the Heuristicscited by 227
- 2023A Survey on Self-supervised Learning: Algorithms, Applications, and Future Trendscited by 205
- 2022SatlasPretrain: A Large-Scale Dataset for Remote Sensing Image Understandingcited by 164
- 2024Prithvi-EO-2.0: A Versatile Multi-Temporal Foundation Model for Earth Observation Applicationscited by 139
- 2023GEO-Bench: Toward Foundation Models for Earth Monitoringcited by 122
- 2026V-JEPA 2.1: Unlocking Dense Features in Video Self-Supervised Learningcited by 104
- 2024Neural Plasticity-Inspired Multimodal Foundation Model for Earth Observationcited by 97
- 2024MMEarth: Exploring Multi-Modal Pretext Tasks For Geospatial Representation Learningcited by 76
- 2024AnySat: One Earth Observation Model for Many Resolutions, Scales, and Modalitiescited by 73
- 2025VL-JEPA: Joint Embedding Predictive Architecture for Vision-languagecited by 61
- 2023Self-Supervised Multimodal Learning: A Surveycited by 58
- 2019Self-Supervised Learning For Few-Shot Image Classificationcited by 44
- 2023Decoupling Common and Unique Representations for Multimodal Self-supervised Learningcited by 36
- 2021A Survey of Self-Supervised and Few-Shot Object Detectioncited by 35
- 2024Masked Image Modeling: A Surveycited by 28
- 2021Contrastive Learning with Large Memory Bank and Negative Embedding Subtraction for Accurate Copy Detectioncited by 23
- 2022SimReg: Regression as a Simple Yet Effective Tool for Self-supervised Knowledge Distillationcited by 21
- 2021Quantum Self-Supervised Learningcited by 20
- 2020Qutrit-inspired Fully Self-supervised Shallow Quantum Learning Network for Brain Tumor Segmentationcited by 7
- 2022The Geometry of Self-supervised Learning Models and its Impact on Transfer Learningcited by 7
- 2024The Hidden Pitfalls of the Cosine Similarity Losscited by 7
- 2024Collapse-Proof Non-Contrastive Self-Supervised Learningcited by 7
- 2026HQF-Net: A Hybrid Quantum-Classical Multi-Scale Fusion Network for Remote Sensing Image Segmentationcited by 3
- 2026QMC-Net: Data-Aware Quantum Representations for Remote Sensing Image Classificationcited by 2
- 2026HQ-UNet: A Hybrid Quantum-Classical U-Net with a Quantum Bottleneck for Remote Sensing Image Segmentationcited by 1
Built on by
Not cited yet.