D-JEPA: Design-Recoverable JEPA Representation with Swappable Physics Decoders
Not on the map. Why?
Abstract (arXiv)
Joint-Embedding Predictive Architectures (JEPAs) provide a framework for learning compact representations without directly reconstructing high-dimensional observations. However, in parameterized physical systems, learned representations can entangle geometry with operating conditions and task-specific physical responses, limiting their reuse across prediction tasks. We introduce D-JEPA (Design-recoverable JEPA), a geometry-centric JEPA that computes a compact representation from geometry alone and reuses it across operating conditions and physical response spaces through lightweight physics-specific decoders. An explicit design-recoverability objective encourages the geometry latent to preserve information about the underlying design variables, enabling the representation to support design analysis and optimization. We further identify a case-level collapse failure mode in which target representations become nearly invariant across distinct geometries despite low reconstruction error, and mitigate it using case-level variation constraints and auxiliary target reconstruction. Across four 3D aerodynamic, hydrodynamic, and structural benchmarks, D-JEPA maintains or improves full-field prediction accuracy while achieving near-perfect linear recoverability of design parameters. The frozen geometry representation can be reused at held-out operating conditions and transferred to a structural response task with fewer trainable parameters. Finally, the representation supports differentiable design optimization, with designs validated using high-fidelity CFD, preserving the predicted ranking of candidate designs. These results demonstrate that separating a reusable geometry representation from physics-specific prediction provides a practical representation for scientific surrogate modeling and design.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 23 of its 30 references that are in the map. First posted on arXiv 27 Sep 2026.
Builds on
23 of 30 references.
References · 23
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
- 2020Bootstrap your own latent: A new approach to self-supervised Learningcited by 4,750
- 2017PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Spacecited by 4,401
- 2019Parameter-Efficient Transfer Learning for NLPcited by 4,236
- 2017FiLM: Visual Reasoning with a General Conditioning Layercited by 2,333
- 2020Implicit Neural Representations with Periodic Activation Functionscited by 2,238
- 2020Fourier Features Let Networks Learn High Frequency Functions in Low Dimensional Domainscited by 2,200
- 2021Barlow Twins: Self-Supervised Learning via Redundancy Reductioncited by 1,838
- 2016Understanding intermediate layers using linear classifier probescited by 1,353
- 2021VICReg: Variance-Invariance-Covariance Regularization for Self-Supervised Learningcited by 1,057
- 2023Self-Supervised Learning from Images with a Joint-Embedding Predictive Architecturecited by 1,039
11 more
- 2022data2vec: A General Framework for Self-supervised Learning in Speech, Vision and Languagecited by 727
- 2023Point Transformer V3: Simpler, Faster, Strongercited by 589
- 2024Revisiting Feature Prediction for Learning Visual Representations from Videocited by 531
- 2019Machine Learning for Fluid Mechanicscited by 385
- 2024Transolver: A Fast Transformer Solver for PDEs on General Geometriescited by 326
- 2025LeJEPA: Provable and Scalable Self-Supervised Learning Without the Heuristicscited by 254
- 2025AB-UPT: Scaling Neural CFD Surrogates for High-Fidelity Automotive Aerodynamics Simulations via Anchored-Branched Universal Physics Transformerscited by 53
- 2025DoMINO: A Decomposable Multi-scale Iterative Neural Operator for Modeling Large Scale Engineering Simulationscited by 27
- 2025GeoTransolver: Learning Physics on Irregular Domains Using Multi-scale Geometry Aware Physics Attention Transformercited by 23
- 2026AeroJEPA: Learning Semantic Latent Representations for Scalable 3D Aerodynamic Field Modelingcited by 4
- 2025AutoHood3D: A Multi-Modal Benchmark for Automotive Hood Design and Fluid-Structure Interactioncited by 3
Built on by
Not cited yet.