mlsanityData to 14 Oct 2026

Sparse Autoencoders as a Steering Basis for Phase Synchronization in Graph-Based CFD Surrogates

arXiv 2604.04946 ↗First posted 28 Mar 2026cs.CE cs.LG physics.comp-phcited by 1

On the map: Mechanistic interpretability → Sparse autoencoder training and evaluation

Abstract (arXiv)

Graph-based surrogate models provide fast alternatives to high-fidelity CFD solvers, but their opaque latent spaces and limited controllability restrict use in safety-critical settings. A key failure mode in oscillatory flows is phase drift, where predictions remain qualitatively correct but gradually lose temporal alignment with observations, limiting use in digital twins and closed-loop control. Correcting this through retraining is expensive and impractical during deployment. We ask whether phase drift can instead be corrected post hoc by manipulating the latent space of a frozen surrogate. We propose a phase-steering framework for pretrained graph-based CFD models that combines the right representation with the right intervention mechanism. To obtain disentangled representation for effective steering, we use sparse autoencoders (SAEs) on frozen MeshGraphNet embeddings. To steer dynamics, we move beyond static per-feature interventions such as scaling or clamping, and introduce a temporally coherent, phase-aware method. Specifically, we identify oscillatory feature pairs with Hilbert analysis, project spatial fields into low-rank temporal coefficients via SVD, and apply smooth time-varying rotations to advance or delay periodic modes while preserving amplitude-phase structure. Using a representation-agnostic setup, we compare SAE-based steering with PCA and raw embedding spaces under the same intervention pipeline. Results show that sparse, disentangled representations outperform dense or entangled ones, while static interventions fail in this dynamical setting. Overall, this work shows that latent-space steering can be extended from semantic domains to time-dependent physical systems when interventions respect the underlying dynamics, and that the same sparse features used for interpretability can also serve as physically meaningful control axes.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Sparse autoencoder training and evaluation, one of 13 directions in Mechanistic interpretability. Builds on 29 of its 49 references that are in the map. First posted on arXiv 28 Mar 2026.

Builds on

29 of 49 references.

Closest ancestors · 6

Same direction, newest first

  1. 2025Interpretable and Steerable Concept Bottleneck Sparse Autoencoders11 Dec
  2. 2025Interpreting CFD Surrogates through Sparse Autoencoders21 Jul
  3. 2024Enhancing Neural Network Interpretability with Feature-Aligned Sparse Autoencoders2 Nov
  4. 2024Decoding Dark Matter: Specialized Sparse Autoencoders for Interpreting Rare Concepts in Foundation Models1 Nov
  5. 2024Efficient Dictionary Learning with Switch Sparse Autoencoders10 Oct
  6. 2024Gemma Scope: Open Sparse Autoencoders Everywhere All At Once on Gemma 29 Aug

Other references · 23

  1. 2023Sparse Autoencoders Find Highly Interpretable Features in Language Modelscited by 1,420
  2. 2023Representation Engineering: A Top-Down Approach to AI Transparencycited by 1,336
  3. 2023Inference-Time Intervention: Eliciting Truthful Answers from a Language Modelcited by 1,302
  4. 2023Steering Llama 2 via Contrastive Activation Additioncited by 1,085
  5. 2018Challenging Common Assumptions in the Unsupervised Learning of Disentangled Representationscited by 941
  6. 2023Steering Language Models With Activation Engineeringcited by 922
  7. 2020Learning to Simulate Complex Physics with Graph Networkscited by 880
  8. 2020Learning Mesh-Based Simulation with Graph Networkscited by 868
  9. 2019Interpreting the Latent Space of GANs for Semantic Face Editingcited by 695
  10. 2024Scaling and evaluating sparse autoencoderscited by 553
  11. 2017Deep learning for universal linear embeddings of nonlinear dynamicscited by 494
  12. 2024Jumping Ahead: Improving Reconstruction Fidelity with JumpReLU Sparse Autoencoderscited by 300
11 more
  1. 2022Extracting Latent Steering Vectors from Pretrained Language Modelscited by 225
  2. 2013k-Sparse Autoencoderscited by 215
  3. 2024Improving Dictionary Learning with Gated Sparse Autoencoderscited by 179
  4. 2018Isolating Sources of Disentanglement in Variational Autoencoderscited by 167
  5. 2016Linear predictors for nonlinear dynamical systems: Koopman operator meets model predictive controlcited by 140
  6. 2022MultiScale MeshGraphNetscited by 98
  7. 2024Steering Language Model Refusal with Sparse Autoencoderscited by 95
  8. 2022Predicting Physics in Mesh-reduced Space with Temporal Attentioncited by 84
  9. 2025Universal Sparse Autoencoders: Interpretable Cross-Model Concept Alignmentcited by 62
  10. 2025M4GN: Mesh-based Multi-segment Hierarchical Graph Network for Dynamic Simulationscited by 2
  11. 2025Visual Exploration of Feature Relationships in Sparse Autoencoders with Curated Conceptscited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2025Learning Distributions of Complex Fluid Simulations with Diffusion Graph Networks
  2. 2025Learning Temporally Consistent Turbulence Between Sparse Snapshots via Diffusion Models
  3. 2026Fluid-DiT: Graph-Free Diffusion Transformers for Fluid Flow Simulations Learning
  4. 2026One Scale at a Time: Scale-Autoregressive Modeling for Fluid Flow Distributions
  5. 2026The balance between compactness and forecast accuracy of data-driven latent-space reduced-order models in controlled wake flows
  6. 2026Inpainting physics: self-supervised learning for context-driven fluid simulation
  7. 2026Multi-fidelity graph-based neural networks architectures to learn Navier-Stokes solutions on non-parametrized 2D domains
  8. 2026A Shortcut to Statistically Steady-State Turbulence with Flow Matching