HH-SAE: Discovering and Steering Hierarchical Knowledge of Complex Manifolds
Not on the map. Why?
Abstract (arXiv)
Rare semantic innovations in high-dimensional, mission-critical domains are often obscured by dense background contexts, a challenge we define as textitfeature density conflict. We introduce the Hybrid Hierarchical SAE (HH-SAE) to resolve this by factorizing manifolds into a nested hierarchy of Contextual (L0), Atomic (f1), and Compository (f2) tiers. Evaluating across disparate manifolds, HH-SAE demonstrates superior resolution by ``fracturing'' administrative clinical labels into physiological modes and achieving a peak cross-domain zero-shot AUC of 0.9156 in fraud detection. Path ablation confirms the architecture's structural necessity, revealing a 13.46% utility collapse when contextual subtraction is removed. Finally, knowledge-steered synthesis achieves a +9.9% AUPRC lift over state-of-the-art generators, proving that HH-SAE effectively prioritizes high-order mechanistic innovation over environmental proxies to enable high-precision discovery in high-stakes environments.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 11 of its 21 references that are in the map. First posted on arXiv 11 May 2026.
Builds on
11 of 21 references.
References · 11
- 2019Modeling Tabular data using Conditional GANcited by 699
- 2024Scaling and evaluating sparse autoencoderscited by 553
- 2022TabDDPM: Modelling Tabular Data with Diffusion Modelscited by 377
- 2024Improving Dictionary Learning with Gated Sparse Autoencoderscited by 179
- 2025SAEBench: A Comprehensive Benchmark for Sparse Autoencoders in Language Model Interpretabilitycited by 124
- 2023REaLTabFormer: Generating Realistic Relational and Tabular Data using Transformerscited by 94
- 2025Incorporating Hierarchical Semantics in Sparse Autoencoder Architecturescited by 14
- 2024Balanced Mixed-Type Tabular Data Synthesis with Diffusion Modelscited by 12
- 2025Representation learning to advance multi-institutional studies with electronic health record data from US and Francecited by 5
- 2025Generating Clinically Realistic EHR Data via a Hierarchy- and Semantics-Guided Transformercited by 4
- 2025Train One Sparse Autoencoder Across Multiple Sparsity Budgets to Preserve Interpretability and Accuracycited by 4
Built on by
Not cited yet.