mlsanityData to 14 Oct 2026

Residual Algebra for Representation-Preserving Learning

arXiv 2608.07349 ↗First posted 7 Aug 2026cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Learning from heterogeneous representations is often reduced to feature concatenation, erasing which representation produced each error. We propose residual algebra, in which each representation retains its coordinate system and owns its unresolved residual until an explicit aggregation boundary. Fold instantiates representations as point-in-time conditional-mean fields on 10x10 rank grids, and FPRC-PQ composes them through relax-aggregate-close: each field first fits a correction to its own residual, corrected fields then meet at a fixed mean, and a shared learner closes only the aggregate's fresh residual. We formalize aggregation as a quotient by the zero-sum redistribution kernel, characterizing legal post-aggregation operators as those constant on its cosets. The resulting composition separates representation, local residual estimation, and residual-of-residual estimation, with population variance reduction and first-order coupled-path mean orthogonality. Rumination-B and Rumination-H extend the algebra with quotient-legal finite correction and feedback. On 3.67M Chinese A-share stock-day observations (2023-2026) under a frozen point-in-time protocol, FPRC-PQ raises net-of-cost return from 13.52% to 19.10% and Sharpe from 1.42 to 2.09, outperforming matched-capacity, unified-residual, identity-free two-stage, and pairwise-only controls. The gain is thus attributable to explicit residual ownership and composition rather than additional features or trees.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 10 of its 34 references that are in the map. First posted on arXiv 7 Aug 2026.

Builds on

10 of 34 references.

References · 10

  1. 2016XGBoost: A Scalable Tree Boosting Systemcited by 5,166
  2. 2017Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layercited by 3,509
  3. 2021Revisiting Deep Learning Models for Tabular Datacited by 740
  4. 2019TabNet: Attentive Interpretable Tabular Learningcited by 648
  5. 2021Tabular Data: Deep Learning is Not All You Needcited by 535
  6. 2021Deep Neural Networks and Tabular Data: A Surveycited by 491
  7. 2020Neural Additive Models: Interpretable Machine Learning with Neural Netscited by 319
  8. 2023When Do Neural Nets Outperform Boosted Trees on Tabular Data?cited by 223
  9. 2022On Embeddings for Numerical Features in Tabular Deep Learningcited by 186
  10. 2023Factor Fields: A Unified Framework for Neural Fields and Beyondcited by 58

Built on by

Not cited yet.