mlsanityData to 7 Oct 2026

Categorical Representation Learning and RG flow operators for algorithmic classifiers

arXiv 2203.07975 ↗First posted 15 Mar 2022cs.LG cond-mat.dis-nn cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Following the earlier formalism of the categorical representation learning (arXiv:2103.14770) by the first two authors, we discuss the construction of the "RG-flow based categorifier". Borrowing ideas from theory of renormalization group flows (RG) in quantum field theory, holographic duality, and hyperbolic geometry, and mixing them with neural ODE's, we construct a new algorithmic natural language processing (NLP) architecture, called the RG-flow categorifier or for short the RG categorifier, which is capable of data classification and generation in all layers. We apply our algorithmic platform to biomedical data sets and show its performance in the field of sequence-to-function mapping. In particular we apply the RG categorifier to particular genomic sequences of flu viruses and show how our technology is capable of extracting the information from given genomic sequences, find their hidden symmetries and dominant features, classify them and use the trained data to make stochastic prediction of new plausible generated sequences associated with new set of viruses which could avoid the human immune system. The content of the current article is part of the recent US patent application submitted by first two authors (U.S. Patent Application No.: 63/313.504).

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 11 of its 38 references that are in the map. First posted on arXiv 15 Mar 2022.

Builds on

11 of 38 references.

References · 11

  1. 2016Density estimation using Real NVPcited by 2,029
  2. 2018FFJORD: Free-form Continuous Dynamics for Scalable Reversible Generative Modelscited by 584
  3. 2019Theoretical Limitations of Self-Attention in Neural Sequence Modelscited by 286
  4. 2020How to train your neural ODE: the world of Jacobian and kinetic regularizationcited by 228
  5. 2016Why does deep and cheap learning work so well?cited by 100
  6. 2014An exact mapping between the Variational Renormalization Group and Deep Learningcited by 52
  7. 2018Neural Network Renormalization Groupcited by 48
  8. 2017Mutual Information, Neural Networks and the Renormalization Groupcited by 32
  9. 2020RG-Flow: A hierarchical and explainable flow model based on renormalization group and sparse priorcited by 11
  10. 2021Categorical Representation Learning: Morphism is All You Needcited by 6
  11. 2017Criticality & Deep Learning II: Momentum Renormalisation Groupcited by 1

Built on by

Not cited yet.