mlsanityData to 14 Oct 2026

Topology-Aware Exploration of Energy-Based Models Equilibrium: Toric QC-LDPC Codes and Hyperbolic MET QC-LDPC Codes

arXiv 2401.14749 ↗First posted 26 Jan 2024cs.IT cs.AI cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

This paper presents a method for achieving equilibrium in the ISING Hamiltonian when confronted with unevenly distributed charges on an irregular grid. Employing (Multi-Edge) QC-LDPC codes and the Boltzmann machine, our approach involves dimensionally expanding the system, substituting charges with circulants, and representing distances through circulant shifts. This results in a systematic mapping of the charge system onto a space, transforming the irregular grid into a uniform configuration, applicable to Torical and Circular Hyperboloid Topologies. The paper covers fundamental definitions and notations related to QC-LDPC Codes, Multi-Edge QC-LDPC codes, and the Boltzmann machine. It explores the marginalization problem in code on the graph probabilistic models for evaluating the partition function, encompassing exact and approximate estimation techniques. Rigorous proof is provided for the attainability of equilibrium states for the Boltzmann machine under Torical and Circular Hyperboloid, paving the way for the application of our methodology. Practical applications of our approach are investigated in Finite Geometry QC-LDPC Codes, specifically in Material Science. The paper further explores its effectiveness in the realm of Natural Language Processing Transformer Deep Neural Networks, examining Generalized Repeat Accumulate Codes, Spatially-Coupled and Cage-Graph QC-LDPC Codes. The versatile and impactful nature of our topology-aware hardware-efficient quasi-cycle codes equilibrium method is showcased across diverse scientific domains without the use of specific section delineations.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 13 of its 70 references that are in the map. First posted on arXiv 26 Jan 2024.

Builds on

13 of 70 references.

References · 13

  1. 2020Long Range Arena: A Benchmark for Efficient Transformerscited by 700
  2. 2019Pay Less Attention with Lightweight and Dynamic Convolutionscited by 211
  3. 2022Mega: Moving Average Equipped Gated Attentioncited by 179
  4. 2021Involution: Inverting the Inherence of Convolution for Visual Recognitioncited by 99
  5. 2016Interaction Screening: Efficient and Sample-Optimal Learning of Ising Modelscited by 43
  6. 2018Topological Approaches to Deep Learningcited by 29
  7. 2023Six Lectures on Linearized Neural Networkscited by 20
  8. 2022Classification of Long Sequential Data using Circular Dilated Convolutional Neural Networkscited by 13
  9. 2022ChordMixer: A Scalable Neural Attention Model for Sequences with Different Lengthscited by 9
  10. 2017Codes on graphs: Models for elementary algebraic topology and statistical physicscited by 5
  11. 2017Boltzmann machines and energy-based modelscited by 5
  12. 2021FAID Diversity via Neural Networkscited by 5
1 more
  1. 2017Belief Propagation in Conditional RBMs for Structured Predictioncited by 4

Built on by

Not cited yet.