# Full-Span Log-Linear Model and Fast Learning Algorithm

arXiv: https://arxiv.org/abs/2202.08472 · HTML: https://mlsanity.com/paper/2202.08472/

## Key facts

- No citing papers in the map yet (data through 14 Oct 2026).
- Builds on 0 of its 16 references that are in the map.
- First posted on arXiv 17 Feb 2022.

## Abstract (arXiv)

The full-span log-linear(FSLL) model introduced in this paper is considered an n-th order Boltzmann machine, where n is the number of all variables in the target system. Let X=(X0,...,Xn-1) be finite discrete random variables that can take |X|=|X0|...|Xn-1| different values. The FSLL model has |X|-1 parameters and can represent arbitrary positive distributions of X. The FSLL model is a "highest-order" Boltzmann machine; nevertheless, we can compute the dual parameters of the model distribution, which plays important roles in exponential families, in O(|X|log|X|) time. Furthermore, using properties of the dual parameters of the FSLL model, we can construct an efficient learning algorithm. The FSLL model is limited to small probabilistic models up to |X|≈225; however, in this problem domain, the FSLL model flexibly fits various true distributions underlying the training data without any hyperparameter tuning. The experiments presented that the FSLL successfully learned six training datasets such that |X|=220 within one minute with a laptop PC.