# Evolving Restricted Boltzmann Machine-Kohonen Network for Online Clustering

arXiv: https://arxiv.org/abs/2402.09167 · HTML: https://mlsanity.com/paper/2402.09167/

## Key facts

- No citing papers in the map yet (data through 14 Oct 2026).
- Builds on 10 of its 38 references that are in the map.
- First posted on arXiv 14 Feb 2024.

## Builds on (most cited first, 10 of 10)

- [Fashion-MNIST: a Novel Image Dataset for Benchmarking Machine Learning Algorithms](https://mlsanity.com/paper/1708.07747/) (2017)
- [Deep Learning for Classical Japanese Literature](https://mlsanity.com/paper/1812.01718/) (2018)
- [Unsupervised Continual Learning in Streaming Environments](https://mlsanity.com/paper/2109.09282/) (2021)
- [DEVDAN: Deep Evolving Denoising Autoencoder](https://mlsanity.com/paper/1910.04062/) (2019)
- [Evaluation of Community Detection Methods](https://mlsanity.com/paper/1807.01130/) (2018)
- [Online k-means Clustering](https://mlsanity.com/paper/1909.06861/) (2019)
- [Disentangling representations in Restricted Boltzmann Machines without adversaries](https://mlsanity.com/paper/2206.11600/) (2022)
- [Energy-based Dropout in Restricted Boltzmann Machines: Why not go random](https://mlsanity.com/paper/2101.06741/) (2021)
- [Autonomous Deep Quality Monitoring in Streaming Environments](https://mlsanity.com/paper/2106.13955/) (2021)
- [DRBM-ClustNet: A Deep Restricted Boltzmann-Kohonen Architecture for Data Clustering](https://mlsanity.com/paper/2205.06697/) (2022)

## Abstract (arXiv)

A novel online clustering algorithm is presented where an Evolving Restricted Boltzmann Machine (ERBM) is embedded with a Kohonen Network called ERBM-KNet. The proposed ERBM-KNet efficiently handles streaming data in a single-pass mode using the ERBM, employing a bias-variance strategy for neuron growing and pruning, as well as online clustering based on a cluster update strategy for cluster prediction and cluster center update using KNet. Initially, ERBM evolves its architecture while processing unlabeled image data, effectively disentangling the data distribution in the latent space. Subsequently, the KNet utilizes the feature extracted from ERBM to predict the number of clusters and updates the cluster centers. By overcoming the common challenges associated with clustering algorithms, such as prior initialization of the number of clusters and subpar clustering accuracy, the proposed ERBM-KNet offers significant improvements. Extensive experimental evaluations on four benchmarks and one industry dataset demonstrate the superiority of ERBM-KNet compared to state-of-the-art approaches.
