# Heterogeneous Tri-stream Clustering Network

arXiv: https://arxiv.org/abs/2301.04451 · HTML: https://mlsanity.com/paper/2301.04451/

## Key facts

- Cited by 3 papers in the map (data through 14 Oct 2026).
- Builds on 30 of its 56 references that are in the map.
- First posted on arXiv 11 Jan 2023.

## Builds on (most cited first, 30 of 30)

- [Deep Residual Learning for Image Recognition](https://mlsanity.com/paper/1512.03385/) (2015)
- [A Simple Framework for Contrastive Learning of Visual Representations](https://mlsanity.com/paper/2002.05709/) (2020)
- [Representation Learning with Contrastive Predictive Coding](https://mlsanity.com/paper/1807.03748/) (2018)
- [Momentum Contrast for Unsupervised Visual Representation Learning](https://mlsanity.com/paper/1911.05722/) (2019)
- [Bootstrap your own latent: A new approach to self-supervised Learning](https://mlsanity.com/paper/2006.07733/) (2020)
- [Exploring Simple Siamese Representation Learning](https://mlsanity.com/paper/2011.10566/) (2020)
- [Unsupervised Learning of Visual Features by Contrasting Cluster Assignments](https://mlsanity.com/paper/2006.09882/) (2020)
- [Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networks](https://mlsanity.com/paper/1511.06434/) (2015)
- [Unsupervised Feature Learning via Non-Parametric Instance-level Discrimination](https://mlsanity.com/paper/1805.01978/) (2018)
- [Deep Clustering for Unsupervised Learning of Visual Features](https://mlsanity.com/paper/1807.05520/) (2018)
- [Self-Supervised Learning of Pretext-Invariant Representations](https://mlsanity.com/paper/1912.01991/) (2019)
- [Unsupervised Deep Embedding for Clustering Analysis](https://mlsanity.com/paper/1511.06335/) (2015)
- [Prototypical Contrastive Learning of Unsupervised Representations](https://mlsanity.com/paper/2005.04966/) (2020)
- [Invariant Information Clustering for Unsupervised Image Classification and Segmentation](https://mlsanity.com/paper/1807.06653/) (2018)
- [SCAN: Learning to Classify Images without Labels](https://mlsanity.com/paper/2005.12320/) (2020)
- [Contrastive Clustering](https://mlsanity.com/paper/2009.09687/) (2020)
- [Joint Unsupervised Learning of Deep Representations and Image Clusters](https://mlsanity.com/paper/1604.03628/) (2016)
- [Deep Comprehensive Correlation Mining for Image Clustering](https://mlsanity.com/paper/1904.06925/) (2019)
- [Improving Unsupervised Image Clustering With Robust Learning](https://mlsanity.com/paper/2012.11150/) (2020)
- [Ultra-Scalable Spectral Clustering and Ensemble Clustering](https://mlsanity.com/paper/1903.01057/) (2019)
- [GATCluster: Self-Supervised Gaussian-Attention Network for Image Clustering](https://mlsanity.com/paper/2002.11863/) (2020)
- [Fast Multi-view Clustering via Ensembles: Towards Scalability, Superiority, and Simplicity](https://mlsanity.com/paper/2203.11572/) (2022)
- [Deep Robust Clustering by Contrastive Learning](https://mlsanity.com/paper/2008.03030/) (2020)
- [Locally Weighted Ensemble Clustering](https://mlsanity.com/paper/1605.05011/) (2016)
- [Toward Multidiversified Ensemble Clustering of High-Dimensional Data: From Subspaces to Metrics and Beyond](https://mlsanity.com/paper/1710.03113/) (2017)
- [Multi-view Graph Learning by Joint Modeling of Consistency and Inconsistency](https://mlsanity.com/paper/2008.10208/) (2020)
- [Enhanced Ensemble Clustering via Fast Propagation of Cluster-wise Similarities](https://mlsanity.com/paper/1810.12544/) (2018)
- [Local Deep-Feature Alignment for Unsupervised Dimension Reduction](https://mlsanity.com/paper/1904.09747/) (2019)
- [TriBYOL: Triplet BYOL for Self-Supervised Representation Learning](https://mlsanity.com/paper/2206.03012/) (2022)
- [An Image Clustering Auto-Encoder Based on Predefined Evenly-Distributed Class Centroids and MMD Distance](https://mlsanity.com/paper/1906.03905/) (2019)

## Built on by (most cited first, 3 of 3)

- [Deep Clustering with Diffused Sampling and Hardness-aware Self-distillation](https://mlsanity.com/paper/2401.14038/) (2024)
- [Learning Representations for Clustering via Partial Information Discrimination and Cross-Level Interaction](https://mlsanity.com/paper/2401.13503/) (2024)
- [Dual-Level Cross-Modal Contrastive Clustering](https://mlsanity.com/paper/2409.04561/) (2024)

## Abstract (arXiv)

Contrastive deep clustering has recently gained significant attention with its ability of joint contrastive learning and clustering via deep neural networks. Despite the rapid progress, previous works mostly require both positive and negative sample pairs for contrastive clustering, which rely on a relative large batch-size. Moreover, they typically adopt a two-stream architecture with two augmented views, which overlook the possibility and potential benefits of multi-stream architectures (especially with heterogeneous or hybrid networks). In light of this, this paper presents a new end-to-end deep clustering approach termed Heterogeneous Tri-stream Clustering Network (HTCN). The tri-stream architecture in HTCN consists of three main components, including two weight-sharing online networks and a target network, where the parameters of the target network are the exponential moving average of that of the online networks. Notably, the two online networks are trained by simultaneously (i) predicting the instance representations of the target network and (ii) enforcing the consistency between the cluster representations of the target network and that of the two online networks. Experimental results on four challenging image datasets demonstrate the superiority of HTCN over the state-of-the-art deep clustering approaches. The code is available at https://github.com/dengxiaozhi/HTCN.