mlsanityData to 14 Oct 2026

SDEC: Semantic Deep Embedded Clustering

arXiv 2508.15823 ↗First posted 18 Aug 2025cs.CL cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

The high dimensional and semantically complex nature of textual Big data presents significant challenges for text clustering, which frequently lead to suboptimal groupings when using conventional techniques like k-means or hierarchical clustering. This work presents Semantic Deep Embedded Clustering (SDEC), an unsupervised text clustering framework that combines an improved autoencoder with transformer-based embeddings to overcome these challenges. This novel method preserves semantic relationships during data reconstruction by combining Mean Squared Error (MSE) and Cosine Similarity Loss (CSL) within an autoencoder. Furthermore, a semantic refinement stage that takes advantage of the contextual richness of transformer embeddings is used by SDEC to further improve a clustering layer with soft cluster assignments and distributional loss. The capabilities of SDEC are demonstrated by extensive testing on five benchmark datasets: AG News, Yahoo! Answers, DBPedia, Reuters 2, and Reuters 5. The framework not only outperformed existing methods with a clustering accuracy of 85.7% on AG News and set a new benchmark of 53.63% on Yahoo! Answers, but also showed robust performance across other diverse text corpora. These findings highlight the significant improvements in accuracy and semantic comprehension of text data provided by SDEC's advances in unsupervised text clustering.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 23 of its 61 references that are in the map. First posted on arXiv 18 Aug 2025.

Builds on

23 of 61 references.

References · 23

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  3. 2013Efficient Estimation of Word Representations in Vector Spacecited by 4,375
  4. 2013Auto-Encoding Variational Bayescited by 4,053
  5. 2013Distributed Representations of Words and Phrases and their Compositionalitycited by 3,474
  6. 2015Character-level Convolutional Networks for Text Classificationcited by 2,330
  7. 2016Enriching Word Vectors with Subword Informationcited by 1,583
  8. 2015Unsupervised Deep Embedding for Clustering Analysiscited by 767
  9. 2017Self-Normalizing Neural Networkscited by 598
  10. 2019How to Fine-Tune BERT for Text Classification?cited by 411
  11. 2016Deep Unsupervised Clustering with Gaussian Mixture Variational Autoencoderscited by 220
  12. 2017Deep Clustering via Joint Convolutional Autoencoder Embedding and Relative Entropy Minimizationcited by 113
11 more
  1. 2016Community detection in networks: A user guidecited by 105
  2. 2018ClusterGAN : Latent Space Clustering in Generative Adversarial Networkscited by 75
  3. 2017Discriminatively Boosted Image Clustering with Fully Convolutional Auto-Encoderscited by 32
  4. 2021BERT-CoQAC: BERT-based Conversational Question Answering in Contextcited by 13
  5. 2023Quantized Transformer Language Model Implementations on Edge Devicescited by 9
  6. 2023EDSA-Ensemble: an Event Detection Sentiment Analysis Ensemble Architecturecited by 8
  7. 2023ContCommRTD: A Distributed Content-based Misinformation-aware Community Detection System for Real-Time Disaster Reportingcited by 8
  8. 2022A BERT-based Deep Learning Approach for Reputation Analysis in Social Mediacited by 3
  9. 2024BERTologyNavigator: Advanced Question Answering with BERT-based Semanticscited by 2
  10. 2021Text Classification and Clustering with Annealing Soft Nearest Neighbor Losscited by 1
  11. 2024Enriched BERT Embeddings for Scholarly Publication Classificationcited by 1

Built on by

Not cited yet.