# Variational Deep Semantic Hashing for Text Documents

arXiv: https://arxiv.org/abs/1708.03436 · HTML: https://mlsanity.com/paper/1708.03436/

## Key facts

- Cited by 12 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 11 Aug 2017.

## Built on by (most cited first, 12 of 12)

- [VAE Approximation Error: ELBO and Exponential Families](https://mlsanity.com/paper/2102.09310/) (2021)
- [Unsupervised Multi-Index Semantic Hashing](https://mlsanity.com/paper/2103.14460/) (2021)
- [Projected Hamming Dissimilarity for Bit-Level Importance Coding in Collaborative Filtering](https://mlsanity.com/paper/2103.14455/) (2021)
- [Bias-Variance Tradeoffs in Single-Sample Binary Gradient Estimators](https://mlsanity.com/paper/2110.03549/) (2021)
- [Bottleneck-Minimal Indexing for Generative Document Retrieval](https://mlsanity.com/paper/2405.10974/) (2024)
- [PROVES: Establishing Image Provenance using Semantic Signatures](https://mlsanity.com/paper/2110.11411/) (2021)
- [Adversarial Learning of Poisson Factorisation Model for Gauging Brand Sentiment in User Reviews](https://mlsanity.com/paper/2101.10150/) (2021)
- [A Conditional Generative Matching Model for Multi-lingual Reply Suggestion](https://mlsanity.com/paper/2109.07046/) (2021)
- [Advances in Electron Microscopy with Deep Learning](https://mlsanity.com/paper/2101.01178/) (2021)
- [Integrating Semantics and Neighborhood Information with Graph-Driven Generative Models for Document Retrieval](https://mlsanity.com/paper/2105.13066/) (2021)
- [Representation Learning for Efficient and Effective Similarity Search and Recommendation](https://mlsanity.com/paper/2109.01815/) (2021)
- [Semantic Watermarking for Malicious Image Manipulation Detection](https://mlsanity.com/paper/2609.39623/) (2026)

## Abstract (arXiv)

As the amount of textual data has been rapidly increasing over the past decade, efficient similarity search methods have become a crucial component of large-scale information retrieval systems. A popular strategy is to represent original data samples by compact binary codes through hashing. A spectrum of machine learning methods have been utilized, but they often lack expressiveness and flexibility in modeling to learn effective representations. The recent advances of deep learning in a wide range of applications has demonstrated its capability to learn robust and powerful feature representations for complex data. Especially, deep generative models naturally combine the expressiveness of probabilistic generative models with the high capacity of deep neural networks, which is very suitable for text modeling. However, little work has leveraged the recent progress in deep learning for text hashing. In this paper, we propose a series of novel deep document generative models for text hashing. The first proposed model is unsupervised while the second one is supervised by utilizing document labels/tags for hashing. The third model further considers document-specific factors that affect the generation of words. The probabilistic generative formulation of the proposed models provides a principled framework for model extension, uncertainty estimation, simulation, and interpretability. Based on variational inference and reparameterization, the proposed models can be interpreted as encoder-decoder deep neural networks and thus they are capable of learning complex nonlinear distributed representations of the original documents. We conduct a comprehensive set of experiments on four public testbeds. The experimental results have demonstrated the effectiveness of the proposed supervised learning models for text hashing.
