# Deep TEN: Texture Encoding Network

arXiv: https://arxiv.org/abs/1612.02844 · HTML: https://mlsanity.com/paper/1612.02844/

## Key facts

- Cited by 44 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 8 Dec 2016.

## Built on by (most cited first, 30 of 44)

- [Mutual Graph Learning for Camouflaged Object Detection](https://mlsanity.com/paper/2104.02613/) (2021)
- [Learning Statistical Texture for Semantic Segmentation](https://mlsanity.com/paper/2103.04133/) (2021)
- [Self-Supervised Material and Texture Representation Learning for Remote Sensing Tasks](https://mlsanity.com/paper/2112.01715/) (2021)
- [A Survey on Graph-Based Deep Learning for Computational Histopathology](https://mlsanity.com/paper/2107.00272/) (2021)
- [Few-Shot Object Detection: A Comprehensive Survey](https://mlsanity.com/paper/2112.11699/) (2021)
- [Learning Gabor Texture Features for Fine-Grained Recognition](https://mlsanity.com/paper/2308.05396/) (2023)
- [Pixel Difference Convolutional Network for RGB-D Semantic Segmentation](https://mlsanity.com/paper/2302.11951/) (2023)
- [RADAM: Texture Recognition through Randomized Aggregated Encoding of Deep Activation Maps](https://mlsanity.com/paper/2303.04554/) (2023)
- [A General Framework for Hypercomplex-valued Extreme Learning Machines](https://mlsanity.com/paper/2101.06166/) (2021)
- [Recent Few-Shot Object Detection Algorithms: A Survey with Performance Comparison](https://mlsanity.com/paper/2203.14205/) (2022)
- [PDBL: Improving Histopathological Tissue Classification with Plug-and-Play Pyramidal Deep-Broad Learning](https://mlsanity.com/paper/2111.03063/) (2021)
- [A Comparative Survey of Vision Transformers for Feature Extraction in Texture Analysis](https://mlsanity.com/paper/2406.06136/) (2024)
- [Self-Supervised Learning to Guide Scientifically Relevant Categorization of Martian Terrain Images](https://mlsanity.com/paper/2204.09854/) (2022)
- [Compositional Neural Textures](https://mlsanity.com/paper/2404.12509/) (2024)
- [Histogram Layers for Neural Engineered Features](https://mlsanity.com/paper/2403.17176/) (2024)
- [Segmenting Object Affordances: Reproducibility and Sensitivity to Scale](https://mlsanity.com/paper/2409.01814/) (2024)
- [Hierarchical Material Recognition from Local Appearance](https://mlsanity.com/paper/2505.22911/) (2025)
- [Deep Multi-Resolution Dictionary Learning for Histopathology Image Analysis](https://mlsanity.com/paper/2104.00669/) (2021)
- [Learning-based Compression for Material and Texture Recognition](https://mlsanity.com/paper/2104.10065/) (2021)
- [SkinFormer: Learning Statistical Texture Representation with Transformer for Skin Lesion Segmentation](https://mlsanity.com/paper/2409.08652/) (2024)
- [Texture image classification based on a pseudo-parabolic diffusion model](https://mlsanity.com/paper/2011.07173/) (2020)
- [ContinuityLearner: Geometric Continuity Feature Learning for Lane Segmentation](https://mlsanity.com/paper/2108.03507/) (2021)
- [Deep learning for radar data exploitation of autonomous vehicle](https://mlsanity.com/paper/2203.08038/) (2022)
- [Coded Residual Transform for Generalizable Deep Metric Learning](https://mlsanity.com/paper/2210.04180/) (2022)
- [Learning a Pedestrian Social Behavior Dictionary](https://mlsanity.com/paper/2212.01426/) (2022)
- [Generalized Sum Pooling for Metric Learning](https://mlsanity.com/paper/2308.09228/) (2023)
- [Enhancing Martian Terrain Recognition with Deep Constrained Clustering](https://mlsanity.com/paper/2503.17633/) (2025)
- [Visual Affordance Prediction: Survey and Reproducibility](https://mlsanity.com/paper/2505.05074/) (2025)
- [Neighborhood Feature Pooling for Remote Sensing Image Classification](https://mlsanity.com/paper/2510.25077/) (2025)
- [ORCNet: A context-based network to simultaneously segment the ocular region components](https://mlsanity.com/paper/2204.07456/) (2022)

## Abstract (arXiv)

We propose a Deep Texture Encoding Network (Deep-TEN) with a novel Encoding Layer integrated on top of convolutional layers, which ports the entire dictionary learning and encoding pipeline into a single model. Current methods build from distinct components, using standard encoders with separate off-the-shelf features such as SIFT descriptors or pre-trained CNN features for material recognition. Our new approach provides an end-to-end learning framework, where the inherent visual vocabularies are learned directly from the loss function. The features, dictionaries and the encoding representation for the classifier are all learned simultaneously. The representation is orderless and therefore is particularly useful for material and texture recognition. The Encoding Layer generalizes robust residual encoders such as VLAD and Fisher Vectors, and has the property of discarding domain specific information which makes the learned convolutional features easier to transfer. Additionally, joint training using multiple datasets of varied sizes and class labels is supported resulting in increased recognition performance. The experimental results show superior performance as compared to state-of-the-art methods using gold-standard databases such as MINC-2500, Flickr Material Database, KTH-TIPS-2b, and two recent databases 4D-Light-Field-Material and GTOS. The source code for the complete system are publicly available.
