# DTR: A Unified Deep Tensor Representation Framework for Multimedia Data Recovery

arXiv: https://arxiv.org/abs/2407.05267 · HTML: https://mlsanity.com/paper/2407.05267/

## Key facts

- Cited by 1 papers in the map (data through 14 Oct 2026).
- Builds on 16 of its 45 references that are in the map.
- First posted on arXiv 7 Jul 2024.

## Builds on (most cited first, 16 of 16)

- [Adam: A Method for Stochastic Optimization](https://mlsanity.com/paper/1412.6980/) (2014)
- [U-Net: Convolutional Networks for Biomedical Image Segmentation](https://mlsanity.com/paper/1505.04597/) (2015)
- [Densely Connected Convolutional Networks](https://mlsanity.com/paper/1608.06993/) (2016)
- [V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentation](https://mlsanity.com/paper/1606.04797/) (2016)
- [Tensor Robust Principal Component Analysis with A New Tensor Nuclear Norm](https://mlsanity.com/paper/1804.03728/) (2018)
- [Novel methods for multilinear data completion and de-noising based on tensor-SVD](https://mlsanity.com/paper/1407.1785/) (2014)
- [Tensor Ring Decomposition with Rank Minimization on Latent Space: An Efficient Approach for Tensor Completion](https://mlsanity.com/paper/1809.02288/) (2018)
- [Framelet Representation of Tensor Nuclear Norm for Third-Order Tensor Completion](https://mlsanity.com/paper/1909.06982/) (2019)
- [Data augmentation for deep learning based accelerated MRI reconstruction with limited data](https://mlsanity.com/paper/2106.14947/) (2021)
- [Multi-dimensional imaging data recovery via minimizing the partial sum of tubal nuclear norm](https://mlsanity.com/paper/1712.05870/) (2017)
- [Dictionary Learning with Low-rank Coding Coefficients for Tensor Completion](https://mlsanity.com/paper/2009.12507/) (2020)
- [Self-Supervised Nonlinear Transform-Based Tensor Nuclear Norm for Multi-Dimensional Image Recovery](https://mlsanity.com/paper/2105.14320/) (2021)
- [Deep Plug-and-play Prior for Low-rank Tensor Completion](https://mlsanity.com/paper/1905.04449/) (2019)
- [Tensor-Based Classifiers for Hyperspectral Data Analysis](https://mlsanity.com/paper/1709.08164/) (2017)
- [Tensor Q-Rank: New Data Dependent Definition of Tensor Rank](https://mlsanity.com/paper/1910.12016/) (2019)
- [Adaptive and Implicit Regularization for Matrix Completion](https://mlsanity.com/paper/2208.05640/) (2022)

## Built on by (most cited first, 1 of 1)

- [Pre-Trained Low-Rank Tensor Decomposition for Multi-Dimensional Image Recovery](https://mlsanity.com/paper/2609.12843/) (2026)

## Abstract (arXiv)

Recently, the transform-based tensor representation has attracted increasing attention in multimedia data (e.g., images and videos) recovery problems, which consists of two indispensable components, i.e., transform and characterization. Previously, the development of transform-based tensor representation mainly focuses on the transform aspect. Although several attempts consider using shallow matrix factorization (e.g., singular value decomposition and negative matrix factorization) to characterize the frontal slices of transformed tensor (termed as latent tensor), the faithful characterization aspect is underexplored. To address this issue, we propose a unified Deep Tensor Representation (termed as DTR) framework by synergistically combining the deep latent generative module and the deep transform module. Especially, the deep latent generative module can faithfully generate the latent tensor as compared with shallow matrix factorization. The new DTR framework not only allows us to better understand the classic shallow representations, but also leads us to explore new representation. To examine the representation ability of the proposed DTR, we consider the representative multi-dimensional data recovery task and suggest an unsupervised DTR-based multi-dimensional data recovery model. Extensive experiments demonstrate that DTR achieves superior performance compared to state-of-the-art methods in both quantitative and qualitative aspects, especially for fine details recovery.
