# Enabling Tensor Decomposition for Time-Series Classification via A Simple Pseudo-Laplacian Contrast

arXiv: https://arxiv.org/abs/2409.15200 · HTML: https://mlsanity.com/paper/2409.15200/

## Key facts

- No citing papers in the map yet (data through 14 Oct 2026).
- Builds on 20 of its 27 references that are in the map.
- First posted on arXiv 23 Sep 2024.

## Builds on (most cited first, 20 of 20)

- [A Simple Framework for Contrastive Learning of Visual Representations](https://mlsanity.com/paper/2002.05709/) (2020)
- [Representation Learning with Contrastive Predictive Coding](https://mlsanity.com/paper/1807.03748/) (2018)
- [Momentum Contrast for Unsupervised Visual Representation Learning](https://mlsanity.com/paper/1911.05722/) (2019)
- [Bootstrap your own latent: A new approach to self-supervised Learning](https://mlsanity.com/paper/2006.07733/) (2020)
- [Deep Clustering for Unsupervised Learning of Visual Features](https://mlsanity.com/paper/1807.05520/) (2018)
- [Prototypical Contrastive Learning of Unsupervised Representations](https://mlsanity.com/paper/2005.04966/) (2020)
- [Contrastive Learning with Hard Negative Samples](https://mlsanity.com/paper/2010.04592/) (2020)
- [A Theoretical Analysis of Contrastive Unsupervised Representation Learning](https://mlsanity.com/paper/1902.09229/) (2019)
- [Tensor Decomposition for Signal Processing and Machine Learning](https://mlsanity.com/paper/1607.01668/) (2016)
- [Data Augmentation Can Improve Robustness](https://mlsanity.com/paper/2111.05328/) (2021)
- [A Kernel Theory of Modern Data Augmentation](https://mlsanity.com/paper/1803.06084/) (2018)
- [Subject-Aware Contrastive Learning for Biosignals](https://mlsanity.com/paper/2007.04871/) (2020)
- [Tensor Completion for Weakly-dependent Data on Graph for Metro Passenger Flow Prediction](https://mlsanity.com/paper/1912.05693/) (2019)
- [Long-Short Term Spatiotemporal Tensor Prediction for Passenger Flow Profile](https://mlsanity.com/paper/2004.11022/) (2020)
- [DeepTensor: Low-Rank Tensor Decomposition with Deep Network Priors](https://mlsanity.com/paper/2204.03145/) (2022)
- [High-dimensional vector autoregressive time series modeling via tensor decomposition](https://mlsanity.com/paper/1909.06624/) (2019)
- [TiCo: Transformation Invariance and Covariance Contrast for Self-Supervised Visual Representation Learning](https://mlsanity.com/paper/2206.10698/) (2022)
- [ATD: Augmenting CP Tensor Decomposition by Self Supervision](https://mlsanity.com/paper/2106.07900/) (2021)
- [Spectral Theory of Unsigned and Signed Graphs. Applications to Graph Clustering: a Survey](https://mlsanity.com/paper/1601.04692/) (2016)
- [Low-Rank Robust Subspace Tensor Clustering for Metro Passenger Flow Modeling](https://mlsanity.com/paper/2404.04403/) (2024)

## Abstract (arXiv)

Tensor decomposition has emerged as a prominent technique to learn low-dimensional representation under the supervision of reconstruction error, primarily benefiting data inference tasks like completion and imputation, but not classification task. We argue that the non-uniqueness and rotation invariance of tensor decomposition allow us to identify the directions with largest class-variability and simple graph Laplacian can effectively achieve this objective. Therefore we propose a novel Pseudo Laplacian Contrast (PLC) tensor decomposition framework, which integrates the data augmentation and cross-view Laplacian to enable the extraction of class-aware representations while effectively capturing the intrinsic low-rank structure within reconstruction constraint. An unsupervised alternative optimization algorithm is further developed to iteratively estimate the pseudo graph and minimize the loss using Alternating Least Square (ALS). Extensive experimental results on various datasets demonstrate the effectiveness of our approach.
