Learning Representations from Imperfect Time Series Data via Tensor Rank Regularization
Not on the map. Why?
Abstract (arXiv)
There has been an increased interest in multimodal language processing including multimodal dialog, question answering, sentiment analysis, and speech recognition. However, naturally occurring multimodal data is often imperfect as a result of imperfect modalities, missing entries or noise corruption. To address these concerns, we present a regularization method based on tensor rank minimization. Our method is based on the observation that high-dimensional multimodal time series data often exhibit correlations across time and modalities which leads to low-rank tensor representations. However, the presence of noise or incomplete values breaks these correlations and results in tensor representations of higher rank. We design a model to learn such tensor representations and effectively regularize their rank. Experiments on multimodal language data show that our model achieves good results across various levels of imperfection.
Key facts. Cited by 30 papers in the map (data through 7 Oct 2026). First posted on arXiv 1 Jul 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 2; 2022: 9; 2023: 6; 2024: 4; 2025: 4; 2026: 5.
30 papers.
Sort:
By area:
- 2021MultiBench: Multiscale Benchmarks for Multimodal Representation Learningcited by 143
- 2022Foundations and Trends in Multimodal Machine Learning: Principles, Challenges, and Open Questionscited by 116
- 2024Deep Multimodal Learning with Missing Modality: A Surveycited by 89
- 2022GCNet: Graph Completion Network for Incomplete Multimodal Learning in Conversationcited by 86
- 2023Quantifying & Modeling Multimodal Interactions: An Information Decomposition Frameworkcited by 81
- 2022Multimodal Information Bottleneck: Learning Minimal Sufficient Unimodal and Multimodal Representationscited by 48
- 2021Trustworthy Multimodal Regression with Mixture of Normal-inverse Gamma Distributionscited by 39
- 2022M-SENA: An Integrated Platform for Multimodal Sentiment Analysiscited by 21
- 2022Efficient Multimodal Transformer with Dual-Level Feature Restoration for Robust Multimodal Sentiment Analysiscited by 20
- 2023Multimodal Learning Without Labeled Multimodal Data: Guarantees and Applicationscited by 20
- 2023Multimodal Fusion Interactions: A Study of Human and Automatic Quantificationcited by 9
- 2025MAESTRO : Adaptive Sparse Attention and Robust Learning for Multimodal Dynamic Time Seriescited by 9
18 more
- 2022MM-Align: Learning Optimal Transport-based Alignment Dynamics for Fast and Accurate Inference on Missing Modality Sequencescited by 8
- 2022Sentiment Word Aware Multimodal Refinement for Multimodal Sentiment Analysis with ASR Errorscited by 7
- 2022Brainish: Formalizing A Multimodal Language for Intelligence and Consciousnesscited by 4
- 2023MultiZoo & MultiBench: A Standardized Toolkit for Multimodal Deep Learningcited by 4
- 2024CT2C-QA: Multimodal Question Answering over Chinese Text, Table and Chartcited by 4
- 2025Partial Information Decomposition via Normalizing Flows in Latent Gaussian Distributionscited by 4
- 2023Fuse It or Lose It: Deep Fusion for Multimodal Simulation-Based Inferencecited by 3
- 2024Meta-Learn Unimodal Signals with Weak Supervision for Multimodal Sentiment Analysiscited by 2
- 2022Curriculum Learning Meets Weakly Supervised Modality Correlation Learningcited by 1
- 2023Modality-Collaborative Transformer with Hybrid Feature Reconstruction for Robust Emotion Recognitioncited by 1
- 2025Uncertainty-Aware Collaborative System of Large and Small Models for Multimodal Sentiment Analysiscited by 1
- 2026REMIND: Rethinking Medical High-Modality Learning under Missingness--A Long-Tailed Distribution Perspectivecited by 1
- 2026Addressing Missing and Noisy Modalities in One Solution: Unified Modality-Quality Framework for Low-quality Multimodal Datacited by 1
- 2026Head-wise Modality Specialization within MLLMs for Robust Fake News Detection under Missing Modalitycited by 1
- 2024Collaborative Position Reasoning Network for Referring Image Segmentationcited by 0
- 2025ADMC: Attention-based Diffusion Model for Missing Modalities Feature Completioncited by 0
- 2026GRCF: Two-Stage Groupwise Ranking and Calibration Framework for Multimodal Sentiment Analysiscited by 0
- 2026Reliability-aware Cross-sample Enhancement for Robust Multimodal Sentiment Analysiscited by 0
- 2026Reliability-aware Cross-sample Enhancement for Robust Multimodal Sentiment Analysis24 Sep 2026
- 2026Head-wise Modality Specialization within MLLMs for Robust Fake News Detection under Missing Modality8 Apr 2026
- 2026Addressing Missing and Noisy Modalities in One Solution: Unified Modality-Quality Framework for Low-quality Multimodal Data3 Mar 2026
- 2026REMIND: Rethinking Medical High-Modality Learning under Missingness--A Long-Tailed Distribution Perspective9 Feb 2026
- 2026GRCF: Two-Stage Groupwise Ranking and Calibration Framework for Multimodal Sentiment Analysis14 Jan 2026
- 2025Partial Information Decomposition via Normalizing Flows in Latent Gaussian Distributions6 Oct 2025
- 2025MAESTRO : Adaptive Sparse Attention and Robust Learning for Multimodal Dynamic Time Series29 Sep 2025
- 2025Uncertainty-Aware Collaborative System of Large and Small Models for Multimodal Sentiment Analysis27 Aug 2025
- 2025ADMC: Attention-based Diffusion Model for Missing Modalities Feature Completion8 Jul 2025
- 2024CT2C-QA: Multimodal Question Answering over Chinese Text, Table and Chart28 Oct 2024
- 2024Deep Multimodal Learning with Missing Modality: A Survey12 Sep 2024
- 2024Meta-Learn Unimodal Signals with Weak Supervision for Multimodal Sentiment Analysis28 Aug 2024
18 more
- 2024Collaborative Position Reasoning Network for Referring Image Segmentation22 Jan 2024
- 2023Modality-Collaborative Transformer with Hybrid Feature Reconstruction for Robust Emotion Recognition26 Dec 2023
- 2023Fuse It or Lose It: Deep Fusion for Multimodal Simulation-Based Inference17 Nov 2023
- 2023MultiZoo & MultiBench: A Standardized Toolkit for Multimodal Deep Learning28 Jun 2023
- 2023Multimodal Learning Without Labeled Multimodal Data: Guarantees and Applications7 Jun 2023
- 2023Multimodal Fusion Interactions: A Study of Human and Automatic Quantification7 Jun 2023
- 2023Quantifying & Modeling Multimodal Interactions: An Information Decomposition Framework23 Feb 2023
- 2022Curriculum Learning Meets Weakly Supervised Modality Correlation Learning15 Dec 2022
- 2022Multimodal Information Bottleneck: Learning Minimal Sufficient Unimodal and Multimodal Representations31 Oct 2022
- 2022MM-Align: Learning Optimal Transport-based Alignment Dynamics for Fast and Accurate Inference on Missing Modality Sequences23 Oct 2022
- 2022Foundations and Trends in Multimodal Machine Learning: Principles, Challenges, and Open Questions7 Sep 2022
- 2022Efficient Multimodal Transformer with Dual-Level Feature Restoration for Robust Multimodal Sentiment Analysis16 Aug 2022
- 2022Brainish: Formalizing A Multimodal Language for Intelligence and Consciousness14 Apr 2022
- 2022M-SENA: An Integrated Platform for Multimodal Sentiment Analysis23 Mar 2022
- 2022GCNet: Graph Completion Network for Incomplete Multimodal Learning in Conversation4 Mar 2022
- 2022Sentiment Word Aware Multimodal Refinement for Multimodal Sentiment Analysis with ASR Errors1 Mar 2022
- 2021Trustworthy Multimodal Regression with Mixture of Normal-inverse Gamma Distributions11 Nov 2021
- 2021MultiBench: Multiscale Benchmarks for Multimodal Representation Learning15 Jul 2021
- 2021MultiBench: Multiscale Benchmarks for Multimodal Representation Learningcited by 143
- 2022Foundations and Trends in Multimodal Machine Learning: Principles, Challenges, and Open Questionscited by 116
- 2024Deep Multimodal Learning with Missing Modality: A Surveycited by 89
- 2022GCNet: Graph Completion Network for Incomplete Multimodal Learning in Conversationcited by 86
- 2023Quantifying & Modeling Multimodal Interactions: An Information Decomposition Frameworkcited by 81
- 2022Multimodal Information Bottleneck: Learning Minimal Sufficient Unimodal and Multimodal Representationscited by 48
- 2021Trustworthy Multimodal Regression with Mixture of Normal-inverse Gamma Distributionscited by 39
- 2022M-SENA: An Integrated Platform for Multimodal Sentiment Analysiscited by 21
- 2022Efficient Multimodal Transformer with Dual-Level Feature Restoration for Robust Multimodal Sentiment Analysiscited by 20
- 2023Multimodal Learning Without Labeled Multimodal Data: Guarantees and Applicationscited by 20
- 2023Multimodal Fusion Interactions: A Study of Human and Automatic Quantificationcited by 9
- 2022MM-Align: Learning Optimal Transport-based Alignment Dynamics for Fast and Accurate Inference on Missing Modality Sequencescited by 8
12 most cited of 28 All 28 (JSON)
- 2026Reliability-aware Cross-sample Enhancement for Robust Multimodal Sentiment Analysis24 Sep 2026
- 2026Head-wise Modality Specialization within MLLMs for Robust Fake News Detection under Missing Modality8 Apr 2026
- 2026Addressing Missing and Noisy Modalities in One Solution: Unified Modality-Quality Framework for Low-quality Multimodal Data3 Mar 2026
- 2026REMIND: Rethinking Medical High-Modality Learning under Missingness--A Long-Tailed Distribution Perspective9 Feb 2026
- 2026GRCF: Two-Stage Groupwise Ranking and Calibration Framework for Multimodal Sentiment Analysis14 Jan 2026
- 2025Partial Information Decomposition via Normalizing Flows in Latent Gaussian Distributions6 Oct 2025
- 2025Uncertainty-Aware Collaborative System of Large and Small Models for Multimodal Sentiment Analysis27 Aug 2025
- 2024CT2C-QA: Multimodal Question Answering over Chinese Text, Table and Chart28 Oct 2024
- 2024Deep Multimodal Learning with Missing Modality: A Survey12 Sep 2024
- 2024Meta-Learn Unimodal Signals with Weak Supervision for Multimodal Sentiment Analysis28 Aug 2024
- 2024Collaborative Position Reasoning Network for Referring Image Segmentation22 Jan 2024
- 2023Modality-Collaborative Transformer with Hybrid Feature Reconstruction for Robust Emotion Recognition26 Dec 2023
12 newest of 28 All 28 (JSON)