Alternative Telescopic Displacement: An Efficient Multimodal Alignment Method
Not on the map. Why?
Abstract (arXiv)
In the realm of multimodal data integration, feature alignment plays a pivotal role. This paper introduces an innovative approach to feature alignment that revolutionizes the fusion of multimodal information. Our method employs a novel iterative process of telescopic displacement and expansion of feature representations across different modalities, culminating in a coherent unified representation within a shared feature space. This sophisticated technique demonstrates a remarkable ability to capture and leverage complex crossmodal interactions at the highest levels of abstraction. As a result, we observe significant enhancements in the performance of multimodal learning tasks. Through rigorous comparative analysis, we establish the superiority of our approach over existing multimodal fusion paradigms across a diverse array of applications. Comprehensive empirical evaluations conducted on multifaceted datasets encompassing temporal sequences, visual data, and textual information provide compelling evidence that our method achieves unprecedented benchmarks in the field. This work not only advances the state of the art in multimodal learning but also opens new avenues for exploring the synergies between disparate data modalities in complex analytical scenarios.
Key facts. Cited by 6 papers in the map (data through 13 Oct 2026). Builds on 16 of its 44 references that are in the map. First posted on arXiv 29 Jun 2023.
Builds on
16 of 44 references.
References · 16
- 2015Deep Residual Learning for Image Recognitioncited by 51,950
- 2021Scaling Up Visual and Vision-Language Representation Learning With Noisy Text Supervisioncited by 3,855
- 2020Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecastingcited by 2,157
- 2022Are Transformers Effective for Time Series Forecasting?cited by 1,413
- 2017Multimodal Machine Learning: A Survey and Taxonomycited by 1,009
- 2020Contrastive Learning of Medical Visual Representations from Paired Images and Textcited by 639
- 2021Unifying Vision-and-Language Tasks via Text Generationcited by 411
- 2021SCINet: Time Series Modeling and Forecasting with Sample Convolution and Interactioncited by 337
- 2018Efficient Low-rank Multimodal Fusion with Modality-Specific Factorscited by 269
- 2022FiLM: Frequency improved Legendre Memory Model for Long-term Time Series Forecastingcited by 147
- 2021CAT: Cross Attention in Vision Transformercited by 92
- 2022Exploring a Fine-Grained Multiscale Method for Cross-Modal Remote Sensing Image Retrievalcited by 77
4 more
- 2015Deep Multimodal Learning for Audio-Visual Speech Recognitioncited by 37
- 2022Towards Multi-Modal Sarcasm Detection via Hierarchical Congruity Modeling with Knowledge Enhancementcited by 26
- 2017Modality-specific Cross-modal Similarity Measurement with Recurrent Attention Networkcited by 11
- 2022A Personalized Zero-Shot ECG Arrhythmia Monitoring System: From Sparse Representation Based Domain Adaption to Energy Efficient Abnormal Beat Detection for Practical ECG Surveillancecited by 6
Built on by
Citing papers per year: 2024: 2; 2025: 0; 2026: 4.
6 papers.
- 2024Multimodal Alignment and Fusion: A Surveycited by 74
- 2026Learning Domain-Invariant Representations for Cross-Domain Image Registration via Scene-Appearance Disentanglementcited by 3
- 2024Bio-Inspired Mamba: Temporal Locality and Bioplausible Learning in Selective State Space Modelscited by 1
- 2026SAS-Net: Cross-Domain Image Registration as Inverse Rendering via Structure-Appearance Factorizationcited by 0
- 2026PCReg-Net: Progressive Contrast-Guided Registration for Cross-Domain Image Alignmentcited by 0
- 2026Deformation-Free Cross-Domain Image Registration via Position-Encoded Temporal Attentioncited by 0
- 2026Deformation-Free Cross-Domain Image Registration via Position-Encoded Temporal Attention17 Feb 2026
- 2026PCReg-Net: Progressive Contrast-Guided Registration for Cross-Domain Image Alignment9 Feb 2026
- 2026SAS-Net: Cross-Domain Image Registration as Inverse Rendering via Structure-Appearance Factorization6 Feb 2026
- 2026Learning Domain-Invariant Representations for Cross-Domain Image Registration via Scene-Appearance Disentanglement12 Jan 2026
- 2024Multimodal Alignment and Fusion: A Survey26 Nov 2024
- 2024Bio-Inspired Mamba: Temporal Locality and Bioplausible Learning in Selective State Space Models17 Sep 2024