Challenges of Multi-Modal Coreset Selection for Depth Prediction
Not on the map. Why?
Abstract (arXiv)
Coreset selection methods are effective in accelerating training and reducing memory requirements but remain largely unexplored in applied multimodal settings. We adapt a state-of-the-art (SoTA) coreset selection technique for multimodal data, focusing on the depth prediction task. Our experiments with embedding aggregation and dimensionality reduction approaches reveal the challenges of extending unimodal algorithms to multimodal scenarios, highlighting the need for specialized methods to better capture inter-modal relationships.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 11 of its 15 references that are in the map. First posted on arXiv 20 Feb 2025.
Builds on
11 of 15 references.
References · 11
- 2014ImageNet Large Scale Visual Recognition Challengecited by 8,441
- 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,131
- 2018UMAP: Uniform Manifold Approximation and Projection for Dimension Reductioncited by 2,841
- 2021Vision Transformers for Dense Predictioncited by 1,789
- 2016CLEVR: A Diagnostic Dataset for Compositional Language and Elementary Visual Reasoningcited by 1,445
- 2019Selection via Proxy: Efficient Data Selection for Deep Learningcited by 337
- 2021Omnidata: A Scalable Pipeline for Making Multi-Task Mid-Level Vision Datasets from 3D Scanscited by 336
- 2022MultiMAE: Multi-modal Multi-task Masked Autoencoderscited by 287
- 2020Deep Learning for Image and Point Cloud Fusion in Autonomous Driving: A Reviewcited by 107
- 2020Submodular Combinatorial Information Measures with Applications in Machine Learningcited by 88
- 20244M-21: An Any-to-Any Vision Model for Tens of Tasks and Modalitiescited by 52
Built on by
Not cited yet.