Bounded-Compute Multimodal Regression for Product-Rating Prediction
On the map: Multimodal LLMs / vision-language models → MLLM training and visual instruction tuning
Abstract (arXiv)
Vision-language models (VLMs) are increasingly attractive for multimodal quality assessment, but their default reliance on autoregressive text generation and dynamic visual processing is poorly matched to scalar regression under strict latency budgets. We present a bounded-compute adaptation of SmolVLM2-256M-Video-Instruct for product-rating prediction in the LoViF 2026 Efficient VLM challenge. Motivated by recent multimodal engagement-prediction results showing that feature-based regression can outperform token-based score generation, we replace the language-modeling head with a lightweight two-layer MLP fed by pooled decoder states, and we enforce deterministic inputs through fixed 384x384 images and truncated metadata. Across controlled ablations, static global image processing slightly outperforms dynamic tiling, and scaling from 100K to 16M training examples substantially improves validation correlation. Under the official held-out evaluation, our 228M-parameter model achieves 0.39 PLCC and 0.40 CES, providing a strong and reproducible baseline for resource-constrained multimodal regression.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in MLLM training and visual instruction tuning, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 25 of its 29 references that are in the map. First posted on arXiv 26 May 2026.
Builds on
25 of 29 references.
Closest ancestors · 3
Same direction, newest first
- 2024DeepSeek-VL2: Mixture-of-Experts Vision-Language Models for Advanced Multimodal Understanding13 Dec
- 2024MiniCPM-V: A GPT-4V Level MLLM on Your Phone3 Aug
- 2023Improved Baselines with Visual Instruction Tuning5 Oct
Other references · 22
- 2025Qwen3 Technical Reportcited by 8,820
- 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,137
- 2025Qwen2.5-VL Technical Reportcited by 5,587
- 2022Flamingo: a Visual Language Model for Few-Shot Learningcited by 4,386
- 2023FlashAttention-2: Faster Attention with Better Parallelism and Work Partitioningcited by 2,598
- 2023Qwen-VL: A Versatile Vision-Language Model for Understanding, Localization, Text Reading, and Beyondcited by 2,224
- 2024Qwen2 Technical Reportcited by 2,120
- 20218-bit Optimizers via Block-wise Quantizationcited by 403
- 2024What matters when building vision-language models?cited by 326
- 2025SmolVLM: Redefining small and efficient multimodal modelscited by 237
- 2024PaliGemma 2: A Family of Versatile VLMs for Transfercited by 207
- 2024MobileVLM V2: Faster and Stronger Baseline for Vision Language Modelcited by 174
10 more
- 2024Building and better understanding vision-language models: insights and future directionscited by 173
- 2015VBPR: Visual Bayesian Personalized Ranking from Implicit Feedbackcited by 151
- 2023MobileVLM : A Fast, Strong and Open Vision Language Assistant for Mobile Devicescited by 122
- 2023Depicting Beyond Scores: Advancing Image Quality Assessment through Multi-modal Language Modelscited by 105
- 2024AesBench: An Expert Benchmark for Multimodal Large Language Models on Image Aesthetics Perceptioncited by 65
- 2023Multimodal Recommender Systems: A Surveycited by 37
- 2022SANCL: Multimodal Review Helpfulness Prediction with Selective Attention and Natural Contrastive Learningcited by 12
- 2025VQualA 2025 Challenge on Engagement Prediction for Short Videos: Methods and Resultscited by 6
- 2024Delving Deep into Engagement Prediction of Short Videoscited by 4
- 2025Engagement Prediction of Short Videos with Large Multimodal Modelscited by 4
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026EffiMiniVLM: A Compact Dual-Encoder Regression Framework
- 2025Language Integration in Fine-Tuning Multimodal Large Language Models for Image-Based Regression
- 2026Decoupling Perception and Calibration: Label-Efficient Image Quality Assessment Framework
- 2026VLM Judges Can Rank but Cannot Score: Task-Dependent Uncertainty in Multimodal Evaluation
- 2024Expanding Performance Boundaries of Open-Source Multimodal Models with Model, Data, and Test-Time Scaling
- 2025STORM: Benchmarking Visual Rating of MLLMs with a Comprehensive Ordinal Regression Dataset
- 2025Demystifying the Visual Quality Paradox in Multimodal Large Language Models
- 2025Q-CLIP: Unleashing the Power of Vision-Language Models for Video Quality Assessment through Unified Cross-Modal Adaptation