FITRep: Attention-Guided Item Representation via MLLMs
Not on the map. Why?
Abstract (arXiv)
Online platforms usually suffer from user experience degradation due to near-duplicate items with similar visuals and text. While Multimodal Large Language Models (MLLMs) enable multimodal embedding, existing methods treat representations as black boxes, ignoring structural relationships (e.g., primary vs. auxiliary elements), leading to local structural collapse problem. To address this, inspired by Feature Integration Theory (FIT), we propose FITRep, the first attention-guided, white-box item representation framework for fine-grained item deduplication. FITRep consists of: (1) Concept Hierarchical Information Extraction (CHIE), using MLLMs to extract hierarchical semantic concepts; (2) Structure-Preserving Dimensionality Reduction (SPDR), an adaptive UMAP-based method for efficient information compression; and (3) FAISS-Based Clustering (FBC), a FAISS-based clustering that assigns each item a unique cluster id using FAISS. Deployed on Meituan's advertising system, FITRep achieves +3.60% CTR and +4.25% CPM gains in online A/B tests, demonstrating both effectiveness and real-world impact.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 4 of its 9 references that are in the map. First posted on arXiv 26 Nov 2025.
Builds on
4 of 9 references.
References · 4
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2025Qwen2.5-VL Technical Reportcited by 5,418
- 2023Towards General Text Embeddings with Multi-stage Contrastive Learningcited by 705
- 2024Harnessing Multimodal Large Language Models for Multimodal Sequential Recommendationcited by 33
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026MMRM: A Multiplex Multimodal Representation Model for Product Ranking in E-commerce Search
- 2025MOON: Generative MLLM-based Multimodal Representation Learning for E-commerce Product Understanding
- 2025Bridging Modality Gaps in e-Commerce Products via Vision-Language Alignment ↗
- 2026RETLLM: Training and Data-Free MLLMs for Multimodal Information Retrieval
- 2025MOON2.0: Dynamic Modality-balanced Multimodal Representation Learning for E-commerce Product Understanding
- 2026Text-Guided Visual Representation Learning for Robust Multimodal E-Commerce Recommendation ↗
- 2025Factorized Transport Alignment for Multimodal and Multiview E-commerce Representation Learning ↗
- 2024MRSE: An Efficient Multi-modality Retrieval System for Large Scale E-commerce