CMAG: Concept-Scaffolded Retrieval for Marketplace Avatar Generation
Not on the map. Why?
Abstract (arXiv)
Metaverse platforms rely on creator-driven marketplaces where avatars are assembled from discrete, taxonomy-labeled 3D assets (e.g., tops, bottoms, shoes, accessories) under strict category and topology constraints. While users increasingly expect free-form text control, text-only retrieval is brittle: natural language is ambiguous with respect to platform taxonomies, metadata is often noisy or informal, and independently retrieved components can be stylistically inconsistent or geometrically incompatible. We propose CMAG, a concept-scaffolded retrieval and verified composition framework for marketplace avatar generation. Given a prompt, CMAG first synthesizes an intermediate 3D concept scaffold that disambiguates intent beyond text by providing global spatial and stylistic context. In parallel, a view-aware part discovery module extracts localized visual evidence via prompt decomposition and text-grounded segmentation. A prompt-conditioned taxonomy router enforces category coverage and resolves semantic-to-taxonomic mismatch, after which a hybrid category-wise retriever combines part-based fusion with a concept-residual fallback using feature suppression. Finally, an agentic vision--language model filters and re-ranks candidates across categories and drives an iterative verification loop to assemble prompt-faithful, topologically consistent avatars from catalog assets. We evaluate CMAG on diverse compositional prompts and demonstrate improved retrieval robustness and compositional correctness compared to strong baselines, highlighting the importance of 3D concept scaffolding under prompt ambiguity.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 13 of its 16 references that are in the map. First posted on arXiv 18 May 2026.
Builds on
13 of 16 references.
References · 13
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,025
- 2025OpenAI GPT-5 System Cardcited by 989
- 2024The Faiss librarycited by 376
- 2025Hunyuan3D 2.0: Scaling Diffusion Models for High Resolution Textured 3D Assets Generationcited by 356
- 2024Generating CAD Code with Vision-Language Models for 3D Designscited by 62
- 2025Localized Concept Erasure for Text-to-Image Diffusion Models Using Training-Free Gated Low-Rank Adaptationcited by 33
- 2025LL3M: Large Language 3D Modelerscited by 20
- 2025Eval3D: Interpretable and Fine-grained Evaluation for 3D Generationcited by 16
- 2025IP-Composer: Semantic Composition of Visual Conceptscited by 14
- 2024Deep Geometric Moments Promote Shape Consistency in Text-to-3D Generationcited by 5
- 2024Learning Low-Rank Feature for Thorax Disease Classificationcited by 4
1 more
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025MetaFind: Scene-Aware 3D Asset Retrieval for Coherent Metaverse Scene Generation
- 2025Bridging Modality Gaps in e-Commerce Products via Vision-Language Alignment ↗
- 2024Vision Search Assistant: Empower Vision-Language Models as Multimodal Search Engines
- 2026Seeing Through Words: Controlling Visual Retrieval Quality with Language Models
- 2026Retrieve, Match, Escalate: Accurate and Scalable Product Linking with VLM-Distilled Cross-Encoders and Agentic VLMs
- 2024KITTEN: A Knowledge-Intensive Evaluation of Image Generation on Visual Entities
- 2026FashionMV: Product-Level Composed Image Retrieval with Multi-View Fashion Data
- 2025mRAG: Elucidating the Design Space of Multi-modal Retrieval-Augmented Generation