mlsanityData to 7 Oct 2026

Beyond Pixels: Visual Metaphor Transfer via Schema-Driven Agentic Reasoning

arXiv 2602.01335 ↗First posted 1 Feb 2026cs.CV cs.AIcited by 4

On the map: LLM agents and tool use → Multimodal and embodied agents

Abstract (arXiv)

A visual metaphor constitutes a high-order form of human creativity, employing cross-domain semantic fusion to transform abstract concepts into impactful visual rhetoric. Despite the remarkable progress of generative AI, existing models remain largely confined to pixel-level instruction alignment and surface-level appearance preservation, failing to capture the underlying abstract logic necessary for genuine metaphorical generation. To bridge this gap, we introduce the task of Visual Metaphor Transfer (VMT), which challenges models to autonomously decouple the "creative essence" from a reference image and re-materialize that abstract logic onto a user-specified target subject. We propose a cognitive-inspired, multi-agent framework that operationalizes Conceptual Blending Theory (CBT) through a novel Schema Grammar ("G"). This structured representation decouples relational invariants from specific visual entities, providing a rigorous foundation for cross-domain logic re-instantiation. Our pipeline executes VMT through a collaborative system of specialized agents: a perception agent that distills the reference into a schema, a transfer agent that maintains generic space invariance to discover apt carriers, a generation agent for high-fidelity synthesis and a hierarchical diagnostic agent that mimics a professional critic, performing closed-loop backtracking to identify and rectify errors across abstract logic, component selection, and prompt encoding. Extensive experiments and human evaluations demonstrate that our method significantly outperforms SOTA baselines in metaphor consistency, analogy appropriateness, and visual creativity, paving the way for automated high-impact creative applications in advertising and media. Project page with source code and self-contained skills is at https://yuci-gpt.github.io/Beyond-Pixels/.

Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Placed in Multimodal and embodied agents, one of 16 directions in LLM agents and tool use. Builds on 28 of its 51 references that are in the map. First posted on arXiv 1 Feb 2026.

Builds on

28 of 51 references.

Closest ancestors · 1

Same direction, newest first

  1. 2025EditDuet: A Multi-Agent System for Video Non-Linear Editing13 Sep

Other references · 27

  1. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
  2. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
  3. 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,286
  4. 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,274
  5. 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,048
  6. 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,231
  7. 2025Qwen-Image Technical Reportcited by 973
  8. 2025Emerging Properties in Unified Multimodal Pretrainingcited by 855
  9. 2022Inversion-Based Style Transfer with Diffusion Modelscited by 290
  10. 2025Seedream 4.0: Toward Next-generation Multimodal Image Generationcited by 233
  11. 2023Break-A-Scene: Extracting Multiple Concepts from a Single Imagecited by 230
  12. 2023Style Aligned Image Generation via Shared Attentioncited by 214
15 more
  1. 2025HunyuanImage 3.0 Technical Reportcited by 138
  2. 2025DreamO: A Unified Framework for Image Customizationcited by 82
  3. 2023I Spy a Metaphor: Large Language Models and Diffusion Models Co-Create Visual Metaphorscited by 31
  4. 2024SketchAgent: Language-Driven Sequential Sketch Generationcited by 30
  5. 2022MetaCLUE: Towards Comprehensive Visual Metaphors Researchcited by 28
  6. 2025Personalized Image Generation with Deep Generative Models: A Decade Surveycited by 20
  7. 2023Text-to-Image Generation for Abstract Conceptscited by 18
  8. 2023A Unified Arbitrary Style Transfer Framework via Adaptive Contrastive Learningcited by 10
  9. 2024Prompt Optimizer of Text-to-Image Diffusion Models for Abstract Concept Understandingcited by 9
  10. 2025In-Context Brush: Zero-shot Customized Subject Insertion with Context-Aware Latent Space Manipulationcited by 7
  11. 2026TAG-MoE: Task-Aware Gating for Unified Generative Mixture-of-Expertscited by 6
  12. 2025The Mind's Eye: A Multi-Faceted Reward Framework for Guiding Visual Metaphor Generationcited by 4
  13. 2024IIDM: Image-to-Image Diffusion Model for Semantic Image Synthesiscited by 3
  14. 2025IP-Prompter: Training-Free Theme-Specific Image Generation via Dynamic Visual Promptingcited by 3
  15. 2025Concept Drift Guided LayerNorm Tuning for Efficient Multimodal Metaphor Identificationcited by 3

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 4.

4 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Less Is More: Balancing Positive and Negative Space in Visual Concept Blending
  2. 2026Think in Strokes, Not Pixels: Process-Driven Image Generation via Interleaved Reasoning
  3. 2024DiffusionAgent: Navigating Expert Models for Agentic Image Generation
  4. 2025Imagine for Me: Creative Conceptual Blending of Real Images and Text via Blended Attention
  5. 2026GenClaw: Code-Driven Agentic Image Generation
  6. 2025Probing and Inducing Combinational Creativity in Vision-Language Models
  7. 2026ExpertVerse: A General-Purpose Benchmark for Expert-Level Reasoning in Knowledge-Intensive Visual Synthesis
  8. 2026Thinking with Drafting: Optical Decompression via Logical Reconstruction