Generative Engine Optimization: A VLM and Agent Framework for Pinterest Acquisition Growth
On the map: LLM agents and tool use → Multimodal and embodied agents
Abstract (arXiv)
Large Language Models are fundamentally reshaping content discovery through AI-native search systems such as ChatGPT, Gemini, and Claude. Unlike traditional search engines that match keywords to documents, these systems infer user intent, synthesize multimodal evidence, and generate contextual answers directly on the search page, introducing a paradigm shift from Search Engine Optimization (SEO) to Generative Engine Optimization (GEO). For visual content platforms hosting billions of assets, this poses an acute challenge: individual images lack the semantic depth and authority signals that generative search prioritizes, risking disintermediation as user needs are satisfied in-place without site visits. We present Pinterest GEO, a production-scale framework that pioneers reverse search design: rather than generating generic image captions describing what content is, we fine-tune Vision-Language Models (VLMs) to predict what users would actually search for, augmented this with AI agents that mine real-time internet trends to capture emerging search demand. These VLM-generated queries then drive construction of semantically coherent Collection Pages via multimodal embeddings, creating indexable aggregations optimized for generative retrieval. Finally, we employ hybrid VLM and two-tower ANN architectures to build authority-aware interlinking structures that propagate signals across billions of visual assets. Deployed at scale across billions of images and tens of millions of collections, GEO delivers 20% organic traffic growth contributing to multi-million monthly active user (MAU) growth, demonstrating a principled pathway for visual platforms to thrive in the generative search era.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Multimodal and embodied agents, one of 16 directions in LLM agents and tool use. Builds on 26 of its 63 references that are in the map. First posted on arXiv 3 Feb 2026.
Builds on
26 of 63 references.
References · 26
- 2017Attention Is All You Needcited by 60,361
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2022Training language models to follow instructions with human feedbackcited by 15,971
- 2017Proximal Policy Optimization Algorithmscited by 15,215
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
- 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 8,065
- 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,944
- 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,182
- 2021Finetuned Language Models Are Zero-Shot Learnerscited by 3,780
- 2023InstructBLIP: Towards General-purpose Vision-Language Models with Instruction Tuningcited by 2,876
14 more
- 2017Billion-scale similarity search with GPUscited by 2,497
- 2021SimCSE: Simple Contrastive Learning of Sentence Embeddingscited by 2,173
- 2020Offline Reinforcement Learning: Tutorial, Review, and Perspectives on Open Problemscited by 1,920
- 2021WebGPT: Browser-assisted question-answering with human feedbackcited by 1,745
- 2015Microsoft COCO Captions: Data Collection and Evaluation Servercited by 1,462
- 2016Modeling Context in Referring Expressionscited by 1,063
- 2014Show and Tell: A Neural Image Caption Generatorcited by 879
- 2016Efficient and robust approximate nearest neighbor search using Hierarchical Navigable Small World graphscited by 861
- 2015Image-based Recommendations on Styles and Substitutescited by 706
- 2022Teaching language models to support answers with verified quotescited by 292
- 2023Patch n' Pack: NaViT, a Vision Transformer for any Aspect Ratio and Resolutioncited by 229
- 2016Ex Machina: Personal Attacks Seen at Scalecited by 210
- 2015DenseCap: Fully Convolutional Localization Networks for Dense Captioningcited by 176
- 2025PinLanding: Content-First Keyword Landing Page Generation via Multi-Modal AI for Web-Scale Discoverycited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026PinCLIP: Large-scale Foundational Multimodal Representation at Pinterest
- 2026Optimizing Visibility in Generative Engines: A Critical Survey of Generative Engine Optimization (2023-2026)
- 2024Improving Pinterest Search Relevance Using Large Language Models
- 2026Agent2UCB: Agentic System for Generative Engine Optimization
- 2024Vision Search Assistant: Empower Vision-Language Models as Multimodal Search Engines
- 2026Multimodal Generative Engine Optimization: Rank Manipulation for Vision-Language Model Rankers
- 2026Search Beyond What Can Be Taught: Evolving the Knowledge Boundary in Agentic Visual Generation
- 2026UniPinRec: Unifying Generative Retrieval and Ranking at Pinterest Scale