mlsanityData to 13 Oct 2026

Amplify What You Gaze At: Target Saliency Boosting in Text-to-Image Generation

arXiv 2609.30733 ↗First posted 25 Sep 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Text-to-image generation has advanced in controlling what, where, and how objects appear, yet how visual attention is distributed among objects remains largely unexplored. In this paper, we introduce Target Saliency Boosting, a new task aimed at boosting the visual saliency of a specific object during text-to-image generation without requiring any visual priors. Our key insight is that visual saliency is inherently relative: boosting the saliency of a target object also depends on the global saliency distribution across all objects in the scene. Based on this insight, we propose GazeME, a lightweight framework that uses saliency-marked prompts, inserting learnable marker tokens around object descriptions to indicate which objects to visually emphasize or suppress. To learn these markers, we construct a saliency-semantics dataset that associates objects in image--prompt pairs with object-level saliency scores, and propose Saliency Prior Marker Activation (SPMA), a saliency-aware stochastic marker activation strategy that exploits relative saliency relationships for robust training. During inference, GazeME automatically inserts appropriate markers into the prompt, thereby directly enhancing the visual saliency of the target object. Extensive experiments demonstrate that GazeME effectively boosts target saliency while preserving both semantic alignment and image quality.

Key facts. No citing papers in the map yet (data through 13 Oct 2026). Builds on 19 of its 39 references that are in the map. First posted on arXiv 25 Sep 2026.

Builds on

19 of 39 references.

References · 19

  1. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,484
  2. 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,421
  3. 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,407
  4. 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,240
  5. 2023T2I-Adapter: Learning Adapters to Dig out More Controllable Ability for Text-to-Image Diffusion Modelscited by 1,342
  6. 2022Exploring CLIP for Assessing the Look and Feel of Imagescited by 980
  7. 2025SAM 3: Segment Anything with Conceptscited by 865
  8. 2023GLIGEN: Open-Set Grounded Text-to-Image Generationcited by 777
  9. 2023Composer: Creative and Controllable Image Synthesis with Composable Conditionscited by 303
  10. 2016What do different evaluation metrics tell us about saliency models?cited by 185
  11. 2014Salient Object Detection: A Surveycited by 98
  12. 2016DeepGaze II: Reading fixations from deep features trained on object recognitioncited by 55
7 more
  1. 2015CAT2000: A Large Scale Fixation Dataset for Boosting Saliency Researchcited by 52
  2. 2019Contextual Encoder-Decoder Network for Visual Saliency Predictioncited by 44
  3. 2021TranSalNet: Towards perceptually relevant visual saliency predictioncited by 44
  4. 2024AnyControl: Create Your Artwork with Versatile Control on Text-to-Image Generationcited by 20
  5. 2024GazeFusion: Saliency-Guided Image Generationcited by 4
  6. 2026CogBlender: Towards Continuous Cognitive Intervention in Text-to-Image Generationcited by 1
  7. 2026Attend to Anything: Foundation Model for Unified Human Attention Modelingcited by 1

Built on by

Not cited yet.