mlsanityData to 14 Oct 2026

Tiny-Engram: Trigger-Indexed Concept Tables for Generative Vision

arXiv 2605.20309 ↗First posted 19 May 2026cs.CV cs.AIcited by 1

On the map: Diffusion models → Image generation, text-to-image and editing

Abstract (arXiv)

Current personalization methods for generative vision models typically encode new concepts through continuous adapters or weight updates, yet provide limited control over whether and when a concept should be retrieved. In this work, we introduce Tiny-Engram, a compact trigger-indexed concept table that gives visual memories an explicit lexical address and activation boundary inside frozen image and video generators. Tiny-Engram parameterizes each concept as a small set of memory entries indexed by registered n-gram matches, which modulate text-encoder hidden states only within the matched trigger region. Outside this lexical support, the conditioning pathway is identical to that of the frozen base model. Across both single-encoder latent diffusion and multi-encoder diffusion-transformer backbones, this formulation binds a rare trigger phrase to a target identity while preserving compositional control from the surrounding prompt. We further evaluate the same table-based memory in a text-conditioned video generation setting, where the trigger path reliably alters the generated subject but fine-grained identity persistence across held-out video prompts remains limited. Taken together, these results suggest that small, explicitly addressed concept tables are a practical route to modular visual personalization, with strongest evidence in image generation. For video diffusion, the remaining gap points to a broader requirement: temporally stable identity likely depends on tighter coupling between text-side memory and the evolving visual state, motivating future work on memory injection beyond the text-conditioning interface.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 27 of its 30 references that are in the map. First posted on arXiv 19 May 2026.

Builds on

27 of 30 references.

Closest ancestors · 3

Same direction, newest first

  1. 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Models13 Aug
  2. 2022Multi-Concept Customization of Text-to-Image Diffusion8 Dec
  3. 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generation25 Aug

Other references · 24

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  4. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
  5. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
  6. 2025Qwen3 Technical Reportcited by 8,820
  7. 2020Measuring Massive Multitask Language Understandingcited by 7,963
  8. 2022Scalable Diffusion Models with Transformerscited by 6,054
  9. 2019Parameter-Efficient Transfer Learning for NLPcited by 4,236
  10. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
  11. 2021Prefix-Tuning: Optimizing Continuous Prompts for Generationcited by 3,915
  12. 2021The Power of Scale for Parameter-Efficient Prompt Tuningcited by 3,795
12 more
  1. 2021TruthfulQA: Measuring How Models Mimic Human Falsehoodscited by 2,975
  2. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
  3. 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,245
  4. 2020REALM: Retrieval-Augmented Language Model Pre-Trainingcited by 2,141
  5. 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuningcited by 1,433
  6. 2021Improving language models by retrieving from trillions of tokenscited by 1,293
  7. 2022Tune-A-Video: One-Shot Tuning of Image Diffusion Models for Text-to-Video Generationcited by 961
  8. 2022Few-Shot Parameter-Efficient Fine-Tuning is Better and Cheaper than In-Context Learningcited by 896
  9. 2019Generalization through Memorization: Nearest Neighbor Language Modelscited by 800
  10. 2023VideoCrafter1: Open Diffusion Models for High-Quality Video Generationcited by 535
  11. 2023ELITE: Encoding Visual Concepts into Textual Embeddings for Customized Text-to-Image Generationcited by 416
  12. 2026Conditional Memory via Scalable Lookup: A New Axis of Sparsity for Large Language Modelscited by 86

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026V-Engram: Trigger-Indexed External Memory for Modular Text-to-Image Personalization
  2. 2024Towards Lifelong Few-Shot Customization of Text-to-Image Diffusion
  3. 2026Let Triggers Control: Frequency-Aware Dropout for Effective Token Control
  4. 2025From Generation to Generalization: Emergent Few-Shot Learning in Video Diffusion Models
  5. 2026Does Engram Do Memory Retrieval in Autoregressive Image Generation?
  6. 2026PREM: Prefix-Steered Recurrent Memory for Long-Video Understanding
  7. 2024Towards Multi-Task Multi-Modal Models: A Video Generative Perspective
  8. 2023InstructCV: Instruction-Tuned Text-to-Image Diffusion Models as Vision Generalists