Twin Co-Adaptive Dialogue for Progressive Image Generation
Not on the map. Why?
Abstract (arXiv)
Modern text-to-image generation systems have enabled the creation of remarkably realistic and high-quality visuals, yet they often falter when handling the inherent ambiguities in user prompts. In this work, we present Twin-Co, a framework that leverages synchronized, co-adaptive dialogue to progressively refine image generation. Instead of a static generation process, Twin-Co employs a dynamic, iterative workflow where an intelligent dialogue agent continuously interacts with the user. Initially, a base image is generated from the user's prompt. Then, through a series of synchronized dialogue exchanges, the system adapts and optimizes the image according to evolving user feedback. The co-adaptive process allows the system to progressively narrow down ambiguities and better align with user intent. Experiments demonstrate that Twin-Co not only enhances user experience by reducing trial-and-error iterations but also improves the quality of the generated images, streamlining creative process across various applications.
Key facts. Cited by 11 papers in the map (data through 13 Oct 2026). Builds on 19 of its 43 references that are in the map. First posted on arXiv 21 Apr 2025.
Builds on
19 of 43 references.
References · 19
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,588
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,231
- 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,564
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,339
- 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,314
- 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,421
- 2023ImageReward: Learning and Evaluating Human Preferences for Text-to-Image Generationcited by 1,028
- 2023Attend-and-Excite: Attention-Based Semantic Guidance for Text-to-Image Diffusion Modelscited by 701
- 2023Using Human Feedback to Fine-tune Diffusion Models without Any Reward Modelcited by 247
- 2023HIVE: Harnessing Human Feedback for Instructional Visual Editingcited by 172
- 2023ChatGPT is not all you need. A State of the Art Review of large Generative AI modelscited by 86
- 2024CogView3: Finer and Faster Text-to-Image Generation via Relay Diffusioncited by 72
7 more
- 2024PromptCharm: Text-to-Image Generation through Multi-modal Prompting and Refinementcited by 62
- 2024Towards Understanding the Working Mechanism of Text-to-Image Diffusion Modelcited by 48
- 2024Proactive Agents for Multi-Turn Text-to-Image Generation Under Uncertaintycited by 24
- 2024M2IST: Multi-Modal Interactive Side-Tuning for Efficient Referring Expression Comprehensioncited by 11
- 2024Enhancing Test Time Adaptation with Few-shot Guidancecited by 5
- 2024Leveraging Contrastive Learning and Self-Training for Multimodal Emotion Recognition with Limited Labeled Samplescited by 5
- 2024DiffChat: Learning to Chat with Text-to-Image Synthesis Models for Interactive Image Creationcited by 4
Built on by
Citing papers per year: 2025: 5; 2026: 6.
11 papers.
- 2025Charts Are Not Images: On the Challenges of Scientific Chart Editingcited by 10
- 2025Adaptive Detector-Verifier Framework for Zero-Shot Polyp Detection in Open-World Settingscited by 4
- 2026Safe Autoregressive Image Generation with Iterative Self-Improving Codebookscited by 1
- 2026Agentic Visual Generation: From Generative Models to Agentic Controlcited by 1
- 2025Multi-Modal Machine Learning Framework for Predicting Early Recurrence of Brain Tumors Using MRI and Clinical Biomarkerscited by 0
- 2025A Multimodal Deep Learning Framework for Early Diagnosis of Liver Cancer via Optimized BiLSTM-AM-VMD Architecturecited by 0
- 2025GEM: Generative Entropy-Guided Preference Modeling for Few-shot Alignment of LLMscited by 0
- 2026Adaptive Multi-Stage Patent Claim Generation with Unified Quality Assessmentcited by 0
- 2026Adaptive Prompt Elicitation for Text-to-Image Generationcited by 0
- 2026The Image Reconstruction Game: Drawing Common Ground Through Iterative Multimodal Dialoguecited by 0
- 2026Semantic Browsing: Controllable Diversity for Image Generationcited by 0
- 2026Agentic Visual Generation: From Generative Models to Agentic Control6 Sep 2026
- 2026Safe Autoregressive Image Generation with Iterative Self-Improving Codebooks25 Jun 2026
- 2026Semantic Browsing: Controllable Diversity for Image Generation22 Jun 2026
- 2026The Image Reconstruction Game: Drawing Common Ground Through Iterative Multimodal Dialogue1 Jun 2026
- 2026Adaptive Prompt Elicitation for Text-to-Image Generation4 Feb 2026
- 2026Adaptive Multi-Stage Patent Claim Generation with Unified Quality Assessment14 Jan 2026
- 2025Adaptive Detector-Verifier Framework for Zero-Shot Polyp Detection in Open-World Settings13 Dec 2025
- 2025Charts Are Not Images: On the Challenges of Scientific Chart Editing30 Nov 2025
- 2025GEM: Generative Entropy-Guided Preference Modeling for Few-shot Alignment of LLMs17 Nov 2025
- 2025A Multimodal Deep Learning Framework for Early Diagnosis of Liver Cancer via Optimized BiLSTM-AM-VMD Architecture1 Sep 2025
- 2025Multi-Modal Machine Learning Framework for Predicting Early Recurrence of Brain Tumors Using MRI and Clinical Biomarkers1 Sep 2025