What to Edit Next: Visually Aligned Image-Editing Follow-Up Suggestions in Conversational Systems
Not on the map. Why?
Abstract (arXiv)
Conversational assistants increasingly recommend follow-up edits to help users continue a task. Existing systems primarily target text-only interactions, leaving image-creation conversations underexplored. In image-creation tasks, useful follow-up edit suggestions must reflect user preferences, offer diverse directions, and remain executable on the current image. We collected 100,000 real multi-turn image-creation conversation samples from Qwen App and found that 80.1% are image-dependent, underscoring the need for multimodal recommendation. We address this setting with a three-stage framework. In Stage 1, we use real online data to build a human-reviewed table of appropriate follow-up editing intents, then create SFT targets and fine-tune a multimodal policy. In Stage 2, to align rule-guided SFT suggestions with actual user choices, we use user click feedback to optimize the policy through multi-objective reinforcement learning. In Stage 3, to reduce visual inconsistencies between suggested edits and the current image, we introduce a visual verifier as additional training supervision. Extensive experiments demonstrate that our framework significantly outperforms baselines on both automatic and human evaluations. In a live user-randomized A/B test with millions of users, our final framework reduces visual inconsistency from 3.7% to 0.9%. Furthermore, it significantly improves recommendation CTR by 32.70%, image take-away rate by 16.32%, and average conversation turns per user by 39.90% (all p<0.05). Project page: https://what-to-edit-next.github.io/
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 28 of its 45 references that are in the map. First posted on arXiv 3 Aug 2026.
Builds on
28 of 45 references.
References · 28
- 2022Training language models to follow instructions with human feedbackcited by 15,971
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,611
- 2016Making the V in VQA Matter: Elevating the Role of Image Understanding in Visual Question Answeringcited by 2,516
- 2025Qwen3 Embedding: Advancing Text Embedding and Reranking Through Foundation Modelscited by 1,261
- 2023Mitigating Object Hallucinations in Large Vision-Language Models through Visual Contrastive Decodingcited by 688
- 2018Object Hallucination in Image Captioningcited by 669
- 2023RLHF-V: Towards Trustworthy MLLMs via Behavior Alignment from Fine-grained Correctional Human Feedbackcited by 412
- 2017Don't Just Assume; Look and Answer: Overcoming Priors for Visual Question Answeringcited by 339
- 2026GDPO: Group reward-Decoupled Normalization Policy Optimization for Multi-reward RL Optimizationcited by 193
- 2016Unbiased Learning-to-Rank with Biased Feedbackcited by 157
- 2024ODIN: Disentangled Reward Mitigates Hacking in RLHFcited by 136
16 more
- 2024RLAIF-V: Open-Source AI Feedback Leads to Super GPT-4V Trustworthinesscited by 131
- 2015A Hierarchical Recurrent Encoder-Decoder For Generative Context-Aware Query Suggestioncited by 68
- 2018Unbiased Learning to Rank with Unbiased Propensity Estimationcited by 61
- 2023See, Say, and Segment: Teaching LMMs to Overcome False Premisescited by 41
- 2025Learning to Optimize Multi-Objective Alignment Through Dynamic Reward Weightingcited by 23
- 2025MO-GRPO: Mitigating Reward Hacking of Group Relative Policy Optimization on Multi-Objective Problemscited by 23
- 2025Post-training Large Language Models for Diverse High-Quality Responsescited by 19
- 2025MIRA: Multimodal Iterative Reasoning Agent for Image Editingcited by 17
- 2025CTR-Guided Generative Query Suggestion in Conversational Searchcited by 9
- 2025From Clicks to Preference: A Multi-stage Alignment Framework for Generative Query Suggestion in Conversational Systemcited by 9
- 2025From Prompting to Alignment: A Generative Framework for Query Recommendationcited by 7
- 2024Empowering Visual Creativity: A Vision-Language Assistant to Image Editing Recommendationscited by 6
- 2026DVAO: Dynamic Variance-adaptive Advantage Optimization for Multi-reward Reinforcement Learningcited by 3
- 2026Uncovering Cross-Objective Interference in Multi-Objective Alignmentcited by 2
- 2026IceBreaker for Conversational Agents: Breaking the First-Message Barrier with Personalized Starterscited by 1
- 2026OnePred: Next-Query Prediction via Recursive Intent Memory in Multi-Turn Conversationscited by 1
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2026IEA: Amateur-Friendly Conversational Image Editing Agent via Three Stages of Multitask Alignment
- 2026Edit-R2: Context-Aware Reinforcement Learning for Multi-Turn Image Editing
- 2023DialogPaint: A Dialog-based Image Editing Model
- 2026ImageEdit-R1: Boosting Multi-Agent Image Editing via Reinforcement Learning
- 2026EditRefiner: A Human-Aligned Agentic Framework for Image Editing Refinement
- 2026TalkPhoto: A Versatile Training-Free Conversational Assistant for Intelligent Image Editing
- 2025LMM4Edit: Benchmarking and Evaluating Multimodal Image Editing with LMMs
- 2024DiffChat: Learning to Chat with Text-to-Image Synthesis Models for Interactive Image Creation