mlsanityData to 14 Oct 2026

What to Edit Next: Visually Aligned Image-Editing Follow-Up Suggestions in Conversational Systems

arXiv 2608.07565 ↗First posted 3 Aug 2026cs.CV cs.AIcited by 2

Not on the map. Why?

Abstract (arXiv)

Conversational assistants increasingly recommend follow-up edits to help users continue a task. Existing systems primarily target text-only interactions, leaving image-creation conversations underexplored. In image-creation tasks, useful follow-up edit suggestions must reflect user preferences, offer diverse directions, and remain executable on the current image. We collected 100,000 real multi-turn image-creation conversation samples from Qwen App and found that 80.1% are image-dependent, underscoring the need for multimodal recommendation. We address this setting with a three-stage framework. In Stage 1, we use real online data to build a human-reviewed table of appropriate follow-up editing intents, then create SFT targets and fine-tune a multimodal policy. In Stage 2, to align rule-guided SFT suggestions with actual user choices, we use user click feedback to optimize the policy through multi-objective reinforcement learning. In Stage 3, to reduce visual inconsistencies between suggested edits and the current image, we introduce a visual verifier as additional training supervision. Extensive experiments demonstrate that our framework significantly outperforms baselines on both automatic and human evaluations. In a live user-randomized A/B test with millions of users, our final framework reduces visual inconsistency from 3.7% to 0.9%. Furthermore, it significantly improves recommendation CTR by 32.70%, image take-away rate by 16.32%, and average conversation turns per user by 39.90% (all p<0.05). Project page: https://what-to-edit-next.github.io/

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 28 of its 45 references that are in the map. First posted on arXiv 3 Aug 2026.

Builds on

28 of 45 references.

References · 28

  1. 2022Training language models to follow instructions with human feedbackcited by 15,971
  2. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  3. 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,611
  4. 2016Making the V in VQA Matter: Elevating the Role of Image Understanding in Visual Question Answeringcited by 2,516
  5. 2025Qwen3 Embedding: Advancing Text Embedding and Reranking Through Foundation Modelscited by 1,261
  6. 2023Mitigating Object Hallucinations in Large Vision-Language Models through Visual Contrastive Decodingcited by 688
  7. 2018Object Hallucination in Image Captioningcited by 669
  8. 2023RLHF-V: Towards Trustworthy MLLMs via Behavior Alignment from Fine-grained Correctional Human Feedbackcited by 412
  9. 2017Don't Just Assume; Look and Answer: Overcoming Priors for Visual Question Answeringcited by 339
  10. 2026GDPO: Group reward-Decoupled Normalization Policy Optimization for Multi-reward RL Optimizationcited by 193
  11. 2016Unbiased Learning-to-Rank with Biased Feedbackcited by 157
  12. 2024ODIN: Disentangled Reward Mitigates Hacking in RLHFcited by 136
16 more
  1. 2024RLAIF-V: Open-Source AI Feedback Leads to Super GPT-4V Trustworthinesscited by 131
  2. 2015A Hierarchical Recurrent Encoder-Decoder For Generative Context-Aware Query Suggestioncited by 68
  3. 2018Unbiased Learning to Rank with Unbiased Propensity Estimationcited by 61
  4. 2023See, Say, and Segment: Teaching LMMs to Overcome False Premisescited by 41
  5. 2025Learning to Optimize Multi-Objective Alignment Through Dynamic Reward Weightingcited by 23
  6. 2025MO-GRPO: Mitigating Reward Hacking of Group Relative Policy Optimization on Multi-Objective Problemscited by 23
  7. 2025Post-training Large Language Models for Diverse High-Quality Responsescited by 19
  8. 2025MIRA: Multimodal Iterative Reasoning Agent for Image Editingcited by 17
  9. 2025CTR-Guided Generative Query Suggestion in Conversational Searchcited by 9
  10. 2025From Clicks to Preference: A Multi-stage Alignment Framework for Generative Query Suggestion in Conversational Systemcited by 9
  11. 2025From Prompting to Alignment: A Generative Framework for Query Recommendationcited by 7
  12. 2024Empowering Visual Creativity: A Vision-Language Assistant to Image Editing Recommendationscited by 6
  13. 2026DVAO: Dynamic Variance-adaptive Advantage Optimization for Multi-reward Reinforcement Learningcited by 3
  14. 2026Uncovering Cross-Objective Interference in Multi-Objective Alignmentcited by 2
  15. 2026IceBreaker for Conversational Agents: Breaking the First-Message Barrier with Personalized Starterscited by 1
  16. 2026OnePred: Next-Query Prediction via Recursive Intent Memory in Multi-Turn Conversationscited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026IEA: Amateur-Friendly Conversational Image Editing Agent via Three Stages of Multitask Alignment
  2. 2026Edit-R2: Context-Aware Reinforcement Learning for Multi-Turn Image Editing
  3. 2023DialogPaint: A Dialog-based Image Editing Model
  4. 2026ImageEdit-R1: Boosting Multi-Agent Image Editing via Reinforcement Learning
  5. 2026EditRefiner: A Human-Aligned Agentic Framework for Image Editing Refinement
  6. 2026TalkPhoto: A Versatile Training-Free Conversational Assistant for Intelligent Image Editing
  7. 2025LMM4Edit: Benchmarking and Evaluating Multimodal Image Editing with LMMs
  8. 2024DiffChat: Learning to Chat with Text-to-Image Synthesis Models for Interactive Image Creation