mlsanityData to 7 Oct 2026

CyCLeGen: Cycle-Consistent Layout Prediction and Image Generation in Vision Foundation Models

arXiv 2603.14957 ↗First posted 16 Mar 2026cs.CVcited by 3

On the map: Multimodal LLMs / vision-language models → VLM benchmarks and visual reasoning

Abstract (arXiv)

We present CyCLeGen, a unified vision-language foundation model capable of both image understanding and image generation within a single autoregressive framework. Unlike existing vision models that depend on separate modules for perception and synthesis, CyCLeGen adopts a fully integrated architecture that enforces cycle-consistent learning through image->layout->image and layout->image->layout generation loops. This unified formulation introduces two key advantages: introspection, enabling the model to reason about its own generations, and data efficiency, allowing self-improvement via synthetic supervision under a reinforcement learning objective guided by cycle consistency. Extensive experiments show that CyCLeGen achieves significant gains across diverse image understanding and generation benchmarks, highlighting the potential of unified vision-language foundation models.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Placed in VLM benchmarks and visual reasoning, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 39 of its 44 references that are in the map. First posted on arXiv 16 Mar 2026.

Builds on

39 of 44 references.

Closest ancestors · 1

Same direction, newest first

  1. 2022Flamingo: a Visual Language Model for Few-Shot Learning29 Apr

Other references · 38

  1. 2020Language Models are Few-Shot Learnerscited by 32,199
  2. 2023GPT-4 Technical Reportcited by 18,132
  3. 2014Microsoft COCO: Common Objects in Contextcited by 17,498
  4. 2017Proximal Policy Optimization Algorithmscited by 14,441
  5. 2024The Llama 3 Herd of Modelscited by 14,192
  6. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
  7. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
  8. 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,274
  9. 2024Qwen2.5-Coder Technical Reportcited by 1,151
  10. 2024Qwen2.5-Math Technical Report: Toward Mathematical Expert Model via Self-Improvementcited by 1,057
  11. 2024Chameleon: Mixed-Modal Early-Fusion Foundation Modelscited by 904
  12. 2025Emerging Properties in Unified Multimodal Pretrainingcited by 855
26 more
  1. 2025Janus-Pro: Unified Multimodal Understanding and Generation with Data and Model Scalingcited by 787
  2. 2023GLIGEN: Open-Set Grounded Text-to-Image Generationcited by 774
  3. 2024Show-o: One Single Transformer to Unify Multimodal Understanding and Generationcited by 734
  4. 2023Aligning Large Multimodal Models with Factually Augmented RLHFcited by 703
  5. 2025Visual-RFT: Visual Reinforcement Fine-Tuningcited by 501
  6. 2024Transfusion: Predict the Next Token and Diffuse Images with One Multi-Modal Modelcited by 468
  7. 2024Janus: Decoupling Visual Encoding for Unified Multimodal Understanding and Generationcited by 447
  8. 2023RLHF-V: Towards Trustworthy MLLMs via Behavior Alignment from Fine-grained Correctional Human Feedbackcited by 404
  9. 2023Training-Free Layout Control with Cross-Attention Guidancecited by 312
  10. 2023Human Preference Score: Better Aligning Text-to-Image Models with Human Preferencecited by 284
  11. 2023BoxDiff: Text-to-Image Synthesis with Training-Free Box-Constrained Diffusioncited by 280
  12. 2024InstanceDiffusion: Instance-level Control for Image Generationcited by 175
  13. 2024MIGC: Multi-Instance Generation Controller for Text-to-Image Synthesiscited by 123
  14. 2024InternLM-Math: Open Math Large Language Models Toward Verifiable Reasoningcited by 117
  15. 2025Unified Multimodal Understanding and Generation Models: Advances, Challenges, and Opportunitiescited by 81
  16. 2024CreatiLayout: Siamese Multimodal Diffusion Transformer for Creative Layout-to-Image Generationcited by 58
  17. 2024MonoFormer: One Transformer for Both Diffusion and Autoregressioncited by 45
  18. 2024HiCo: Hierarchical Controllable Diffusion Model for Layout-to-image Generationcited by 39
  19. 2024Preference Optimization for Reasoning with Pseudo Feedbackcited by 38
  20. 2025Skywork UniPic 2.0: Building Kontext Model with Online RL for Unified Multimodal Modelcited by 38
  21. 2024OmniControlNet: Dual-stage Integration for Conditional Image Generationcited by 24
  22. 2017Wasserstein Introspective Neural Networkscited by 18
  23. 2025PlanGen: Towards Unified Layout Planning and Image Generation in Auto-Regressive Vision Language Modelscited by 18
  24. 2025OverLayBench: A Benchmark for Layout-to-Image Generation with Dense Overlapscited by 9
  25. 2025Lay-Your-Scene: Natural Scene Layout Generation with Diffusion Transformerscited by 6
  26. 2025CVP: Central-Peripheral Vision-Inspired Multimodal Model for Spatial Reasoningcited by 5

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 3.

3 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026EchoGen: Cycle-Consistent Learning for Unified Layout-Image Generation and Understanding
  2. 2026Think, Plan, Paint: Layout-Aware Reasoning for Controllable Image Generation in Unified Models
  3. 2026Thinking in Pictures: A Systematic Benchmark for Reasoning-driven Image Generation
  4. 2025VisualCloze: A Universal Image Generation Framework via Visual In-Context Learning
  5. 2026UniGen-AR: Unifying Visual Generation with Auto-Regressive Modeling
  6. 2025ReasonGen-R1: CoT for Autoregressive Image generation models through SFT and RL
  7. 2023UniControl: A Unified Diffusion Model for Controllable Visual Generation In the Wild
  8. 2025GoT-R1: Unleashing Reasoning Capability of MLLM for Visual Generation with Reinforcement Learning