CyCLeGen: Cycle-Consistent Layout Prediction and Image Generation in Vision Foundation Models
On the map: Multimodal LLMs / vision-language models → VLM benchmarks and visual reasoning
Abstract (arXiv)
We present CyCLeGen, a unified vision-language foundation model capable of both image understanding and image generation within a single autoregressive framework. Unlike existing vision models that depend on separate modules for perception and synthesis, CyCLeGen adopts a fully integrated architecture that enforces cycle-consistent learning through image->layout->image and layout->image->layout generation loops. This unified formulation introduces two key advantages: introspection, enabling the model to reason about its own generations, and data efficiency, allowing self-improvement via synthetic supervision under a reinforcement learning objective guided by cycle consistency. Extensive experiments show that CyCLeGen achieves significant gains across diverse image understanding and generation benchmarks, highlighting the potential of unified vision-language foundation models.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Placed in VLM benchmarks and visual reasoning, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 39 of its 44 references that are in the map. First posted on arXiv 16 Mar 2026.
Builds on
39 of 44 references.
Closest ancestors · 1
Same direction, newest first
Other references · 38
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2023GPT-4 Technical Reportcited by 18,132
- 2014Microsoft COCO: Common Objects in Contextcited by 17,498
- 2017Proximal Policy Optimization Algorithmscited by 14,441
- 2024The Llama 3 Herd of Modelscited by 14,192
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
- 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,274
- 2024Qwen2.5-Coder Technical Reportcited by 1,151
- 2024Qwen2.5-Math Technical Report: Toward Mathematical Expert Model via Self-Improvementcited by 1,057
- 2024Chameleon: Mixed-Modal Early-Fusion Foundation Modelscited by 904
- 2025Emerging Properties in Unified Multimodal Pretrainingcited by 855
26 more
- 2025Janus-Pro: Unified Multimodal Understanding and Generation with Data and Model Scalingcited by 787
- 2023GLIGEN: Open-Set Grounded Text-to-Image Generationcited by 774
- 2024Show-o: One Single Transformer to Unify Multimodal Understanding and Generationcited by 734
- 2023Aligning Large Multimodal Models with Factually Augmented RLHFcited by 703
- 2025Visual-RFT: Visual Reinforcement Fine-Tuningcited by 501
- 2024Transfusion: Predict the Next Token and Diffuse Images with One Multi-Modal Modelcited by 468
- 2024Janus: Decoupling Visual Encoding for Unified Multimodal Understanding and Generationcited by 447
- 2023RLHF-V: Towards Trustworthy MLLMs via Behavior Alignment from Fine-grained Correctional Human Feedbackcited by 404
- 2023Training-Free Layout Control with Cross-Attention Guidancecited by 312
- 2023Human Preference Score: Better Aligning Text-to-Image Models with Human Preferencecited by 284
- 2023BoxDiff: Text-to-Image Synthesis with Training-Free Box-Constrained Diffusioncited by 280
- 2024InstanceDiffusion: Instance-level Control for Image Generationcited by 175
- 2024MIGC: Multi-Instance Generation Controller for Text-to-Image Synthesiscited by 123
- 2024InternLM-Math: Open Math Large Language Models Toward Verifiable Reasoningcited by 117
- 2025Unified Multimodal Understanding and Generation Models: Advances, Challenges, and Opportunitiescited by 81
- 2024CreatiLayout: Siamese Multimodal Diffusion Transformer for Creative Layout-to-Image Generationcited by 58
- 2024MonoFormer: One Transformer for Both Diffusion and Autoregressioncited by 45
- 2024HiCo: Hierarchical Controllable Diffusion Model for Layout-to-image Generationcited by 39
- 2024Preference Optimization for Reasoning with Pseudo Feedbackcited by 38
- 2025Skywork UniPic 2.0: Building Kontext Model with Online RL for Unified Multimodal Modelcited by 38
- 2024OmniControlNet: Dual-stage Integration for Conditional Image Generationcited by 24
- 2017Wasserstein Introspective Neural Networkscited by 18
- 2025PlanGen: Towards Unified Layout Planning and Image Generation in Auto-Regressive Vision Language Modelscited by 18
- 2025OverLayBench: A Benchmark for Layout-to-Image Generation with Dense Overlapscited by 9
- 2025Lay-Your-Scene: Natural Scene Layout Generation with Diffusion Transformerscited by 6
- 2025CVP: Central-Peripheral Vision-Inspired Multimodal Model for Spatial Reasoningcited by 5
Built on by
Citing papers per year: 2026: 3.
3 papers.
Similar, not cited
Close in wording, no citation either way
- 2026EchoGen: Cycle-Consistent Learning for Unified Layout-Image Generation and Understanding
- 2026Think, Plan, Paint: Layout-Aware Reasoning for Controllable Image Generation in Unified Models
- 2026Thinking in Pictures: A Systematic Benchmark for Reasoning-driven Image Generation
- 2025VisualCloze: A Universal Image Generation Framework via Visual In-Context Learning
- 2026UniGen-AR: Unifying Visual Generation with Auto-Regressive Modeling
- 2025ReasonGen-R1: CoT for Autoregressive Image generation models through SFT and RL
- 2023UniControl: A Unified Diffusion Model for Controllable Visual Generation In the Wild
- 2025GoT-R1: Unleashing Reasoning Capability of MLLM for Visual Generation with Reinforcement Learning