AesFormer: Transform Everyday Photos into Beautiful Memories
Not on the map. Why?
Abstract (arXiv)
In everyday photography, aesthetically appealing moments are often captured with structural flaws (e.g., composition, camera viewpoint, or pose) that existing retouching and portrait enhancement methods cannot fix. We formulate Aesthetic Photo Reconstruction (APR) as improving a photo's aesthetic quality via structural reconstruction while preserving subject identity and scene semantics. Although recent advances in image editing models make APR feasible, they often lack aesthetic understanding, yielding edits that are semantically plausible yet aesthetically weak. To address this, we propose AesFormer, a two-stage framework that decouples aesthetic planning from image editing. In Stage 1, an aesthetic action model (AesThinker) analyzes the input along seven progressive photographic dimensions and outputs executable editing actions; we further apply GRPO-A to encourage broad exploration over diverse action plans beyond SFT. In Stage 2, an action-conditioned editor (AesEditor) performs structural edits guided by these actions. To support APR, we build a video-based corpus-mining pipeline (VCMP) and construct AesRecon, a benchmark of 9,071 strictly aligned (poor, good) image pairs. Experiments show that AesFormer substantially improves APR performance and is competitive with Nano Banana Pro. Code is available at https://github.com/PKU-ICST-MIPL/AesFormer_ICML2026.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 36 of its 46 references that are in the map. First posted on arXiv 21 May 2026.
Builds on
36 of 46 references.
References · 36
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2025Qwen3 Technical Reportcited by 8,820
- 2023Visual Instruction Tuningcited by 7,869
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
- 2022Flow Matching for Generative Modelingcited by 5,702
- 2025Qwen2.5-VL Technical Reportcited by 5,587
- 2024GPT-4o System Cardcited by 4,588
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
- 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,152
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
24 more
- 2025Qwen-Image Technical Reportcited by 1,044
- 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Spacecited by 1,006
- 2025OpenAI GPT-5 System Cardcited by 989
- 2025Emerging Properties in Unified Multimodal Pretrainingcited by 897
- 2023Q-Align: Teaching LMMs for Visual Scoring via Discrete Text-Defined Levelscited by 503
- 2025Step1X-Edit: A Practical Framework for General Image Editingcited by 429
- 2025ImgEdit: A Unified Image Editing Dataset and Benchmarkcited by 231
- 2025In-Context Edit: Enabling Instructional Image Editing with In-Context Generation in Large Scale Diffusion Transformercited by 204
- 2020Conditional Sequential Modulation for Efficient Global Image Retouchingcited by 71
- 2021PPR10K: A Large-Scale Portrait Photo Retouching Dataset with Human-Region Mask and Group-Level Consistencycited by 59
- 2025GPT-ImgEval: A Comprehensive Benchmark for Diagnosing GPT4o in Image Generationcited by 58
- 2025ArtiMuse: Fine-Grained Image Aesthetics Assessment with Joint Scoring and Expert-Level Understandingcited by 41
- 2025JarvisArt: Liberating Human Artistic Creativity via an Intelligent Photo Retouching Agentcited by 39
- 2025EditThinker: Unlocking Iterative Reasoning for Any Image Editorcited by 25
- 2025Thinking with Camera: A Unified Multimodal Model for Camera-Centric Understanding and Generationcited by 19
- 2023RSFNet: A White-Box Image Retouching Approach using Region-Specific Color Filterscited by 15
- 2024DiffRetouch: Using Diffusion to Retouch on the Shoulder of Expertscited by 14
- 2025Next Token Is Enough: Realistic Image Quality and Aesthetic Scoring with Multimodal Large Language Modelcited by 12
- 2024Toward Tiny and High-quality Facial Makeup with Data Amplify Learningcited by 10
- 2025MonetGPT: Solving Puzzles Enhances MLLMs' Image Retouching Skillscited by 10
- 2025Understanding Overadaptation in Supervised Fine-Tuning: The Role of Ensemble Methodscited by 9
- 2025PhotoFramer: Multi-modal Image Composition Instructioncited by 9
- 2025Towards Smart Point-and-Shoot Photographycited by 6
- 2024Advancing Comprehensive Aesthetic Insight with Multi-Scale Text-Guided Self-Supervised Learningcited by 3
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026Venus: Benchmarking and Empowering Multimodal Large Language Models for Aesthetic Guidance and Cropping
- 2026Edit2Restore:Few-Shot Image Restoration via Parameter-Efficient Adaptation of Pre-trained Editing Models
- 2026SmartPhotoCrafter: Unified Reasoning, Generation and Optimization for Automatic Photographic Image Editing
- 2025AesTest: Measuring Aesthetic Intelligence from Perception to Production
- 2026AesRM: Improving Video Aesthetics with Expert-Level Feedback
- 2026AesCanvas: A Large-Scale Dataset and Benchmark for Aesthetic Critique and Contextual Suitability
- 2024Magic Fixup: Streamlining Photo Editing by Watching Dynamic Videos
- 2026SE-MoLoRA: Shared-Expert LoRA Adapters for Domain-Specific Photographic Assessment