ShutterMuse: Capture-Time Photography Guidance with MLLMs
Not on the map. Why?
Abstract (arXiv)
Real-world photography requires capture-time guidance for both camera framing and subject pose. Yet existing aesthetic cropping benchmarks mainly evaluate post-hoc crop prediction and overlook subject-side recommendations, leaving the capture-time guidance capabilities of multimodal large language models (MLLMs) underexplored. To address this gap, we introduce CaptureGuide-Bench, a benchmark with two complementary tasks: photographer-side composition decision and refinement, and subject-side scene-conditioned pose recommendation. Our evaluation reveals limitations: general-purpose MLLMs can make composition decisions but lack precise refinement localization, while specialized aesthetic cropping models localize crops effectively but are limited to refinement; neither provides actionable pose guidance. To support model development, we further construct CaptureGuide-Dataset, comprising 130K samples with textual rationales and structured visual annotations, and develop ShutterMuse, a unified MLLM trained with supervised and reinforcement fine-tuning. Experiments on CaptureGuide-Bench show that ShutterMuse achieves the best overall photographer-side performance among evaluated baselines and competitive subject-side pose recommendation with substantially lower inference cost, demonstrating the potential of MLLMs as interactive assistants for photography during image capture.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 31 of its 47 references that are in the map. First posted on arXiv 24 Jun 2026.
Builds on
31 of 47 references.
References · 31
- 2023GPT-4 Technical Reportcited by 18,396
- 2014Microsoft COCO: Common Objects in Contextcited by 17,608
- 2023Visual Instruction Tuningcited by 7,869
- 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,137
- 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,944
- 2022Flamingo: a Visual Language Model for Few-Shot Learningcited by 4,386
- 2023InstructBLIP: Towards General-purpose Vision-Language Models with Instruction Tuningcited by 2,876
- 2025Qwen3-VL Technical Reportcited by 2,793
- 2023MiniGPT-4: Enhancing Vision-Language Understanding with Advanced Large Language Modelscited by 2,711
- 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiencycited by 1,510
- 2022Human Motion Diffusion Modelcited by 1,080
- 2023T2M-GPT: Generating Human Motion from Textual Descriptions with Discrete Representationscited by 588
19 more
- 2022Executing your Commands via Motion Diffusion in Latent Spacecited by 575
- 2023MotionGPT: Human Motion as a Foreign Languagecited by 527
- 2023Q-Align: Teaching LMMs for Visual Scoring via Discrete Text-Defined Levelscited by 503
- 2023MoMask: Generative Masked Modeling of 3D Human Motionscited by 400
- 2024Bilateral Reference for High-Resolution Dichotomous Image Segmentationcited by 112
- 2023FineMoGen: Fine-Grained Spatio-Temporal Motion Generation and Editingcited by 106
- 2026Ultralytics YOLO26: Unified Real-Time End-to-End Vision Modelscited by 57
- 2024AesExpert: Towards Multi-modality Foundation Model for Image Aesthetics Perceptioncited by 54
- 2025ArtiMuse: Fine-Grained Image Aesthetics Assessment with Joint Scoring and Expert-Level Understandingcited by 41
- 2019Reliable and Efficient Image Cropping: A Grid Anchor based Approachcited by 33
- 2017Quantitative Analysis of Automatic Image Cropping Algorithms: A Dataset and Comparative Studycited by 27
- 2024Spatial-Semantic Collaborative Cropping for User Generated Contentcited by 13
- 2025The Photographer Eye: Teaching Multimodal Large Language Models to Understand Image Aesthetics like Photographerscited by 13
- 2023Learning Subject-Aware Cropping by Outpainting Professional Photoscited by 12
- 2022Human-centric Image Cropping with Partition-aware and Content-preserving Featurescited by 11
- 2023Beyond Image Borders: Learning Feature Extrapolation for Unbounded Image Compositioncited by 10
- 2025ProCrop: Learning Aesthetic Image Cropping from Professional Compositionscited by 8
- 2026Venus: Benchmarking and Empowering Multimodal Large Language Models for Aesthetic Guidance and Croppingcited by 5
- 2024Advancing Comprehensive Aesthetic Insight with Multi-Scale Text-Guided Self-Supervised Learningcited by 3
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2025Global Compression Commander: Plug-and-Play Inference Acceleration for High-Resolution Large Vision-Language Models
- 2025CameraBench: Benchmarking Visual Reasoning in MLLMs via Photography
- 2026CROP: Expert-Aligned Image Cropping via Compositional Reasoning and Optimizing Preference
- 2024Cropper: Vision-Language Model for Image Cropping through In-Context Learning
- 2025CropVLM: Learning to Zoom for Fine-Grained Vision-Language Perception
- 2025AesCrop: Aesthetic-driven Cropping Guided by Composition
- 2026Discrete Annotation, Continuous Preference: Rethinking Supervision for Accurate and Generalizable Aesthetic Image Cropping
- 2026Look Where It Matters: High-Resolution Crops Retrieval for Efficient VLMs