mlsanityData to 14 Oct 2026

SE-MoLoRA: Shared-Expert LoRA Adapters for Domain-Specific Photographic Assessment

arXiv 2608.17514 ↗First posted 18 Aug 2026cs.CV cs.MMcited by 0

On the map: Multimodal LLMs / vision-language models → Image editing and quality assessment

Abstract (arXiv)

Vision-language models can describe images fluently, but they often fail to provide actionable photographic critique because semantic content and aesthetic judgment remain entangled. We propose SE-MoLoRA, a modular parameter-efficient adaptation framework for domain-specific photographic assessment. The method separates general photographic knowledge from specialist residual judgments using an always-active shared LoRA expert and routed adapters for composition, lighting, and technical quality. A lightweight query router selects the relevant specialist, enabling targeted critique without training separate full models. A rank-64 shared adapter captures broad photographic vocabulary, while rank-32 specialists learn domain-specific residuals with an orthogonal regularization penalty that encourages disentangled representations. Training data is obtained by distilling the Reddit Photo Critique Dataset into domain-labeled critique samples. On held-out critique generation, SE-MoLoRA improves BERTScore-F1 from 0.2317 to 0.4215 over monolithic LoRA and is preferred in 84.6% of pairwise comparisons, while using fewer active parameters than separate specialist models. SVD-based ablation study shows that shared-specialist decomposition and orthogonal regularization reduce expert overlap. These results demonstrate that modular adaptation improves controllability and specificity in multimodal photographic critique.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Image editing and quality assessment, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 36 of its 43 references that are in the map. First posted on arXiv 18 Aug 2026.

Builds on

36 of 43 references.

Closest ancestors · 5

Same direction, newest first

  1. 2025AesTest: Measuring Aesthetic Intelligence from Perception to Production9 Nov
  2. 2025Unlocking the Essence of Beauty: Advanced Aesthetic Reasoning with Relative-Absolute Policy Optimization26 Sep
  3. 2025The Photographer Eye: Teaching Multimodal Large Language Models to Understand Image Aesthetics like Photographers23 Sep
  4. 2025Multimodal LLMs Can Reason about Aesthetics in Zero-Shot15 Jan
  5. 2024AesExpert: Towards Multi-modality Foundation Model for Image Aesthetics Perception15 Apr

Other references · 31

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2023GPT-4 Technical Reportcited by 18,396
  3. 2023Visual Instruction Tuningcited by 7,869
  4. 2016Overcoming catastrophic forgetting in neural networkscited by 4,787
  5. 2019Parameter-Efficient Transfer Learning for NLPcited by 4,236
  6. 2017Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layercited by 3,509
  7. 2023QLoRA: Efficient Finetuning of Quantized LLMscited by 3,418
  8. 2021Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsitycited by 3,073
  9. 2025Qwen3-VL Technical Reportcited by 2,793
  10. 2024DeepSeekMoE: Towards Ultimate Expert Specialization in Mixture-of-Experts Language Modelscited by 867
  11. 2023TIES-Merging: Resolving Interference When Merging Modelscited by 818
  12. 2020AdapterFusion: Non-Destructive Task Composition for Transfer Learningcited by 788
19 more
  1. 2024DoRA: Weight-Decomposed Low-Rank Adaptationcited by 758
  2. 2023Language Models are Super Mario: Absorbing Abilities from Homologous Models as a Free Lunchcited by 694
  3. 2022When and why vision-language models behave like bags-of-words, and what to do about it?cited by 610
  4. 2023LLaMA-Adapter V2: Parameter-Efficient Visual Instruction Modelcited by 602
  5. 2017NIMA: Neural Image Assessmentcited by 389
  6. 2024LoRA+: Efficient Low Rank Adaptation of Large Modelscited by 377
  7. 2023LoraHub: Efficient Cross-Task Generalization via Dynamic LoRA Compositioncited by 364
  8. 2023Multimodal Foundation Models: From Specialists to General-Purpose Assistantscited by 247
  9. 2023Q-Instruct: Improving Low-level Visual Abilities for Multi-modality Foundation Modelscited by 152
  10. 2024Chain of LoRA: Efficient Fine-tuning of Language Models via Residual Learningcited by 82
  11. 2024A Closer Look at the Limitations of Instruction Tuningcited by 77
  12. 2024UNIAA: A Unified Multi-modal Image Aesthetic Assessment Baseline and Benchmarkcited by 42
  13. 2024Mixture-of-LoRAs: An Efficient Multitask Tuning for Large Language Modelscited by 38
  14. 2019Aesthetic Attributes Assessment of Imagescited by 18
  15. 2022Understanding Aesthetics with Language: A Photo Critique Dataset for Aesthetic Assessmentcited by 15
  16. 2024DEAL: Disentangle and Localize Concept-level Explanations for VLMscited by 14
  17. 2025Dynamic Expert Specialization: Towards Catastrophic Forgetting-Free Multi-Domain MoE Adaptationcited by 10
  18. 2025Beauty and the Bias: Exploring the Impact of Attractiveness on Multimodal Large Language Modelscited by 7
  19. 2025Adaptive Shared Experts with LoRA-Based Mixture of Experts for Multi-Task Learningcited by 3

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026AesCanvas: A Large-Scale Dataset and Benchmark for Aesthetic Critique and Contextual Suitability
  2. 2026One Model, Two Minds: Task-Conditioned Reasoning for Unified Image Quality and Aesthetic Assessment
  3. 2023VILA: Learning Image Aesthetics from User Comments with Vision-Language Pretraining
  4. 2026Venus: Benchmarking and Empowering Multimodal Large Language Models for Aesthetic Guidance and Cropping
  5. 2024UniQA: Unified Vision-Language Pre-training for Image Quality and Aesthetic Assessment
  6. 2026Visual Aesthetic Benchmark: Can Frontier Models Judge Beauty?
  7. 2026AesFormer: Transform Everyday Photos into Beautiful Memories
  8. 2024IRR: Image Review Ranking Framework for Evaluating Vision-Language Models