mlsanityData to 7 Oct 2026

CiQi-Agent: Aligning Vision, Tools and Aesthetics in Multimodal Agent for Cultural Reasoning on Chinese Porcelains

arXiv 2603.28474 ↗First posted 30 Mar 2026cs.CV cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

The connoisseurship of antique Chinese porcelain demands extensive historical expertise, material understanding, and aesthetic sensitivity, making it difficult for non-specialists to engage. To democratize cultural-heritage understanding and assist expert connoisseurship, we introduce CiQi-Agent -- a domain-specific Porcelain Connoisseurship Agent for intelligent analysis of antique Chinese porcelain. CiQi-Agent supports multi-image porcelain inputs and enables vision tool invocation and multimodal retrieval-augmented generation, performing fine-grained connoisseurship analysis across six attributes: dynasty, reign period, kiln site, glaze color, decorative motif, and vessel shape. Beyond attribute classification, it captures subtle visual details, retrieves relevant domain knowledge, and integrates visual and textual evidence to produce coherent, explainable connoisseurship descriptions. To achieve this capability, we construct a large-scale, expert-annotated dataset CiQi-VQA, comprising 29,596 porcelain specimens, 51,553 images, and 557,940 visual question--answering pairs, and further establish a comprehensive benchmark CiQi-Bench aligned with the previously mentioned six attributes. CiQi-Agent is trained through supervised fine-tuning, reinforcement learning, and a tool-augmented reasoning framework that integrates two categories of tools: a vision tool and multimodal retrieval tools. Experimental results show that CiQi-Agent (7B) outperforms all competitive open- and closed-source models across all six attributes on CiQi-Bench, achieving on average 12.2% higher accuracy than GPT-5. The model and dataset have been released and are publicly available at https://huggingface.co/datasets/SII-Monument-Valley/CiQi-VQA.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 30 of its 49 references that are in the map. First posted on arXiv 30 Mar 2026.

Builds on

30 of 49 references.

References · 30

  1. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
  2. 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,069
  3. 2025Qwen2.5-VL Technical Reportcited by 5,418
  4. 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,151
  5. 2023InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Taskscited by 2,534
  6. 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiencycited by 1,419
  7. 2024M3-Embedding: Multi-Linguality, Multi-Functionality, Multi-Granularity Text Embeddings Through Self-Knowledge Distillationcited by 1,050
  8. 2023Visual ChatGPT: Talking, Drawing and Editing with Visual Foundation Modelscited by 659
  9. 2023ViperGPT: Visual Inference via Python Execution for Reasoningcited by 591
  10. 2022Visual Programming: Compositional visual reasoning without trainingcited by 507
  11. 2025DeepEyes: Incentivizing "Thinking with Images" via Reinforcement Learningcited by 398
  12. 2023Med-Flamingo: a Multimodal Medical Few-shot Learnercited by 387
18 more
  1. 2025Kimi-VL Technical Reportcited by 381
  2. 2024SWIFT:A Scalable lightWeight Infrastructure for Fine-Tuningcited by 345
  3. 2023Towards Generalist Biomedical AIcited by 286
  4. 2024Visual Sketchpad: Sketching as a Visual Chain of Thought for Multimodal Language Modelscited by 260
  5. 2023Compositional Chain-of-Thought Prompting for Large Multimodal Modelscited by 160
  6. 2023Dolphins: Multimodal Language Model for Drivingcited by 124
  7. 2024Insight-V: Exploring Long-Chain Visual Reasoning with Multimodal Large Language Modelscited by 112
  8. 2025Thinking with Generated Imagescited by 71
  9. 2024AesExpert: Towards Multi-modality Foundation Model for Image Aesthetics Perceptioncited by 53
  10. 2025V-Thinker: Interactive Thinking with Imagescited by 26
  11. 2024No Culture Left Behind: ArtELingo-28, a Benchmark of WikiArt with Captions in 28 Languagescited by 19
  12. 2025Vision-Language Modeling Meets Remote Sensing: Models, Datasets and Perspectivescited by 18
  13. 2024FabGPT: An Efficient Large Multimodal Model for Complex Wafer Defect Knowledge Queriescited by 12
  14. 2024D-Rax: Domain-specific Radiologic assistant leveraging multi-modal data and eXpert model predictionscited by 7
  15. 2025VaseVQA: Multimodal Agent and Benchmark for Ancient Greek Potterycited by 6
  16. 2025Hanfu-Bench: A Multimodal Benchmark on Cross-Temporal Cultural Understanding and Transcreationcited by 5
  17. 2024Understanding Museum Exhibits using Vision-Language Reasoningcited by 4
  18. 2025Multi-task Learning for Identification of Porcelain in Song and Yuan Dynastiescited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Synthetic Data Augmentation for Multi-Task Chinese Porcelain Classification: A Stable Diffusion Approach
  2. 2026VaseMuseum: Digital Intelligent Museum for Ancient Greek Pottery
  3. 2026CArtBench: Evaluating Vision-Language Models on Chinese Art Understanding, Interpretation, and Authenticity
  4. 2025VQArt-Bench: A semantically rich VQA Benchmark for Art and Cultural Heritage
  5. 2026CulMind: Benchmarking Multimodal Understanding and Reasoning in Chinese Cultural Heritage
  6. 2026A-MAR: Agent-based Multimodal Art Retrieval for Fine-Grained Artwork Understanding
  7. 2025Provenance Analysis of Archaeological Artifacts via Multimodal RAG Systems
  8. 2026Specializing Large Models for Oracle Bone Script Interpretation via Component-Grounded Multimodal Knowledge Augmentation