Do Vision-Language Models Agree on the Affective Qualities of Shape? A Cross-Model Audit for Generative Design Interfaces
On the map: Multimodal LLMs / vision-language models → VLM benchmarks and visual reasoning
Abstract (arXiv)
Generative design interfaces increasingly expose semantic controls that let users steer output with concepts such as "more elegant" or "more minimalist," typically encoded by a vision-language model (VLM). A practical question is whether state-of-the-art VLMs represent objects consistently in terms of the same concept. We audit 6 VLMs by ranking untextured 3D objects along Kansei adjective pairs, where Kansei describes affective impressions of product form, with each axis defined as the difference between the text representations of its two poles. Geometric pairs serve as positive controls, and pairs of unrelated adjectives establish an empirical null. Across 10 categories of ShapeNet database, affective axes converge above the null (mean pairwise rank correlation 0.36 vs. 0.14) but below the geometric ceiling (0.44). The agreement between models is partial and highly uneven: on the three axes shared by all categories, mean convergence ranges from 0.21 for bookshelves to 0.51 for jars. Convergence depends primarily on whether a category's representational variation aligns with the semantic direction being evaluated, rather than simply on how much the objects vary in shape overall. Cross-model convergence does not imply agreement with human judgments. Based on our findings, we implement a UI prototype that shows how the audit can inform which Kansei descriptors to expose as controls for a given object class and which to withhold.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in VLM benchmarks and visual reasoning, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 17 of its 57 references that are in the map. First posted on arXiv 26 Aug 2026.
Builds on
17 of 57 references.
References · 17
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2016Simple and Scalable Predictive Uncertainty Estimation using Deep Ensemblescited by 3,926
- 2021Scaling Up Visual and Vision-Language Representation Learning With Noisy Text Supervisioncited by 3,864
- 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,897
- 2019Similarity of Neural Network Representations Revisitedcited by 1,755
- 2016Man is to Computer Programmer as Woman is to Homemaker? Debiasing Word Embeddingscited by 1,312
- 2025SigLIP 2: Multilingual Vision-Language Encoders with Improved Semantic Understanding, Localization, and Dense Featurescited by 1,188
- 2022Reproducible scaling laws for contrastive language-image learningcited by 1,173
- 2021StyleCLIP: Text-Driven Manipulation of StyleGAN Imagerycited by 991
- 2022Exploring CLIP for Assessing the Look and Feel of Imagescited by 991
- 2021FLAVA: A Foundational Language And Vision Alignment Modelcited by 649
- 2020GANSpace: Discovering Interpretable GAN Controlscited by 614
5 more
- 2026Qwen3-VL-Embedding and Qwen3-VL-Reranker: A Unified Framework for State-of-the-Art Multimodal Retrieval and Rankingcited by 230
- 2016Photo Aesthetics Ranking Network with Attributes and Content Adaptationcited by 125
- 2023VILA: Learning Image Aesthetics from User Comments with Vision-Language Pretrainingcited by 65
- 20223DALL-E: Integrating Text-to-Image AI in 3D Design Workflowscited by 41
- 2022GANSlider: How Users Control Generative Models for Images using Multiple Sliders with and without Feedforward Informationcited by 13
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Modeling Aesthetic Preferences in 3D Shapes: A Large-Scale Paired Comparison Study Across Object Categories
- 2026Can Vision Language Models Assess Graphic Design Aesthetics? A Benchmark, Evaluation, and Dataset Perspective
- 2025How Modality Shapes Perception and Reasoning: A Study of Error Propagation in ARC-AGI
- 2026Shape of Thought: Progressive Object Assembly via Visual Chain-of-Thought
- 2025Human-Aligned Generative Perception: Bridging Psychophysics and Generative Models
- 2026Do Emotion Concepts Generalize Across Sources, Modalities, and Architectures in Vision-Language Models?
- 2026The Geometry of Representational Failures in Vision Language Models
- 2022When and why vision-language models behave like bags-of-words, and what to do about it?