Integrating Visual and X-Ray Machine Learning Features in the Study of Paintings by Goya
Not on the map. Why?
Abstract (arXiv)
Art authentication of Francisco Goya's works presents complex computational challenges due to his heterogeneous stylistic evolution and extensive historical patterns of forgery. We introduce a novel multimodal machine learning framework that applies identical feature extraction techniques to both visual and X-ray radiographic images of Goya paintings. The unified feature extraction pipeline incorporates Grey-Level Co-occurrence Matrix descriptors, Local Binary Patterns, entropy measures, energy calculations, and colour distribution analysis applied consistently across both imaging modalities. The extracted features from both visual and X-ray images are processed through an optimised One-Class Support Vector Machine with hyperparameter tuning. Using a dataset of 24 authenticated Goya paintings with corresponding X-ray images, split into an 80/20 train-test configuration with 10-fold cross-validation, the framework achieves 97.8% classification accuracy with a 0.022 false positive rate. Case study analysis of ``Un Gigante'' demonstrates the practical efficacy of our pipeline, achieving 92.3% authentication confidence through unified multimodal feature analysis. Our results indicate substantial performance improvement over single-modal approaches, establishing the effectiveness of applying identical computational methods to both visual and radiographic imagery in art authentication applications.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 11 of its 29 references that are in the map. First posted on arXiv 2 Nov 2025.
Builds on
11 of 29 references.
References · 11
- 2017Multimodal Machine Learning: A Survey and Taxonomycited by 1,013
- 2022BEVFusion: Multi-Task Multi-Sensor Fusion with Unified Bird's-Eye View Representationcited by 850
- 2021LAVT: Language-Aware Vision Transformer for Referring Image Segmentationcited by 348
- 2021Vision-Language Transformer and Query Generation for Referring Segmentationcited by 240
- 2021UniT: Multimodal Multitask Learning with a Unified Transformercited by 195
- 2024Multimodal Alignment and Fusion: A Surveycited by 74
- 2021Multimodal Object Detection via Probabilistic Ensemblingcited by 68
- 2023Contrastive Grouping with Transformer for Referring Image Segmentationcited by 54
- 2024A review of deep learning-based information fusion techniques for multimodal medical image classificationcited by 25
- 2024Cross-aware Early Fusion with Stage-divided Vision and Language Transformer Encoders for Referring Image Segmentationcited by 21
- 2024A Survey on State-of-the-art Deep Learning Applications and Challengescited by 7
Built on by
Not cited yet.