mlsanityData to 14 Oct 2026

Artificial Intelligence for the Characterization of Particles and Fibers by Optical Microscopy

arXiv 2608.00361 ↗First posted 1 Aug 2026cs.CV cs.AIcited by 1

Not on the map. Why?

Abstract (arXiv)

Optical microscopy of particle and fiber dispersions involves interpreting subtle visual cues influenced by specimen morphology, chemical composition, magnification, and illumination conditions. We introduce an artificial intelligence (AI) distillation framework that extracts semantically rich image embeddings from microscopy images using semantic anchors. A multimodal teacher combines each image's visual embedding with three text embeddings representing illumination modality, magnification, and specimen identity and morphology. Generated by LongCLIP's extended-context text encoder, this yields a 2304-dimensional block-structured teacher vector whose component blocks remain physically interpretable throughout training and inference. A student vision transformer (ViT) with a multi-layer perceptron (MLP) decoder is trained to reconstruct this teacher vector from the image alone, minimizing a mean absolute error (L1) loss that enforces coordinate-level fidelity to the teacher's block structure. A cross-entropy term over pseudo-classes derived from HDBSCAN clustering of the teacher embedding space acts as a collapse-prevention regularizer, enforcing inter-cluster separation without requiring contrastive negative mining. At inference, the student operates on image input alone, producing compact embeddings that recover the full semantic content of the teacher vector. The framework achieves approximately 80% pseudo-class validation accuracy and 75% Recall@1 on fine-grained specimen description labels under leave-one-out nearest-neighbor retrieval. These results demonstrate that semantic anchoring enables a vision-only student to acquire richer and more interpretable representations than image-only training, with direct applicability to retrieval, classification, and exploratory analysis of heterogeneous particle and fiber dispersions.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 10 of its 31 references that are in the map. First posted on arXiv 1 Aug 2026.

Builds on

10 of 31 references.

References · 10

  1. 2020Bootstrap your own latent: A new approach to self-supervised Learningcited by 4,750
  2. 2018UMAP: Uniform Manifold Approximation and Projection for Dimension Reductioncited by 2,898
  3. 2020Knowledge Distillation: A Surveycited by 1,603
  4. 2025DINOv3cited by 1,414
  5. 2024Multimodal Alignment and Fusion: A Surveycited by 74
  6. 2021Imbalanced Big Data Oversampling: Taxonomy, Algorithms, Software, Guidelines and Future Directionscited by 21
  7. 2024μ-Bench: A Vision-Language Benchmark for Microscopy Understandingcited by 15
  8. 2025Generalizing vision-language models to novel domains: A comprehensive surveycited by 7
  9. 2025Zero-shot Autonomous Microscopy for Scalable and Intelligent Characterization of 2D Materialscited by 4
  10. 2024Multimodal Multilabel Classification by CLIPcited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.