mlsanityData to 14 Oct 2026

Miller-Index-Based Latent Crystallographic Fracture Plane Reasoning and generation with Vision-Language Models

arXiv 2605.20416 ↗First posted 19 May 2026cs.LG physics.comp-phcited by 1

On the map: LLM reasoning → Clinical and biomedical applications

also in 1 more
Abstract (arXiv)

We study whether multimodal large language models (MLLMs) can leverage crystallographic plane indices (Miller indices) as a structured latent representation for reasoning about fracture geometry. We formulate Miller indices z = (h,k,l) as a latent variable governing idealized planar fracture and evaluate two complementary capabilities: (i) latent inference, where the model maps visual observations to plane hypotheses under physically valid conditions, and (ii) latent applicability assessment, where the model determines whether such a representation is meaningful for a given fracture image. Through extensive experiments spanning synthetic data, controlled 2D--3D geometric pairs, and real-world fracture images across multiple material classes -- including ceramics, glass, metals, and concrete -- we show that MLLMs can reliably perform latent inference in idealized settings and, critically, can reject the latent representation when the underlying physics does not support it. As an exploratory extension, we further examine AI-generated fracture sequences and observe qualitatively plausible brittle-fracture progression behaviors, suggesting that multimodal generative models may encode partial implicit physical priors related to material failure dynamics. These results suggest that MLLMs can act as physics-aware reasoning systems conditioned on structured latent priors, provided that the domain of validity is explicitly modeled.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Clinical and biomedical applications, one of 17 directions in LLM reasoning. Builds on 8 of its 14 references that are in the map. First posted on arXiv 19 May 2026.

Builds on

8 of 14 references.

References · 8

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2023GPT-4 Technical Reportcited by 18,396
  3. 2023Visual Instruction Tuningcited by 7,869
  4. 2023MM-REACT: Prompting ChatGPT for Multimodal Reasoning and Actioncited by 517
  5. 2026Robust Checkpoint Selection for Multimodal LLMs via Agentic Evaluation and Stability-Aware Rankingcited by 3
  6. 2026Multilingual OCR-Aware Fine-Tuning and Prompt-Guided Chain-of-Thought Reasoning for Multimodal Large Language Modelscited by 2
  7. 2026Grounded Post-Training with Hard Examples for Reducing Hallucination in Multimodal Large Language Modelscited by 2
  8. 2021Modeling 3D geometry using 1D laser distance measurements with application to cylinder for visualization and evaluating surface qualitycited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026Fine-tuning a vision-language model for fracture-surface morphology recognition
  2. 2025GARF: Learning Generalizable 3D Reassembly for Real-World Fractures
  3. 2026SCALAR: Quantifying Structural Hallucination, Consistency, and Reasoning Gaps in Materials Foundation Models
  4. 2026MaterialFigBENCH: benchmark dataset with figures for evaluating college-level materials science problem-solving abilities of multimodal large language models
  5. 2026Physics as the label for measuring and correcting materials reasoning in multimodal models
  6. 2025SoM-1K: A Thousand-Problem Benchmark Dataset for Strength of Materials
  7. 2022Unsupervised physics-informed disentanglement of multimodal data for high-throughput scientific discovery
  8. 2026CrystalXRD-Bench: Benchmarking Vision-Language Models for XRD Peak Indexing Across Diverse Crystalline Materials