mlsanityData to 7 Oct 2026

SemiFA: An Agentic Multi-Modal Framework for Autonomous Semiconductor Failure Analysis Report Generation

arXiv 2604.13236 ↗First posted 14 Apr 2026cs.CV cs.AI eess.IVcited by 0

On the map: LLM agents and tool use → Software engineering coding agents

Abstract (arXiv)

Semiconductor failure analysis (FA) requires engineers to examine inspection images, correlate equipment telemetry, consult historical defect records, and write structured reports, a process that can consume several hours of expert time per case. We present SemiFA, an agentic multi-modal framework that autonomously generates structured FA reports from semiconductor inspection images in under one minute. SemiFA decomposes FA into a four-agent LangGraph pipeline: a DefectDescriber that classifies and narrates defect morphology using DINOv2 and LLaVA-1.6, a RootCauseAnalyzer that fuses SECS/GEM equipment telemetry with historically similar defects retrieved from a Qdrant vector database, a SeverityClassifier that assigns severity and estimates yield impact, and a RecipeAdvisor that proposes corrective process adjustments. A fifth node assembles a PDF report. We introduce SemiFA-930, a dataset of 930 annotated semiconductor defect images paired with structured FA narratives across nine defect classes, drawn from procedural synthesis, WM-811K, and MixedWM38. Our DINOv2-based classifier achieves 92.1% accuracy on 140 validation images (macro F1 = 0.917), and the full pipeline produces complete FA reports in 48 seconds on an NVIDIA A100-SXM4-40 GB GPU. A GPT-4o judge ablation across four modality conditions demonstrates that multi-modal fusion improves root cause reasoning by +0.86 composite points (1-5 scale) over an image-only baseline, with equipment telemetry as the more load-bearing modality. To our knowledge, SemiFA is the first system to integrate SECS/GEM equipment telemetry into a vision-language model pipeline for autonomous FA report generation.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Software engineering coding agents, one of 16 directions in LLM agents and tool use. Builds on 18 of its 38 references that are in the map. First posted on arXiv 14 Apr 2026.

Builds on

18 of 38 references.

Closest ancestors · 1

Same direction, newest first

  1. 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversation16 Aug

Other references · 17

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  3. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  4. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,393
  5. 2023Visual Instruction Tuningcited by 7,792
  6. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
  7. 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,069
  8. 2024GPT-4o System Cardcited by 4,467
  9. 2023QLoRA: Efficient Finetuning of Quantized LLMscited by 3,355
  10. 2023InstructBLIP: Towards General-purpose Vision-Language Models with Instruction Tuningcited by 2,855
  11. 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,081
  12. 2023ToolLLM: Facilitating Large Language Models to Master 16000+ Real-world APIscited by 1,880
5 more
  1. 2023LLaVA-Med: Training a Large Language-and-Vision Assistant for Biomedicine in One Daycited by 1,287
  2. 2023GeoChat: Grounded Large Vision-Language Model for Remote Sensingcited by 320
  3. 2023WinCLIP: Zero-/Few-Shot Anomaly Classification and Segmentationcited by 311
  4. 2023Foundation Models in Robotics: Applications, Challenges, and the Futurecited by 212
  5. 2023AnomalyGPT: Detecting Industrial Anomalies Using Large Vision-Language Modelscited by 169

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Intelligent Assistants for the Semiconductor Failure Analysis with LLM-Based Planning Agents
  2. 2025LVLMs as inspectors: an agentic framework for category-level structural defect annotation
  3. 2026A Hybrid Vision-Language Architecture for Automated Defect Reasoning and Report Generation in Industrial Inspection
  4. 2026Synthetic Defect Image Generation for Power Line Insulator Inspection Using Multimodal Large Language Models
  5. 2026AgentFixer: From Failure Detection to Fix Recommendations in LLM Agentic Systems
  6. 2024FabGPT: An Efficient Large Multimodal Model for Complex Wafer Defect Knowledge Queries
  7. 2026WaferSAGE: Large Language Model-Powered Wafer Defect Analysis via Synthetic Data Generation and Rubric-Guided Reinforcement Learning
  8. 2026Multi-Modal Agents for Power Distribution Defect Detection: An Evaluation of Foundation Models