mlsanityData to 14 Oct 2026

Fountain -- an intelligent contextual assistant combining knowledge representation and language models for manufacturing risk identification

arXiv 2308.00364 ↗First posted 1 Aug 2023cs.CL cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Deviations from the approved design or processes during mass production can lead to unforeseen risks. However, these changes are sometimes necessary due to changes in the product design characteristics or an adaptation in the manufacturing process. A major challenge is to identify these risks early in the workflow so that failures leading to warranty claims can be avoided. We developed Fountain as a contextual assistant integrated in the deviation management workflow that helps in identifying the risks based on the description of the existing design and process criteria and the proposed deviation. In the manufacturing context, it is important that the assistant provides recommendations that are explainable and consistent. We achieve this through a combination of the following two components 1) language models finetuned for domain specific semantic similarity and, 2) knowledge representation in the form of a property graph derived from the bill of materials, Failure Modes and Effect Analysis (FMEA) and prior failures reported by customers. Here, we present the nuances of selecting and adapting pretrained language models for an engineering domain, continuous model updates based on user interaction with the contextual assistant and creating the causal chain for explainable recommendations based on the knowledge representation. Additionally, we demonstrate that the model adaptation is feasible using moderate computational infrastructure already available to most engineering teams in manufacturing organizations and inference can be performed on standard CPU only instances for integration with existing applications making these methods easily deployable.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 21 of its 38 references that are in the map. First posted on arXiv 1 Aug 2023.

Builds on

21 of 38 references.

References · 21

  1. 2017Attention Is All You Needcited by 60,361
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  3. 2020Language Models are Few-Shot Learnerscited by 32,419
  4. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
  5. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
  6. 2014Neural Machine Translation by Jointly Learning to Align and Translatecited by 4,548
  7. 2019DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lightercited by 4,307
  8. 2019XLNet: Generalized Autoregressive Pretraining for Language Understandingcited by 2,811
  9. 2017A Broad-Coverage Challenge Corpus for Sentence Understanding through Inferencecited by 2,682
  10. 2022BLOOM: A 176B-Parameter Open-Access Multilingual Language Modelcited by 1,984
  11. 2015A large annotated corpus for learning natural language inferencecited by 1,847
  12. 2020Don't Stop Pretraining: Adapt Language Models to Domains and Taskscited by 1,565
9 more
  1. 2020MiniLM: Deep Self-Attention Distillation for Task-Agnostic Compression of Pre-Trained Transformerscited by 1,463
  2. 2021Scaling Language Models: Methods, Analysis & Insights from Training Gophercited by 1,202
  3. 2017SemEval-2017 Task 1: Semantic Textual Similarity - Multilingual and Cross-lingual Focused Evaluationcited by 1,001
  4. 2020MPNet: Masked and Permuted Pre-training for Language Understandingcited by 981
  5. 2020A Survey on Knowledge Graphs: Representation, Acquisition and Applicationscited by 643
  6. 2020Knowledge Graphscited by 621
  7. 2017Supervised Learning of Universal Sentence Representations from Natural Language Inference Datacited by 432
  8. 2015Skip-Thought Vectorscited by 322
  9. 2019RedisGraph GraphBLAS Enabled Graph Databasecited by 2

Built on by

Not cited yet.