mlsanityData to 13 Oct 2026

Triplet Feature Fusion for Equipment Anomaly Prediction : An Open-Source Methodology Using Small Foundation Models

arXiv 2602.15089 ↗First posted 16 Feb 2026cs.LG stat.MLcited by 1

Not on the map. Why?

Abstract (arXiv)

Predicting equipment anomalies before they escalate into failures is a critical challenge in industrial facility management. Existing approaches rely either on hand-crafted threshold rules, which lack generalizability, or on large neural models that are impractical for on-site, air-gapped deployments. We present an industrial methodology that resolves this tension by combining open-source small foundation models into a unified 1,116-dimensional Triplet Feature Fusion pipeline. This pipeline integrates: (1) statistical features (x in R28) derived from 90-day sensor histories, (2) time-series embeddings (y in R64) from a LoRA-adapted IBM Granite TinyTimeMixer (TTM, 133K parameters), and (3) multilingual text embeddings (z in R1024) extracted from Japanese equipment master records via multilingual-e5-large. The concatenated triplet h = [x; y; z] is processed by a LightGBM classifier (< 3 MB) trained to predict anomalies at 30-, 60-, and 90-day horizons. All components use permissive open-source licenses (Apache 2.0 / MIT). The inference-time pipeline runs entirely on CPU in under 2 ms, enabling edge deployment on co-located hardware without cloud dependency. On a dataset of 64 HVAC units comprising 67,045 samples, the triplet model achieves Precision = 0.992, F1 = 0.958, and ROC-AUC = 0.998 at the 30-day horizon. Crucially, it reduces the False Positive Rate from 0.6 percent (baseline) to 0.1 percent - an 83 percent reduction attributable to equipment-type conditioning via text embedding z. Cluster analysis reveals that the embeddings align time-series signatures with distinct fault archetypes, explaining how compact multilingual representations improve discrimination without explicit categorical encoding.

Key facts. Cited by 1 paper in the map (data through 13 Oct 2026). Builds on 14 of its 32 references that are in the map. First posted on arXiv 16 Feb 2026.

Builds on

14 of 32 references.

References · 14

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,588
  2. 2016XGBoost: A Scalable Tree Boosting Systemcited by 5,143
  3. 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,314
  4. 2018UMAP: Uniform Manifold Approximation and Projection for Dimension Reductioncited by 2,870
  5. 2024Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phonecited by 1,908
  6. 2023A decoder-only foundation model for time-series forecastingcited by 674
  7. 2019TabNet: Attentive Interpretable Tabular Learningcited by 645
  8. 2024Unified Training of Universal Time Series Forecasting Transformerscited by 602
  9. 2021Deep Neural Networks and Tabular Data: A Surveycited by 489
  10. 2018Detecting Spacecraft Anomalies Using LSTMs and Nonparametric Dynamic Thresholdingcited by 408
  11. 2024Multilingual E5 Text Embeddings: A Technical Reportcited by 364
  12. 2017A Multimodal Anomaly Detector for Robot-Assisted Feeding Using an LSTM-based Variational Autoencodercited by 209
2 more
  1. 2023Efficient Large Language Models: A Surveycited by 185
  2. 2021Flood Inflow Forecast Using L2-norm Ensemble Weighting Sea Surface Featurecited by 1

Built on by

Cited by year (2026 to 13 Oct)

Citing papers per year: 2026: 1.

1 paper.