# Estimate and Replace: A Novel Approach to Integrating Deep Neural Networks with Existing Applications

arXiv: https://arxiv.org/abs/1804.09028 · HTML: https://mlsanity.com/paper/1804.09028/

## Key facts

- Cited by 21 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 24 Apr 2018.

## Built on by (most cited first, 21 of 21)

- [Faithfulness in Natural Language Generation: A Systematic Survey of Analysis, Evaluation and Optimization Methods](https://mlsanity.com/paper/2203.05227/) (2022)
- [Towards out of distribution generalization for problems in mechanics](https://mlsanity.com/paper/2206.14917/) (2022)
- [Facial Expression Recognition with Swin Transformer](https://mlsanity.com/paper/2203.13472/) (2022)
- [Noise Optimization for Artificial Neural Networks](https://mlsanity.com/paper/2102.04450/) (2021)
- [The Dawn of KAN in Image-to-Image (I2I) Translation: Integrating Kolmogorov-Arnold Networks with GANs for Unpaired I2I Translation](https://mlsanity.com/paper/2408.08216/) (2024)
- [Multi Modal Facial Expression Recognition with Transformer-Based Fusion Networks and Dynamic Sampling](https://mlsanity.com/paper/2303.08419/) (2023)
- [Graph Neural Aggregation-diffusion with Metastability](https://mlsanity.com/paper/2403.20221/) (2024)
- [A Synergistic Approach In Network Intrusion Detection By Neurosymbolic AI](https://mlsanity.com/paper/2406.00938/) (2024)
- [An h-space Based Adversarial Attack for Protection Against Few-shot Personalization](https://mlsanity.com/paper/2507.17554/) (2025)
- [Ada-QPacknet -- adaptive pruning with bit width reduction as an efficient continual learning method without forgetting](https://mlsanity.com/paper/2308.07939/) (2023)
- [Physics Sensor Based Deep Learning Fall Detection System](https://mlsanity.com/paper/2403.06994/) (2024)
- [Out-of-distribution detection based on subspace projection of high-dimensional features output by the last convolutional layer](https://mlsanity.com/paper/2405.01662/) (2024)
- [Layer-Wise Perturbations via Sparse Autoencoders for Adversarial Text Generation](https://mlsanity.com/paper/2508.10404/) (2025)
- [Animating Still Images](https://mlsanity.com/paper/2209.10497/) (2022)
- [Improved Breast Cancer Diagnosis through Transfer Learning on Hematoxylin and Eosin Stained Histology Images](https://mlsanity.com/paper/2309.08745/) (2023)
- [DUNE: A Machine Learning Deep UNet++ based Ensemble Approach to Monthly, Seasonal and Annual Climate Forecasting](https://mlsanity.com/paper/2408.06262/) (2024)
- [REL: Working out is all you need](https://mlsanity.com/paper/2412.04645/) (2024)
- [ViRAC: A Vision-Reasoning Agent Head Movement Control Framework in Arbitrary Virtual Environments](https://mlsanity.com/paper/2502.10046/) (2025)
- [Agent-Based Detection and Resolution of Incompleteness and Ambiguity in Interactions with Large Language Models](https://mlsanity.com/paper/2507.03726/) (2025)
- [Fine-tuning Pre-trained Audio Models for COVID-19 Detection: A Technical Report](https://mlsanity.com/paper/2511.14939/) (2025)
- [Student Classroom Behavior Recognition Based on Improved YOLOv8s](https://mlsanity.com/paper/2604.27293/) (2026)

## Abstract (arXiv)

Existing applications include a huge amount of knowledge that is out of reach for deep neural networks. This paper presents a novel approach for integrating calls to existing applications into deep learning architectures. Using this approach, we estimate each application's functionality with an estimator, which is implemented as a deep neural network (DNN). The estimator is then embedded into a base network that we direct into complying with the application's interface during an end-to-end optimization process. At inference time, we replace each estimator with its existing application counterpart and let the base network solve the task by interacting with the existing application. Using this 'Estimate and Replace' method, we were able to train a DNN end-to-end with less data and outperformed a matching DNN that did not interact with the external application.