mlsanityData to 14 Oct 2026

Feed-Forward Networks with Attention Can Solve Some Long-Term Memory Problems

arXiv 1512.08756 ↗First posted 29 Dec 2015cs.LG cs.NEcited by 23

Not on the map. Why?

Abstract (arXiv)

We propose a simplified model of attention which is applicable to feed-forward neural networks and demonstrate that the resulting model can solve the synthetic "addition" and "multiplication" long-term memory problems for sequence lengths which are both longer and more widely varying than the best published results for these tasks.

Key facts. Cited by 23 papers in the map (data through 14 Oct 2026). First posted on arXiv 29 Dec 2015.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2021: 6; 2022: 4; 2023: 4; 2024: 3; 2025: 2; 2026: 4.

23 papers.

Sort:

  1. 2021Skeleton Aware Multi-modal Sign Language Recognitioncited by 101
  2. 2023A Systematic Review of Deep Learning-based Research on Radiology Report Generationcited by 14
  3. 2023Event-Based Contrastive Learning for Medical Time Seriescited by 13
  4. 2022ArmanEmo: A Persian Dataset for Text-based Emotion Detectioncited by 9
  5. 2021Are the Multilingual Models Better? Improving Czech Sentiment with Transformerscited by 7
  6. 2024Description-based Controllable Text-to-Speech with Cross-Lingual Voice Controlcited by 4
  7. 2021Weakly Supervised Attention-based Models Using Activation Maps for Citrus Mite and Insect Pest Classificationcited by 3
  8. 2025Voice Impression Control in Zero-Shot TTScited by 3
  9. 2025Multi-interaction TTS toward professional recording reproductioncited by 2
  10. 2021Multi-Label Annotation of Chest Abdomen Pelvis Computed Tomography Text Reports Using Deep Learningcited by 1
  11. 2021Leveraging Multi-domain, Heterogeneous Data using Deep Multitask Learning for Hate Speech Detectioncited by 1
  12. 2022Lite Unified Modeling for Discriminative Reading Comprehensioncited by 1
11 more
  1. 2022N-ACT: An Interpretable Deep Learning Model for Automatic Cell Type and Salient Gene Identificationcited by 1
  2. 2026Investigation for Relative Voice Impression Estimationcited by 1
  3. 2021BCFNet: A Balanced Collaborative Filtering Network with Attention Mechanismcited by 0
  4. 2022Clustering Text Using Attentioncited by 0
  5. 2023Assessment of few-hits machine learning classification algorithms for low energy physics in liquid argon detectorscited by 0
  6. 2023Enhancing Instance-Level Image Classification with Set-Level Labelscited by 0
  7. 2024Enhancing Apparent Personality Trait Analysis with Cross-Modal Embeddingscited by 0
  8. 2024Quantity versus Diversity: Influence of Data on Detecting EEG Pathology with Advanced ML Modelscited by 0
  9. 2026Extracting Problem and Method Sentence from Scientific Papers: A Context-enhanced Transformer Using Formulaic Expression Desensitizationcited by 0
  10. 2026Leveraging a Foundation Model for the EEG-Based Diagnosis of Alzheimer's Diseasecited by 0
  11. 2026Multi-Step Forecasting of Grape Berry Temperature based on LSTM Model with Feed-Forward Attentioncited by 0