mlsanityData to 14 Oct 2026

HTMA-Net: Towards Multiplication-Avoiding Neural Networks via Hadamard Transform and In-Memory Computing

arXiv 2509.23103 ↗First posted 27 Sep 2025cs.CV cs.AIcited by 1

Not on the map. Why?

Abstract (arXiv)

Reducing the cost of multiplications is critical for efficient deep neural network deployment, especially in energy-constrained edge devices. In this work, we introduce HTMA-Net, a novel framework that integrates the Hadamard Transform (HT) with multiplication-avoiding (MA) SRAM-based in-memory computing to reduce arithmetic complexity while maintaining accuracy. Unlike prior methods that only target multiplications in convolutional layers or focus solely on in-memory acceleration, HTMA-Net selectively replaces intermediate convolutions with Hybrid Hadamard-based transform layers whose internal convolutions are implemented via multiplication-avoiding in-memory operations. We evaluate HTMA-Net on ResNet-18 using CIFAR-10, CIFAR-100, and Tiny ImageNet, and provide a detailed comparison against regular, MF-only, and HT-only variants. Results show that HTMA-Net eliminates up to 52% of multiplications compared to baseline ResNet-18, ResNet-20, and ResNet-32 models, while achieving comparable accuracy in evaluation and significantly reducing computational complexity and the number of parameters. Our results demonstrate that combining structured Hadamard transform layers with SRAM-based in-memory computing multiplication-avoiding operators is a promising path towards efficient deep learning architectures.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 13 of its 23 references that are in the map. First posted on arXiv 27 Sep 2025.

Builds on

13 of 23 references.

References · 13

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  3. 2017MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applicationscited by 3,845
  4. 2016XNOR-Net: ImageNet Classification Using Binary Convolutional Neural Networkscited by 849
  5. 2013Deep Scattering Spectrumcited by 52
  6. 2021A comprehensive review of Binary Neural Networkcited by 45
  7. 2021Fast Walsh-Hadamard Transform and Smooth-Thresholding Based Binary Layers in Deep Neural Networkscited by 14
  8. 2022Block Walsh-Hadamard Transform Based Binary Layers in Deep Neural Networkscited by 13
  9. 2018Energy Efficient Hadamard Neural Networkscited by 12
  10. 2021MF-Net: Compute-In-Memory SRAM for Multibit Precision Inference using Memory-immersed Data Conversion and Multiplication-free Operatorscited by 12
  11. 2023A Hybrid Quantum-Classical Approach based on the Hadamard Transform for the Convolutional Layercited by 12
  12. 2025Combating the Memory Walls: Optimization Pathways for Long-Context Agentic LLM Inferencecited by 7
1 more
  1. 2024A Probabilistic Hadamard U-Net for MRI Bias Field Correctioncited by 4

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.