mlsanityData to 7 Oct 2026

Self-Attention to Operator Learning-based 3D-IC Thermal Simulation

arXiv 2510.15968 ↗First posted 12 Oct 2025cs.LG cs.AI cs.ARcited by 6

Not on the map. Why?

Abstract (arXiv)

Thermal management in 3D ICs is increasingly challenging due to higher power densities. Traditional PDE-solving-based methods, while accurate, are too slow for iterative design. Machine learning approaches like FNO provide faster alternatives but suffer from high-frequency information loss and high-fidelity data dependency. We introduce Self-Attention U-Net Fourier Neural Operator (SAU-FNO), a novel framework combining self-attention and U-Net with FNO to capture long-range dependencies and model local high-frequency features effectively. Transfer learning is employed to fine-tune low-fidelity data, minimizing the need for extensive high-fidelity datasets and speeding up training. Experiments demonstrate that SAU-FNO achieves state-of-the-art thermal prediction accuracy and provides an 842x speedup over traditional FEM methods, making it an efficient tool for advanced 3D IC thermal simulations.

Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Builds on 12 of its 37 references that are in the map. First posted on arXiv 12 Oct 2025.

Builds on

12 of 37 references.

References · 12

  1. 2017Attention Is All You Needcited by 59,932
  2. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  3. 2020Fourier Neural Operator for Parametric Partial Differential Equationscited by 2,806
  4. 2017Non-local Neural Networkscited by 2,290
  5. 2021U-FNO -- An enhanced Fourier neural operator-based deep-learning model for multiphase flowcited by 292
  6. 2023Multi-Resolution Active Learning of Fourier Neural Operatorscited by 22
  7. 2025VFlow: Discovering Optimal Agentic Workflows for Verilog Generationcited by 19
  8. 2023DeepOHeat: Operator Learning-based Ultra-fast Thermal Simulation in 3D-IC Designcited by 13
  9. 2023Multi-fidelity prediction of fluid flow and temperature field based on transfer learning using Fourier Neural Operatorcited by 10
  10. 2022A Thermal Machine Learning Solver For Chip Simulationcited by 7
  11. 2023Multi-fidelity surrogate modeling for temperature field prediction using deep convolution neural networkcited by 7
  12. 2023GAR: Generalized Autoregression for Multi-Fidelity Fusioncited by 3

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 2; 2026: 4.

6 papers.