mlsanityData to 7 Oct 2026

TeMPO: Efficient Time-Multiplexed Dynamic Photonic Tensor Core for Edge AI with Compact Slow-Light Electro-Optic Modulator

arXiv 2402.07393 ↗First posted 12 Feb 2024cs.ET cs.AI cs.LGcited by 5

Not on the map. Why?

Abstract (arXiv)

Electronic-photonic computing systems offer immense potential in energy-efficient artificial intelligence (AI) acceleration tasks due to the superior computing speed and efficiency of optics, especially for real-time, low-energy deep neural network (DNN) inference tasks on resource-restricted edge platforms. However, current optical neural accelerators based on foundry-available devices and conventional system architecture still encounter a performance gap compared to highly customized electronic counterparts. To bridge the performance gap due to lack of domain specialization, we present a time-multiplexed dynamic photonic tensor accelerator, dubbed TeMPO, with cross-layer device/circuit/architecture customization. At the device level, we present foundry-compatible, customized photonic devices, including a slow-light electro-optic modulator with experimental demonstration, optical splitters, and phase shifters that significantly reduce the footprint and power in input encoding and dot-product calculation. At the circuit level, partial products are hierarchically accumulated via parallel photocurrent aggregation, lightweight capacitive temporal integration, and sequential digital summation, considerably relieving the analog-to-digital conversion bottleneck. We also employ a multi-tile, multi-core architecture to maximize hardware sharing for higher efficiency. Across diverse edge AI workloads, TeMPO delivers digital-comparable task accuracy with superior quantization/noise tolerance. We achieve a 368.6 TOPS peak performance, 22.3 TOPS/W energy efficiency, and 1.2 TOPS/mm2 compute density, pushing the Pareto frontier in edge AI hardware. This work signifies the power of cross-layer co-design and domain-specific customization, paving the way for future electronic-photonic accelerators with even greater performance and efficiency.

Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 14 of its 63 references that are in the map. First posted on arXiv 12 Feb 2024.

Builds on

14 of 63 references.

References · 14

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2020Language Models are Few-Shot Learnerscited by 32,199
  3. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  4. 2023GPT-4 Technical Reportcited by 18,132
  5. 2020End-to-End Object Detection with Transformerscited by 7,384
  6. 2014Fully Convolutional Networks for Semantic Segmentationcited by 4,845
  7. 2020Training data-efficient image transformers & distillation through attentioncited by 4,560
  8. 2019Learned Step Size Quantizationcited by 604
  9. 2023TPU v4: An Optically Reconfigurable Supercomputer for Machine Learning with Hardware Support for Embeddingscited by 198
  10. 2017Deep Residual Learning for Small-Footprint Keyword Spottingcited by 68
  11. 2016Neuromorphic Silicon Photonic Networkscited by 66
  12. 2023Lightening-Transformer: A Dynamically-operated Optically-interconnected Photonic Transformer Acceleratorcited by 15
2 more
  1. 2021A compact butterfly-style silicon photonic-electronic neural chip for hardware-efficient deep learningcited by 13
  2. 2020Graphcore C2 Card performance for image-based deep learning application: A Reportcited by 5

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 1; 2025: 3; 2026: 1.

5 papers.