Pruning Coherent Integrated Photonic Neural Networks Using the Lottery Ticket Hypothesis
Not on the map. Why?
Abstract (arXiv)
Singular-value-decomposition-based coherent integrated photonic neural networks (SC-IPNNs) have a large footprint, suffer from high static power consumption for training and inference, and cannot be pruned using conventional DNN pruning techniques. We leverage the lottery ticket hypothesis to propose the first hardware-aware pruning method for SC-IPNNs that alleviates these challenges by minimizing the number of weight parameters. We prune a multi-layer perceptron-based SC-IPNN and show that up to 89% of the phase angles, which correspond to weight parameters in SC-IPNNs, can be pruned with a negligible accuracy loss (smaller than 5%) while reducing the static power consumption by up to 86%.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 7 of its 20 references that are in the map. First posted on arXiv 14 Dec 2021.
Builds on
7 of 20 references.
References · 7
- 2015Deep Compression: Compressing Deep Neural Networks with Pruning, Trained Quantization and Huffman Codingcited by 2,291
- 2018The Lottery Ticket Hypothesis: Finding Sparse, Trainable Neural Networkscited by 2,250
- 2021A Survey on Silicon Photonics for Deep Learningcited by 23
- 2019Reprogrammable Electro-Optic Nonlinear Activation Functions for Optical Neural Networkscited by 19
- 2019Design of optical neural networks with component imprecisionscited by 10
- 2021SONIC: A Sparse Neural Network Inference Accelerator with Silicon Photonics for Energy-Efficient Deep Learningcited by 10
- 2020Modeling Silicon-Photonic Neural Networks under Uncertaintiescited by 7
Built on by
Citing papers per year: 2022: 1; 2023: 0; 2024: 2.
3 papers.
- 2024SimPhony: A Device-Circuit-Architecture Cross-Layer Modeling and Simulation Framework for Heterogeneous Electronic-Photonic AI Systemcited by 6
- 2024SCATTER: Algorithm-Circuit Co-Sparse Photonic Accelerator with Thermal-Tolerant, Power-Efficient In-situ Light Redistributioncited by 5
- 2022Characterizing Coherent Integrated Photonic Neural Networks under Imperfectionscited by 4
- 2024SimPhony: A Device-Circuit-Architecture Cross-Layer Modeling and Simulation Framework for Heterogeneous Electronic-Photonic AI System20 Nov 2024
- 2024SCATTER: Algorithm-Circuit Co-Sparse Photonic Accelerator with Thermal-Tolerant, Power-Efficient In-situ Light Redistribution7 Jul 2024
- 2022Characterizing Coherent Integrated Photonic Neural Networks under Imperfections22 Jul 2022