Pathfinding Future PIM Architectures by Demystifying a Commercial PIM Technology
Not on the map. Why?
Abstract (arXiv)
Processing-in-memory (PIM) has been explored for decades by computer architects, yet it has never seen the light of day in real-world products due to their high design overheads and lack of a killer application. With the advent of critical memory-intensive workloads, several commercial PIM technologies have been introduced to the market ranging from domain-specific PIM architectures to more general-purpose PIM architectures. In this work, we deepdive into UPMEM's commercial PIM technology, a general-purpose PIM-enabled parallel architecture that is highly programmable. Our first key contribution is the development of a flexible simulation framework for PIM. The simulator we developed (aka PIMulator) enables the compilation of UPMEM-PIM source codes into its compiled machine-level instructions, which are subsequently consumed by our cycle-level performance simulator. Using PIMulator, we demystify UPMEM's PIM design through a detailed characterization study. Building on top of our characterization, we conduct a series of case studies to pathfind important architectural features that we deem will be critical for future PIM architectures to support
Key facts. Cited by 13 papers in the map (data through 7 Oct 2026). First posted on arXiv 1 Aug 2023.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2024: 6; 2025: 4; 2026: 3.
13 papers.
Sort:
By area:
- 2024LLMServingSim: A HW/SW Co-Simulation Infrastructure for LLM Inference Serving at Scalecited by 30
- 2025PAPI: Exploiting Dynamic Parallelism in Large Language Model Decoding with a Processing-In-Memory-Enabled Computing Systemcited by 19
- 2025Pimba: A Processing-in-Memory Acceleration for Post-Transformer Large Language Model Servingcited by 7
- 2024PIM-Opt: Demystifying Distributed Optimization Algorithms on a Real-World Processing-In-Memory Systemcited by 5
- 2024PIMphony: Overcoming Bandwidth and Capacity Inefficiency in PIM-based Long-Context LLM Inference Systemcited by 4
- 2025Sparse Attention Remapping with Clustering for Efficient LLM Decoding on PIMcited by 3
- 2024PyGim: An Efficient Graph Neural Network Library for Real Processing-In-Memory Architecturescited by 2
- 2024SwiftRL: Towards Efficient Reinforcement Learning on Real Processing-In-Memory Systemscited by 1
- 2024UpANNS: Enhancing Billion-Scale ANNS Efficiency with Real-World PIM Architecturecited by 0
- 2025DCC: Data-Centric Compilation of Machine Learning Kernels for Processing-In-Memory Architecturescited by 0
- 2026LP5X-PIM Sim: A High-Fidelity HW/SW Integrated Simulator for LPDDR5X-PIMcited by 0
- 2026D-NOVA: In-Storage Retrieval Accelerator via Dual-Bound 3D NAND-Optimized Similarity Search with Vector Adaptationcited by 0
1 more
- 2026PATTON: Enabling Commodity PIM for Production LLM Serving10 Sep 2026
- 2026D-NOVA: In-Storage Retrieval Accelerator via Dual-Bound 3D NAND-Optimized Similarity Search with Vector Adaptation20 Jul 2026
- 2026LP5X-PIM Sim: A High-Fidelity HW/SW Integrated Simulator for LPDDR5X-PIM30 May 2026
- 2025DCC: Data-Centric Compilation of Machine Learning Kernels for Processing-In-Memory Architectures19 Nov 2025
- 2025Pimba: A Processing-in-Memory Acceleration for Post-Transformer Large Language Model Serving14 Jul 2025
- 2025Sparse Attention Remapping with Clustering for Efficient LLM Decoding on PIM9 May 2025
- 2025PAPI: Exploiting Dynamic Parallelism in Large Language Model Decoding with a Processing-In-Memory-Enabled Computing System21 Feb 2025
- 2024PIMphony: Overcoming Bandwidth and Capacity Inefficiency in PIM-based Long-Context LLM Inference System28 Dec 2024
- 2024UpANNS: Enhancing Billion-Scale ANNS Efficiency with Real-World PIM Architecture31 Oct 2024
- 2024LLMServingSim: A HW/SW Co-Simulation Infrastructure for LLM Inference Serving at Scale10 Aug 2024
- 2024SwiftRL: Towards Efficient Reinforcement Learning on Real Processing-In-Memory Systems7 May 2024
- 2024PIM-Opt: Demystifying Distributed Optimization Algorithms on a Real-World Processing-In-Memory System10 Apr 2024
- 2024LLMServingSim: A HW/SW Co-Simulation Infrastructure for LLM Inference Serving at Scalecited by 30
- 2025PAPI: Exploiting Dynamic Parallelism in Large Language Model Decoding with a Processing-In-Memory-Enabled Computing Systemcited by 19
- 2024PIMphony: Overcoming Bandwidth and Capacity Inefficiency in PIM-based Long-Context LLM Inference Systemcited by 4
- 2025Sparse Attention Remapping with Clustering for Efficient LLM Decoding on PIMcited by 3
- 2026PATTON: Enabling Commodity PIM for Production LLM Servingcited by 0
- 2026PATTON: Enabling Commodity PIM for Production LLM Serving10 Sep 2026
- 2025Sparse Attention Remapping with Clustering for Efficient LLM Decoding on PIM9 May 2025
- 2025PAPI: Exploiting Dynamic Parallelism in Large Language Model Decoding with a Processing-In-Memory-Enabled Computing System21 Feb 2025
- 2024PIMphony: Overcoming Bandwidth and Capacity Inefficiency in PIM-based Long-Context LLM Inference System28 Dec 2024
- 2024LLMServingSim: A HW/SW Co-Simulation Infrastructure for LLM Inference Serving at Scale10 Aug 2024
- 2025Pimba: A Processing-in-Memory Acceleration for Post-Transformer Large Language Model Servingcited by 7
- 2024PIM-Opt: Demystifying Distributed Optimization Algorithms on a Real-World Processing-In-Memory Systemcited by 5
- 2024PyGim: An Efficient Graph Neural Network Library for Real Processing-In-Memory Architecturescited by 2
- 2024SwiftRL: Towards Efficient Reinforcement Learning on Real Processing-In-Memory Systemscited by 1
- 2025DCC: Data-Centric Compilation of Machine Learning Kernels for Processing-In-Memory Architecturescited by 0
- 2026LP5X-PIM Sim: A High-Fidelity HW/SW Integrated Simulator for LPDDR5X-PIMcited by 0
- 2026LP5X-PIM Sim: A High-Fidelity HW/SW Integrated Simulator for LPDDR5X-PIM30 May 2026
- 2025DCC: Data-Centric Compilation of Machine Learning Kernels for Processing-In-Memory Architectures19 Nov 2025
- 2025Pimba: A Processing-in-Memory Acceleration for Post-Transformer Large Language Model Serving14 Jul 2025
- 2024SwiftRL: Towards Efficient Reinforcement Learning on Real Processing-In-Memory Systems7 May 2024
- 2024PIM-Opt: Demystifying Distributed Optimization Algorithms on a Real-World Processing-In-Memory System10 Apr 2024
- 2024PyGim: An Efficient Graph Neural Network Library for Real Processing-In-Memory Architectures26 Feb 2024