A General-Purpose Device for Interaction with LLMs
Not on the map. Why?
Abstract (arXiv)
This paper investigates integrating large language models (LLMs) with advanced hardware, focusing on developing a general-purpose device designed for enhanced interaction with LLMs. Initially, we analyze the current landscape, where virtual assistants and LLMs are reshaping human-technology interactions, highlighting pivotal advancements and setting the stage for a new era of intelligent hardware. Despite substantial progress in LLM technology, a significant gap exists in hardware development, particularly concerning scalability, efficiency, affordability, and multimodal capabilities. This disparity presents both challenges and opportunities, underscoring the need for hardware that is not only powerful but also versatile and capable of managing the sophisticated demands of modern computation. Our proposed device addresses these needs by emphasizing scalability, multimodal data processing, enhanced user interaction, and privacy considerations, offering a comprehensive platform for LLM integration in various applications.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 6 of its 10 references that are in the map. First posted on arXiv 2 Aug 2024.
Builds on
6 of 10 references.
References · 6
- 2023Efficient Streaming Language Models with Attention Sinkscited by 2,115
- 2024The Era of 1-bit LLMs: All Large Language Models are in 1.58 Bitscited by 289
- 2024MobileLLM: Optimizing Sub-billion Parameter Language Models for On-Device Use Casescited by 216
- 2023EdgeMoE: Empowering Sparse Large Language Models on Mobile Devicescited by 65
- 2024Large Language Models for Forecasting and Anomaly Detection: A Systematic Literature Reviewcited by 50
- 2023LLMind: Orchestrating AI and IoT with LLM for Complex Task Executioncited by 24
Built on by
Citing papers per year: 2024: 1; 2025: 2.
3 papers.