Enabling Cloud-Level Accuracy in Edge AI through IoT Data Preprocessing
Not on the map. Why?
Abstract (arXiv)
Large language models (LLMs) offer a natural-language interface for interpreting Internet of Things (IoT) sensor data in smart environments; however, cloud deployment introduces latency, privacy, and connectivity concerns. Local LLMs can reduce these limitations, but compact edge-deployable models often show weaker numerical reasoning when raw sensor readings are provided directly. This paper investigates whether prompt-side preprocessing can improve the accuracy-latency trade-off of local LLMs for environmental monitoring. We propose a structured prompt construction framework that transforms raw air-quality and thermal-comfort measurements into progressively enriched textual representations: raw sensor values, threshold-aware descriptions, and compact environmental summary flags. The approach is evaluated using indoor Raspberry Pi/BME680 datasets from Tampere University and outdoor air-quality datasets from Helsinki, Katowice, and Warsaw. We construct a binary LLM query dataset covering air quality, thermal comfort, and joint environmental conditions, and evaluate five local and five cloud LLMs across three prompt variants and two inference modes, with and without chain-of-thought prompting. Results show that prompt enrichment substantially improves local-model accuracy. In No-CoT mode, local accuracy increases from 50.9% to 81.7% indoors and from 63.7% to 89.3% outdoors from the raw to the most enriched prompt. Local No-CoT inference is the fastest configuration, with mean latency close to 0.22 s, while CoT substantially increases inference time. These findings suggest that lightweight prompt-side preprocessing can narrow the local--cloud performance gap and support low-latency IoT analytics in smart environments.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 31 of its 64 references that are in the map. First posted on arXiv 21 Jun 2026.
Builds on
31 of 64 references.
References · 31
- 2022Training language models to follow instructions with human feedbackcited by 15,971
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
- 2020Scaling Laws for Neural Language Modelscited by 6,586
- 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,708
- 2022Training Compute-Optimal Large Language Modelscited by 3,019
- 2021Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processingcited by 2,234
- 2023Language Models Don't Always Say What They Think: Unfaithful Explanations in Chain-of-Thought Promptingcited by 1,122
- 2024TinyLlama: An Open-Source Small Language Modelcited by 618
- 2024Mobile Edge Intelligence for Large Language Models: A Contemporary Surveycited by 128
- 2024Mind Your Step (by Step): Chain-of-Thought can Reduce Performance on Tasks where Thinking Makes Humans Worsecited by 109
- 2024PowerInfer-2: Fast Large Language Model Inference on a Smartphonecited by 103
19 more
- 2023Penetrative AI: Making LLMs Comprehend the Physical Worldcited by 64
- 2023Large Language Models Empowered Autonomous Edge AI for Connected Intelligencecited by 56
- 2024SensorLLM: Aligning Large Language Models with Motion Sensors for Human Activity Recognitioncited by 38
- 2025Right Answer, Wrong Score: Uncovering the Inconsistencies of LLM Evaluation in Multiple-Choice Question Answeringcited by 28
- 2018SOSA: A Lightweight Ontology for Sensors, Observations, Samples, and Actuatorscited by 27
- 2024CE-CoLLM: Efficient and Adaptive Large Language Models Through Cloud-Edge Collaborationcited by 25
- 2023LLMind: Orchestrating AI and IoT with LLM for Complex Task Executioncited by 24
- 2024IoT-LLM: a framework for enhancing Large Language Model reasoning from real-world sensor datacited by 18
- 2024A Survey of Sustainability in Large Language Models: Applications, Economics, and Challengescited by 18
- 2024IoT-LM: Large Multisensory Language Models for the Internet of Thingscited by 14
- 2024Adaptive Layer Splitting for Wireless LLM Inference in Edge Computing: A Model-Based Reinforcement Learning Approachcited by 12
- 2024SplitLLM: Collaborative Inference of LLMs for Model Placement and Throughput Optimizationcited by 11
- 2025Beyond Text Compression: Evaluating Tokenizers Across Scalescited by 11
- 2023"Get ready for a party": Exploring smarter smart spaces with help from large language modelscited by 10
- 2025Instructor-Worker Large Language Model System for Policy Recommendation: a Case Study on Air Quality Analysis of the January 2025 Los Angeles Wildfirescited by 6
- 2024Follow-Me AI: Energy-Efficient User Interaction with Smart Environmentscited by 4
- 2024VayuBuddy: an LLM-Powered Chatbot to Democratize Air Quality Insightscited by 4
- 2024Through the Thicket: A Study of Number-Oriented LLMs derived from Random Forest Modelscited by 2
- 2024Creation of AI-driven Smart Spaces for Enhanced Indoor Environments -- A Surveycited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Talk with the Things: Integrating LLMs into IoT Networks ↗
- 2024When IoT Meet LLMs: Applications and Challenges
- 2024LLMSense: Harnessing LLMs for High-level Reasoning Over Spatiotemporal Sensor Traces
- 2025Large Language Models in the IoT Ecosystem -- A Survey on Security Challenges and Applications
- 2026SCENIC: Semantic-Conditioned Edge-Aware Neural Framework for Structured IoT Command Generation
- 2025IoT-MCP: Bridging LLMs and IoT Systems Through Model Context Protocol
- 2025CoSense-LLM: Semantics at the Edge with Cost- and Uncertainty-Aware Cloud-Edge Cooperation
- 2025Sustainable LLM Inference for Edge AI: Evaluating Quantized LLMs for Energy Efficiency, Output Accuracy, and Inference Latency