QEIL v2: Heterogeneous Computing for Edge Intelligence via Roofline-Derived Pareto-Optimal Energy Modeling and Multi-Objective Orchestration
Not on the map. Why?
Abstract (arXiv)
Deploying large language models (LLMs) on heterogeneous edge devices demands frameworks that jointly optimize energy efficiency, inference quality, and reliability. Our prior QEIL v1 (Kumar & Jha, 2026) achieved 4.82x IPW improvement but relied on static efficiency factors, greedy optimization, and unverified candidate selection. QEIL v2 replaces every static heuristic with physics-grounded, runtime-adaptive models. We introduce three device-workload metrics: DASI (roofline-derived compute utilization), CPQ (memory pressure from allocation theory), and Phi (thermal yield from CMOS leakage physics), forming a unified energy equation with every coefficient traceable to semiconductor physics. For optimization, PGSAM (Pareto-Guided Simulated Annealing with Momentum) simultaneously minimizes energy, latency, and device underutilization. At inference time, the EAC/ARDE selection cascade with CSVET early stopping provides progressive verification among repeated samples. Evaluated on WikiText-103, GSM8K, and ARC-Challenge across seven model families (125M-8B parameters, including one pre-quantized variant), QEIL v2 achieves 75.7% pass@k at 63.8W (IPW=0.9749), a 2.86x improvement over standard inference. When applied to a 4-bit Llama-3.1-8B, QEIL v2's physics-grounded routing achieves IPW=1.024 at 54.8W -- the first edge orchestration system to surpass the IPW=1.0 empirical reference mark, with the gain attributable entirely to QEIL v2's workload-adaptive device allocation on a model with reduced memory bandwidth requirements. Total energy drops 75.6% vs. standard with 38.3% latency reduction, zero thermal throttling, and 100% fault recovery across all benchmarks and model families.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 5 of its 22 references that are in the map. First posted on arXiv 23 Jan 2026.
Builds on
5 of 22 references.
References · 5
- 2022Training Compute-Optimal Large Language Modelscited by 3,019
- 2024Large Language Monkeys: Scaling Inference Compute with Repeated Samplingcited by 991
- 2024The Larger the Better? Improved LLM Code-Generation via Budget Reallocationcited by 43
- 2025Intelligence per Watt: Measuring Intelligence Efficiency of Local AIcited by 14
- 2025Efficient and Scalable Agentic AI with Heterogeneous Systemscited by 11
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026TOM: A Ternary Read-only Memory Accelerator for LLM-powered Edge Intelligence
- 2025Hardware-Algorithm Co-Optimization of Early-Exit Neural Networks for Multi-Core Edge Accelerators
- 2025Energy-Efficient Edge Inference in Integrated Sensing, Communication, and Computation Networks
- 2026Agentic Design Space Exploration for Joint Hardware Configuration Selection and Mapping of AI Inference Workloads on Heterogeneous Edge SoCs
- 2026PALUTE: Processing-In-Memory Acceleration via Lookup Table for Edge LLM Inference
- 2026Seeing at the Edge: Energy Characterization of Vision-Language Model Inference on Edge Platforms
- 2025A Systematic Evaluation of On-Device LLMs: Quantization, Performance, and Resources
- 2026ZipMoE: Efficient On-Device MoE Serving via Lossless Compression and Cache-Affinity Scheduling