mlsanityData to 7 Oct 2026

BitTP: The Lightweight Trajectory Prediction Model with BitLLM for Edge-Devices

arXiv 2605.29705 ↗First posted 28 May 2026cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Trajectory prediction is a fundamental task for autonomous systems, requiring complex reasoning about multi-agent interactions and intents. Large language models (LLMs) have recently been adopted for this task, as they provide strong contextual reasoning and interpretable, language-based trajectory representations. However, these LLM-based predictors are extremely memory- and compute-intensive, making them difficult to deploy on resource-constrained edge devices such as on-board computers in autonomous robots. To bridge this gap, we propose BitTP, which converts an LLM-based trajectory predictor into a lightweight bitlinear architecture. We demonstrate that weight-only quantization to 1.58-bit (BitTP-Weight) is optimal. Crucially, activations must remain in full precision, as quantizing them leads to severe degradation and instability in spatio-temporal reasoning. Empirically, BitTP-Weight not only preserves but improves prediction quality over the full-precision (BF16) LLM baseline, reducing ADE by 14.29% and FDE by 20.97% on average, while simultaneously reducing memory usage and inference latency relative to other quantization methods. These results demonstrate that carefully designed quantization acts as an effective regularizer, enabling the practical deployment of sophisticated LLM-based reasoning on edge devices. Code is available at: https://github.com/MintCat98/BitTP.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 38 of its 52 references that are in the map. First posted on arXiv 28 May 2026.

Builds on

38 of 52 references.

References · 38

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2020Language Models are Few-Shot Learnerscited by 32,199
  3. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  4. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
  5. 2015Distilling the Knowledge in a Neural Networkcited by 10,076
  6. 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,485
  7. 2019DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lightercited by 4,243
  8. 2019ALBERT: A Lite BERT for Self-supervised Learning of Language Representationscited by 2,772
  9. 2018The Lottery Ticket Hypothesis: Finding Sparse, Trainable Neural Networkscited by 2,250
  10. 2022GPTQ: Accurate Post-Training Quantization for Generative Pre-trained Transformerscited by 1,838
  11. 2022LLM.int8(): 8-bit Matrix Multiplication for Transformers at Scalecited by 881
  12. 2016XNOR-Net: ImageNet Classification Using Binary Convolutional Neural Networkscited by 829
26 more
  1. 2019Argoverse: 3D Tracking and Forecasting with Rich Mapscited by 728
  2. 2018Social GAN: Socially Acceptable Trajectories with Generative Adversarial Networkscited by 687
  3. 2021Large Scale Interactive Motion Forecasting for Autonomous Driving : The Waymo Open Motion Datasetcited by 532
  4. 2020VectorNet: Encoding HD Maps and Agent Dynamics from Vectorized Representationcited by 528
  5. 2023DriveLM: Driving with Graph Visual Question Answeringcited by 527
  6. 2021NuPlan: A closed-loop ML-based planning benchmark for autonomous vehiclescited by 485
  7. 2019MultiPath: Multiple Probabilistic Anchor Trajectory Hypotheses for Behavior Predictioncited by 417
  8. 20218-bit Optimizers via Block-wise Quantizationcited by 395
  9. 2020Learning Lane Graph Representations for Motion Forecastingcited by 380
  10. 2020TNT: Target-driveN Trajectory Predictioncited by 345
  11. 2021AgentFormer: Agent-Aware Transformers for Socio-Temporal Multi-Agent Forecastingcited by 327
  12. 2020Social-STGCNN: A Social Spatio-Temporal Graph Convolutional Neural Network for Human Trajectory Predictioncited by 324
  13. 2017DESIRE: Distant Future Prediction in Dynamic Scenes with Interacting Agentscited by 310
  14. 2022The case for 4-bit precision: k-bit Inference Scaling Lawscited by 247
  15. 2020One Thousand and One Hours: Self-driving Motion Prediction Datasetcited by 239
  16. 2020It Is Not the Journey but the Destination: Endpoint Conditioned Trajectory Predictioncited by 235
  17. 2019Social-BiGAT: Multimodal Trajectory Forecasting using Bicycle-GAN and Graph Attention Networkscited by 228
  18. 2022Stochastic Trajectory Prediction via Motion Indeterminacy Diffusioncited by 184
  19. 2020From Goals, Waypoints & Paths To Long Term Human Trajectory Forecastingcited by 166
  20. 2021Scene Transformer: A unified architecture for predicting multiple agent trajectoriescited by 165
  21. 2021IntentNet: Learning to Predict Intention from Raw Sensor Datacited by 158
  22. 2022SocialVAE: Human Trajectory Prediction using Timewise Latentscited by 65
  23. 2021Spatio-Temporal Graph Dual-Attention Network for Multi-Agent Prediction and Trackingcited by 35
  24. 2024Can Language Beat Numerical Regression? Language-Based Multimodal Trajectory Predictioncited by 31
  25. 2025Uni4D-LLM: A Unified SpatioTemporal-Aware VLM for 4D Understanding and Generationcited by 10
  26. 2025Spectra 1.1: Scaling Laws and Efficient Inference for Ternary Language Modelscited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Trajectory Prediction Meets Large Language Models: A Survey
  2. 2026AutoTraces: Autoregressive Trajectory Forecasting via Multimodal Large Language Models
  3. 2026EdgeVLN: Runtime-Aware Deployment Ready Quantized Vision Language Navigation Model
  4. 2023GG-LLM: Geometrically Grounding Large Language Models for Zero-shot Human Activity Forecasting in Human-Aware Task Planning
  5. 2026Spatial Strategies, Not Actions: Vector-Quantized Geodesics as Tools for LLM-Driven Agents
  6. 2026Xiaomi OneVL: One-Step Latent Reasoning and Planning with Vision-Language Explanation
  7. 2024Q-S5: Towards Quantized State Space Models
  8. 2025LLaViDA: A Large Language Vision Driving Assistant for Explicit Reasoning and Enhanced Trajectory Planning