Task-Aware Scanning Parameter Configuration for Robotic Inspection Using Vision Language Embeddings and Hyperdimensional Computing
Not on the map. Why?
Abstract (arXiv)
Robotic laser profiling is widely used for dimensional verification and surface inspection, yet measurement fidelity is often dominated by sensor configuration rather than robot motion. Industrial profilers expose multiple coupled parameters, including sampling frequency, measurement range, exposure time, receiver dynamic range, and illumination, that are still tuned by trial-and-error; mismatches can cause saturation, clipping, or missing returns that cannot be recovered downstream. We formulate instruction-conditioned sensing parameter recommendation; given a pre-scan RGB observation and a natural-language inspection instruction, infer a discrete configuration over key parameters of a robot-mounted profiler. To benchmark this problem, we develop Instruct-Obs2Param, a real-world multimodal dataset linking inspection intents and multi-view pose and illumination variation across 16 objects to canonical parameter regimes. We then propose ScanHD, a hyperdimensional computing framework that binds instruction and observation into a task-aware code and performs parameter-wise associative reasoning with compact memories, matching discrete scanner regimes while yielding stable, interpretable, low-latency decisions. On Instruct-Obs2Param, ScanHD achieves 92.7% average exact accuracy and 98.1% average Win@1 accuracy across the five parameters, with strong cross-split generalization and low-latency inference suitable for deployment, outperforming rule-based heuristics, conventional multimodal models, and multimodal large language models. This work enables autonomous, instruction-conditioned sensing configuration from task intent and scene context, eliminating manual tuning and elevating sensor configuration from a static setting to an adaptive decision variable.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 9 of its 43 references that are in the map. First posted on arXiv 5 May 2026.
Builds on
9 of 43 references.
References · 9
- 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,410
- 2021CALVIN: A Benchmark for Language-Conditioned Policy Learning for Long-Horizon Robot Manipulation Taskscited by 584
- 2024VLM Agents Generate Their Own Memories: Distilling Experience into Embodied Programs of Thoughtcited by 55
- 2025Reflective Planning: Vision-Language Models for Multi-Stage Long-Horizon Robotic Manipulationcited by 42
- 2025Can Multimodal Large Language Models be Guided to Improve Industrial Anomaly Detection?cited by 17
- 2023PSO-Based Optimal Coverage Path Planning for Surface Defect Inspection of 3C Components with a Robotic Line Scannercited by 4
- 2022Coverage Path Planning for Robotic Quality Inspection with Control on Measurement Uncertaintycited by 3
- 2025Multimodal RAG-driven Anomaly Detection and Classification in Laser Powder Bed Fusion using Large Language Modelscited by 3
- 2023Active perception network for non-myopic online exploration and visual surface coveragecited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026Task-Specified Active Metrological Inspection with Measurement-Steered VLA Manipulation and Deterministic Evidence Gating
- 2025Sight Over Site: Perception-Aware Reinforcement Learning for Efficient Robotic Inspection
- 2025InspectVLM: Unified in Theory, Unreliable in Practice
- 2024SEEK: Semantic Reasoning for Object Goal Navigation in Real World Inspection Tasks
- 2024Reinforcement Learning Approach to Optimizing Profilometric Sensor Trajectories for Surface Inspection
- 20253D-Grounded Vision-Language Framework for Robotic Task Planning: Automated Prompt Synthesis and Supervised Reasoning
- 2025SNOW: Spatio-Temporal Scene Understanding with World Knowledge for Open-World Embodied Reasoning
- 2026FORGE: Fine-grained Multimodal Evaluation for Manufacturing Scenarios