mlsanityData to 14 Oct 2026

RoboShape: Information-Theoretic Point Cloud Representations for Privacy-Aware Robot Perception

arXiv 2608.21380 ↗First posted 16 Jul 2026cs.RO cs.AI cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

With the increased adoption of robotic agents operating in human environments by scanning and sharing 3D representations (e.g., for fleet learning, cloud-based planning, or collaborative mapping), collected point clouds reveal not just the objects in a scene but also sensitive spatial context, such as room function or information that occupants never consented to disclose. Traditional point cloud encoders offer no principled control over this: either all is preserved, or none. Hence, we introduce RoboShape, an information theory guided compression head following the frozen tt Sonata encoder. We project voxel-level embeddings using the Donsker-Varadhan formulation of mutual information (MI). Specifically, we maximize the MI between embeddings and object-level understanding while minimizing it for private attributes. RoboShape leads to 87.5% smaller embeddings that retain 98.7% of object classification utility while collapsing sensitive attribute predictions by 39.3% across the three real-world indoor LiDAR datasets. Its privacy-preserving embeddings are cheaper to transmit over the network or to train a model for any downstream tasks. We release the RoboShape codebase to give the robotics community a practical, encoder-agnostic tool for building perception pipelines that are compact, privacy-aware, and deployment-ready.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 23 of its 32 references that are in the map. First posted on arXiv 16 Jul 2026.

Builds on

23 of 32 references.

References · 23

  1. 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,248
  2. 2017PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Spacecited by 4,401
  3. 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,117
  4. 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 3,080
  5. 2020Point Transformercited by 1,470
  6. 2017Matterport3D: Learning from RGB-D Data in Indoor Environmentscited by 1,376
  7. 20194D Spatio-Temporal ConvNets: Minkowski Convolutional Neural Networkscited by 1,208
  8. 2021Isaac Gym: High Performance GPU-Based Physics Simulation For Robot Learningcited by 998
  9. 2018MINE: Mutual Information Neural Estimationcited by 683
  10. 2019Deep Learning for 3D Point Clouds: A Surveycited by 558
  11. 2022Masked Autoencoders for Point Cloud Self-supervised Learningcited by 459
  12. 2021ARKitScenes: A Diverse Real-World Dataset For 3D Indoor Scene Understanding Using Mobile RGB-D Datacited by 454
11 more
  1. 2020Object Goal Navigation using Goal-Oriented Semantic Explorationcited by 429
  2. 2020Transporter Networks: Rearranging the Visual World for Robotic Manipulationcited by 344
  3. 2015Censoring Representations with an Adversarycited by 192
  4. 2019Understanding the Limitations of Variational Mutual Information Estimatorscited by 140
  5. 2020FedVision: An Online Visual Object Detection Platform Powered by Federated Learningcited by 124
  6. 2025Sonata: Self-Supervised Learning of Reliable Point Representationscited by 110
  7. 2019Revealing Scenes by Inverting Structure from Motion Reconstructionscited by 66
  8. 2022Unsupervised Point Cloud Representation Learning with Deep Neural Networks: A Surveycited by 54
  9. 2021NeuraCrypt: Hiding Private Health Data via Random Neural Networks for Public Trainingcited by 11
  10. 2024TexShape: Information Theoretic Sentence Embedding for Language Modelscited by 10
  11. 2025WavShape: Information-Theoretic Speech Representation Learning for Fair and Privacy-Aware Audio Processingcited by 2

Built on by

Not cited yet.