mlsanityData to 7 Oct 2026

Atomizer-IO: Beyond Pixels, Patches and Grids

arXiv 2609.40320 ↗First posted 30 Sep 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Most vision architectures assume that observations lie on a regular grid, an effective abstraction for natural images but a restrictive one for sensing data whose channels, temporal sampling, spatial resolution, and geometry can vary. Generic set-based architectures remove the grid, but also remove useful spatial inductive biases. We introduce Atomizer-IO, an architecture that places observations first and derives structure from their physical relationships. Building on top of an atomic representation of the data, each observation is described by its measurement and acquisition metadata, while local cross-attention maps observations to anchor points that can be arbitrarily placed. We evaluate this design by progressively relaxing the grid assumption, from varying input raster configurations and incomplete channel sets to flexible output density and, ultimately, inputs without a raster grid. Atomizer-IO is competitive with flexible EO-specific architectures on most tasks, while offering post-training control over inference cost and competitive compute--performance trade-offs. The same formulation extends without architectural redesign to unordered 3D point clouds, showing that the atomic interface generalizes beyond regular raster inputs. These results suggest that pixels, patches, and grids do not need to define the interface of a sensing architecture.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 38 of its 49 references that are in the map. First posted on arXiv 30 Sep 2026.

Builds on

38 of 49 references.

References · 38

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  3. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  4. 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,223
  5. 2017PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Spacecited by 4,384
  6. 2017EuroSAT: A Novel Dataset and Deep Learning Benchmark for Land Use and Land Cover Classificationcited by 1,488
  7. 2018Unified Perceptual Parsing for Scene Understandingcited by 1,265
  8. 2019KPConv: Flexible and Deformable Convolution for Point Cloudscited by 1,202
  9. 2021Perceiver: General Perception with Iterative Attentioncited by 1,089
  10. 2023Vision Transformers Need Registerscited by 844
  11. 2018PointCNN: Convolution On X-Transformed Pointscited by 764
  12. 2021Perceiver IO: A General Architecture for Structured Inputs & Outputscited by 616
26 more
  1. 2019RandLA-Net: Efficient Semantic Segmentation of Large-Scale Point Cloudscited by 584
  2. 2019Deep Learning for 3D Point Clouds: A Surveycited by 557
  3. 2017Large-scale Point Cloud Semantic Segmentation with Superpoint Graphscited by 384
  4. 2022Scale-MAE: A Scale-Aware Masked Autoencoder for Multiscale Geospatial Representation Learningcited by 302
  5. 2024Rotary Position Embedding for Vision Transformercited by 226
  6. 2023Foundation Models for Generalist Geospatial Artificial Intelligencecited by 143
  7. 2021Panoptic Segmentation of Satellite Image Time Series with Convolutional Temporal Attention Networkscited by 141
  8. 2024Prithvi-EO-2.0: A Versatile Multi-Temporal Foundation Model for Earth Observation Applicationscited by 139
  9. 2019xBD: A Dataset for Assessing Building Damage from Satellite Imagerycited by 138
  10. 2019ShellNet: Efficient Point Cloud Convolutional Neural Networks using Concentric Shells Statisticscited by 104
  11. 2023Lightweight, Pre-trained Transformers for Remote Sensing Timeseriescited by 102
  12. 2025TerraMind: Large-Scale Generative Multimodality for Earth Observationcited by 101
  13. 2024Neural Plasticity-Inspired Multimodal Foundation Model for Earth Observationcited by 97
  14. 2020DALES: A Large-scale Aerial LiDAR Data Set for Semantic Segmentationcited by 65
  15. 2019ConvPoint: Continuous Convolutions for Point Cloud Processingcited by 62
  16. 2024PANGAEA: A Global and Inclusive Benchmark for Geospatial Foundation Modelscited by 62
  17. 2023Efficient 3D Semantic Segmentation with Superpoint Transformercited by 56
  18. 2020Lightweight Temporal Self-Attention for Classifying Satellite Image Time Seriescited by 55
  19. 2025Panopticon: Advancing Any-Sensor Foundation Models for Earth Observationcited by 34
  20. 2020ForestNet: Classifying Drivers of Deforestation in Indonesia using Deep Learning on Satellite Imagerycited by 27
  21. 2025FlexiMo: A Flexible Remote Sensing Foundation Modelcited by 24
  22. 2024SenPa-MAE: Sensor Parameter Aware Masked Autoencoder for Multi-Satellite Self-Supervised Pretrainingcited by 18
  23. 2024FRACTAL: An Ultra-Large-Scale Aerial Lidar Dataset for 3D Semantic Segmentation of Diverse Landscapescited by 11
  24. 2025SMARTIES: Spectrum-Aware Multi-Sensor Auto-Encoder for Remote Sensing Imagescited by 9
  25. 2025RAMEN: Resolution-Adjustable Multimodal Encoder for Earth Observationcited by 4
  26. 2026UniverSat: Resolution- and Modality-Agnostic Transformers for Earth Observationcited by 4

Built on by

Not cited yet.