mlsanityData to 14 Oct 2026

Independent Samples, Correlated Variance A Learnable Cross-View Cue in Path-Traced Stereo Data

arXiv 2606.25483 ↗First posted 24 Jun 2026cs.CV cs.GRcited by 0

Not on the map. Why?

Abstract (arXiv)

Path-traced synthetic stereo is a primary training substrate for disparity networks, and the pipelines that consume it assume Monte~Carlo (MC) rendering noise is independent across the two views. The assumption is correct at the level it is stated---individual samples---but silent about the object a network actually sees. We show that the per-pixel MC variance fields, though built from independent samples, are strongly correlated once aligned by the ground-truth disparity, and that a network can learn to match with that correlation. Across 20 indoor scenes the warped correlation is 0.754±0.016 against 0.360 unwarped; it replicates on a second renderer with a different sampler and sample budget (0.743±0.044), and a seed-count analysis puts the population value near 0.85, making the measurement a lower bound. The effect is field-level, not sample-level: at the warp correspondence the signed per-seed residual correlation is -0.0004 while the residual envelope correlates at 0.38. A capacity-limited siamese probe given nothing but variance-field patches reaches 78.8% two-alternative forced-choice accuracy on held-out scenes and falls to chance once the alignment is destroyed; under the ordinary single-render condition, decorrelation still costs 2.40 percentage points in a difference-in-differences design, positive in all six held-out scenes. A real sensor's variance is fixed by its own signal rather than by transport difficulty, so across views it is redundant with intensity: the cue is specific to rendered data.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 10 of its 20 references that are in the map. First posted on arXiv 24 Jun 2026.

Builds on

10 of 20 references.

References · 10

  1. 2020Shortcut Learning in Deep Neural Networkscited by 1,969
  2. 2015A Large Dataset to Train Convolutional Networks for Disparity, Optical Flow, and Scene Flow Estimationcited by 881
  3. 2020Hypersim: A Photorealistic Synthetic Dataset for Holistic Indoor Scene Understandingcited by 604
  4. 2018Pyramid Stereo Matching Networkcited by 489
  5. 2021RAFT-Stereo: Multilevel Recurrent Field Transforms for Stereo Matchingcited by 353
  6. 2023Iterative Geometry Encoding Volume for Stereo Matchingcited by 190
  7. 2023Spring: A High-Resolution High-Detail Dataset and Benchmark for Scene Flow, Optical Flow and Stereocited by 172
  8. 2023Infinite Photorealistic Worlds using Procedural Generationcited by 147
  9. 2025What Makes Good Synthetic Training Data for Zero-Shot Stereo Matching?cited by 7
  10. 2021Achieving Domain Robustness in Stereo Matching Networks by Removing Shortcut Learningcited by 1

Built on by

Not cited yet.