mlsanityData to 14 Oct 2026

What Will This Copper Look Like Later? Forecasting Surface Appearance and Rendering It as a PBR Material

arXiv 2608.28102 ↗First posted 28 Aug 2026cs.GR cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Digital design requires predicting how a metal surface will look later in its oxidation; this paper presents such a pipeline for copper. Given a fixed-camera observation, the system forecasts appearance 10 accelerated units ahead and converts it into the albedo, normal, roughness and metallic maps a renderer consumes. Forecasting is evaluated as an authoring tool would use it, on a copper specimen the system has not observed: an entire recording is held out, so training and checkpoint selection use one specimen and the test set is the whole of a second, recorded on a different day and condition. Under this protocol a learned spatio-temporal model with a monotone oxidation state, the most accurate forecaster within a single recording, is less accurate than copying the last observed frame on an unseen specimen, in both directions, as are three further trained architectures. The only forecaster that transfers is a closed-form global color extrapolation with no trained parameters, improving on copy-last-frame by 13.4% and 50.6%, with a margin that increases with horizon to +16.7% and +55.5% at t+10. Two controls qualify this: correcting every frame for the photometric drift measured on a non-oxidizing reference region leaves both margins intact, ruling out uncontrolled exposure as their source, and a moving-block bootstrap over the 6 independent windows each recording contains separates the larger margin from zero but leaves the smaller one not individually significant. The mechanism is measured: a learned susceptibility map encodes where corrosion begins on the training specimen and misleads on a new one, whereas the global color trajectory is what specimens share. The pipeline therefore deploys the closed-form forecaster for unseen specimens and the learned model only for continuing one already observed. Code, splits, protocol and leakage audit are released.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 13 of its 32 references that are in the map. First posted on arXiv 28 Aug 2026.

Builds on

13 of 32 references.

References · 13

  1. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
  2. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
  3. 2020Fourier Neural Operator for Parametric Partial Differential Equationscited by 2,908
  4. 2017FiLM: Visual Reasoning with a General Conditioning Layercited by 2,333
  5. 2015Convolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcastingcited by 1,436
  6. 2017PDE-Net: Learning PDEs from Datacited by 311
  7. 2020Disentangling Physical Dynamics from Unknown Factors for Unsupervised Video Predictioncited by 195
  8. 2022SimVP: Simpler yet Better Video Predictioncited by 184
  9. 2022Earthformer: Exploring Space-Time Transformers for Earth System Forecastingcited by 152
  10. 2022Temporal Attention Unit: Towards Efficient Spatiotemporal Predictive Learningcited by 86
  11. 2023A Dynamic Multi-Scale Voxel Flow Network for Video Predictioncited by 53
  12. 2023SwinLSTM:Improving Spatiotemporal Prediction Accuracy using Swin Transformer and LSTMcited by 32
1 more
  1. 2022SimVPv2: Towards Simple yet Powerful Spatiotemporal Predictive Learningcited by 22

Built on by

Not cited yet.