mlsanityData to 14 Oct 2026

CATRF: Codec-Adaptive TriPlane Radiance Fields for Volumetric Content Delivery

arXiv 2605.18054 ↗First posted 18 May 2026eess.IV cs.CV cs.MMcited by 0

Not on the map. Why?

Abstract (arXiv)

Volumetric media promises next-generation content delivery applications, but its bandwidth demand remains a key bottleneck. Implicit and hybrid volumetric representations reduce model sizes, yet still require careful coding to reach 2D video-like bitrates. We present CATRF, a standard-codec-in-the-loop compression framework for plane-factorized radiance fields. During training, we quantize and pack 2D feature planes into codec-friendly canvases, run a standard codec roundtrip (JPEG/VP9/HEVC/AV1), then unpack and dequantize the decoded features before volume rendering. We use a straight-through estimator (STE) to insert the non-differentiable, standard codec pipeline into the training loop, allowing radiance-field features to adapt directly to the real, client-side codec distortions without introducing any learned codec parameters. On both static and dynamic benchmarks, CATRF consistently achieves a better rate-distortion trade-off over codec-agnostic and learned-codec-in-the-loop baselines, and also outperforms recent compressed 3DGS methods in both compression efficiency and decoding speed. These results highlight a practical path toward low-bitrate, compression-resilient volumetric representations for free-viewpoint video streaming.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 45 of its 60 references that are in the map. First posted on arXiv 18 May 2026.

Builds on

45 of 60 references.

References · 45

  1. 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,723
  2. 2013Estimating or Propagating Gradients Through Stochastic Neurons for Conditional Computationcited by 2,079
  3. 2021Plenoxels: Radiance Fields without Neural Networkscited by 1,613
  4. 2022TensoRF: Tensorial Radiance Fieldscited by 1,280
  5. 2021Efficient Geometry-aware 3D Generative Adversarial Networkscited by 1,205
  6. 20234D Gaussian Splatting for Real-Time Dynamic Scene Renderingcited by 1,157
  7. 2021Direct Voxel Grid Optimization: Super-fast Convergence for Radiance Fields Reconstructioncited by 964
  8. 2020Neural Sparse Voxel Fieldscited by 959
  9. 2018Variational image compression with a scale hyperpriorcited by 935
  10. 2023K-Planes: Explicit Radiance Fields in Space, Time, and Appearancecited by 746
  11. 2016End-to-end Optimized Image Compressioncited by 696
  12. 2018ProxylessNAS: Direct Neural Architecture Search on Target Task and Hardwarecited by 673
33 more
  1. 2015BinaryConnect: Training Deep Neural Networks with binary weights during propagationscited by 592
  2. 2023Spacetime Gaussian Feature Splatting for Real-Time Dynamic View Synthesiscited by 344
  3. 20223D Neural Field Generation using Triplane Diffusioncited by 274
  4. 2023Compressed 3D Gaussian Splatting for Accelerated Novel View Synthesiscited by 239
  5. 2024HAC: Hash-grid Assisted Context for 3D Gaussian Splatting Compressioncited by 209
  6. 20233DGen: Triplane Latent Diffusion for Textured Mesh Generationcited by 183
  7. 20243DGStream: On-the-Fly Training of 3D Gaussians for Efficient Streaming of Photo-Realistic Free-Viewpoint Videoscited by 160
  8. 2024Neural Video Compression with Feature Modulationcited by 123
  9. 2022Streaming Radiance Fields for 3D Video Synthesiscited by 119
  10. 2025Towards Practical Real-Time Neural Video Compressioncited by 80
  11. 2025HAC++: Towards 100X Compression of 3D Gaussian Splattingcited by 57
  12. 2023SWinGS: Sliding Windows for Dynamic 3D Gaussian Splattingcited by 46
  13. 2023Instant3D: Instant Text-to-3D Generationcited by 45
  14. 2023Binary Radiance Fieldscited by 40
  15. 2024How Far Can We Compress Instant-NGP-Based NeRF?cited by 30
  16. 2024V^3: Viewing Volumetric Videos on Mobiles via Streamable 2D Dynamic Gaussianscited by 29
  17. 2024QUEEN: QUantized Efficient ENcoding of Dynamic Gaussians for Streaming Free-viewpoint Videoscited by 25
  18. 2025Compression of 3D Gaussian Splatting with Optimized Feature Planes and Standard Video Codecscited by 25
  19. 2025GIFStream: 4D Gaussian-based Immersive Video with Feature Streamcited by 24
  20. 2023VideoRF: Rendering Dynamic Radiance Fields as 2D Feature Video Streamscited by 22
  21. 2023TeTriRF: Temporal Tri-Plane Radiance Fields for Efficient Free-Viewpoint Videocited by 22
  22. 2024NeRFCodec: Neural Feature Compression Meets Neural Radiance Fields for Memory-Efficient Scene Representationcited by 16
  23. 2024VRVVC: Variable-Rate NeRF-Based Volumetric Video Compressioncited by 14
  24. 2024JointRF: End-to-End Joint Optimization for Dynamic Neural Radiance Field Representation and Compressioncited by 13
  25. 2021Differentiable Signal Processing With Black-Box Audio Effectscited by 10
  26. 2023From Capture to Display: A Survey on Volumetric Videocited by 9
  27. 2023ECRF: Entropy-Constrained Neural Radiance Fields Compression with Frequency Domain Optimizationcited by 8
  28. 2024Rate-aware Compression for NeRF-based Volumetric Videocited by 8
  29. 2023Sandwiched Video Compression: Efficiently Extending the Reach of Standard Codecs with Neural Wrapperscited by 6
  30. 2024CodecNeRF: Toward Fast Encoding and Decoding, Compact, and High-quality Novel-view Synthesiscited by 6
  31. 2025Improving the Straight-Through Estimator with Zeroth-Order Informationcited by 5
  32. 2025Efficient Evaluation of Quantization-Effects in Neural Codecscited by 3
  33. 2024Plenoptic PNG: Real-Time Neural Radiance Fields in 150 KBcited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2022Compressing Volumetric Radiance Fields to 1 MB
  2. 2024Content-Aware Radiance Fields: Aligning Model Complexity with Scene Intricacy Through Learned Bitwidth Quantization
  3. 2021KiloNeRF: Speeding up Neural Radiance Fields with Thousands of Tiny MLPs
  4. 2025VistaFlow: Photorealistic Volumetric Reconstruction with Dynamic Resolution Management via Q-Learning
  5. 2024SPC-NeRF: Spatial Predictive Compression for Voxel Based Radiance Field
  6. 2025GoDe: Gaussians on Demand for Progressive Level of Detail and Scalable Compression
  7. 2024Divide and Conquer: Rethinking the Training Paradigm of Neural Radiance Fields
  8. 2026RouteBridge: Reliability-Routed Bidirectional Distillation Between Neural Radiance Fields and 3D Gaussian Splatting