mlsanityData to 7 Oct 2026

MUSE: Unlocking Timestep as Native Task Steering for One-Step Dense Prediction

arXiv 2606.30370 ↗First posted 29 Jun 2026cs.CVcited by 0

On the map: Diffusion models → Diffusion foundations and sampling

Abstract (arXiv)

Monocular dense prediction has recently seen remarkable success by repurposing pre-trained diffusion models. This opens a promising yet challenging avenue for more efficient multi-task learning paradigm. However, existing multi-task diffusion methods often introduce parameter-heavy adapters, experts, or learnable task tokens, leading to computational redundancy. In this paper, we reveal an inherent mechanism within one-step diffusion models: the native, fixed sinusoidal timestep embedding can be repurposed as an endogenous task steering signal. Based on this discovery, we propose Multi-task Unified eStimation via timestep Embedding (MUSE), a parameter-free, single-model multi-tasking approach for dense prediction. We interpret this mechanism via Manifold Decoupling, where discrete, fixed timestep values deterministically steer the generation process towards decoupled, task-specific manifolds in the latent space. Extensive experiments across 10 datasets demonstrate that MUSE achieves highly competitive performance on both monocular depth and normal estimation, and its efficacy generalizes across U-Net and DiT architectures. Our work offers a concise and efficient path toward generalist vision models by simply unlocking the latent potential of existing generation infrastructure.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Diffusion foundations and sampling, one of 14 directions in Diffusion models. Builds on 43 of its 56 references that are in the map. First posted on arXiv 29 Jun 2026.

Builds on

43 of 56 references.

Closest ancestors · 16

Same direction, newest first

  1. 2025The Principles of Diffusion Models24 Oct
  2. 2025Marigold: Affordable Adaptation of Diffusion-Based Image Generators for Image Analysis14 May
  3. 2024One Step Diffusion via Shortcut Models16 Oct
  4. 2024Decouple-Then-Merge: Finetune Diffusion Models as Multi-Task Learning9 Oct
  5. 2024Lotus: Diffusion-based Visual Foundation Model for High-quality Dense Prediction26 Sep
  6. 2024DiffusionMTL: Learning Multi-Task Denoising Diffusion Model from Partially Annotated Data22 Mar
  7. 2024Switch Diffusion Transformer: Synergizing Denoising Tasks with Sparse Mixture-of-Experts14 Mar
  8. 2023Exploiting Diffusion Prior for Generalizable Dense Prediction30 Nov
  9. 2023Manifold Preserving Guided Diffusion28 Nov
  10. 2023Addressing Negative Transfer in Diffusion Models1 Jun
  11. 2023Efficient Diffusion Training via Min-SNR Weighting Strategy16 Mar
  12. 2022Your diffusion model secretly knows the dimension of the data manifold23 Dec
4 more
  1. 2022Scalable Diffusion Models with Transformers19 Dec
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Models20 Dec
  3. 2020Denoising Diffusion Implicit Models6 Oct
  4. 2020Denoising Diffusion Probabilistic Models19 Jun

Other references · 27

  1. 2014Microsoft COCO: Common Objects in Contextcited by 17,498
  2. 2022Flow Matching for Generative Modelingcited by 5,426
  3. 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,131
  4. 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,088
  5. 2023Wonder3D: Single Image to 3D using Cross-Domain Diffusioncited by 682
  6. 2020Hypersim: A Photorealistic Synthetic Dataset for Holistic Indoor Scene Understandingcited by 593
  7. 2025Mean Flows for One-step Generative Modelingcited by 524
  8. 2022Improving Diffusion Models for Inverse Problems using Manifold Constraintscited by 501
  9. 2020Multi-Task Learning with Deep Neural Networks: A Surveycited by 374
  10. 2024GeoWizard: Unleashing the Diffusion Priors for 3D Geometry Estimation from a Single Imagecited by 283
  11. 2019DIODE: A Dense Indoor and Outdoor DEpth Datasetcited by 236
  12. 2023DDP: Diffusion Model for Dense Visual Predictioncited by 148
15 more
  1. 2018Evaluation of CNN-based Single-Image Depth Estimation Methodscited by 137
  2. 2023Monocular Depth Estimation using Diffusion Modelscited by 87
  3. 2021RotoGrad: Gradient Homogenization in Multitask Learningcited by 82
  4. 2023DiffusionDepth: Diffusion Denoising Approach for Monocular Depth Estimationcited by 81
  5. 2024What Matters When Repurposing Diffusion Models for General Dense Perception Tasks?cited by 74
  6. 2023Manifold learning: what, how, and whycited by 66
  7. 2020OASIS: A Large-Scale Dataset for Single Image 3D in the Wildcited by 62
  8. 2025DICEPTION: A Generalist Diffusion Model for Visual Perceptual Taskscited by 37
  9. 2025Jasmine: Harnessing Diffusion Prior for Self-supervised Depth Estimationcited by 20
  10. 2025DepthMaster: Taming Diffusion Models for Monocular Depth Estimationcited by 18
  11. 2025Orchid: Image Latent Diffusion for Joint Appearance and Geometry Generationcited by 17
  12. 2025Lotus-2: Advancing Geometric Dense Prediction with Powerful Image Generative Modelcited by 16
  13. 2025Modular MeanFlow: Towards Stable and Scalable One-Step Generative Modelingcited by 8
  14. 2025Staying on the Manifold: Geometry-Aware Noise Injectioncited by 4
  15. 2025Steering One-Step Diffusion Model with Fidelity-Rich Decoder for Fast Image Compressioncited by 3

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Task-oriented Learnable Diffusion Timesteps for Universal Few-shot Learning of Dense Tasks
  2. 2025Rethinking Timesteps Samplers and Prediction Types
  3. 2025StableMTL: Repurposing Latent Diffusion Models for Multi-Task Learning from Partially Annotated Synthetic Datasets
  4. 2026B3-Net: Controlled Posterior Bridge Learning for Multi-Task Dense Prediction
  5. 2024Adaptive Non-uniform Timestep Sampling for Accelerating Diffusion Model Training
  6. 2025D3-Predictor: Noise-Free Deterministic Diffusion for Dense Prediction
  7. 2025StateSpaceDiffuser: Bringing Long Context to Diffusion World Models
  8. 2025Parameter Aware Mamba Model for Multi-task Dense Prediction