mlsanityData to 7 Oct 2026

AssetFormer: Modular 3D Assets Generation with Autoregressive Transformer

arXiv 2602.12100 ↗First posted 12 Feb 2026cs.CVcited by 1

Not on the map. Why?

Abstract (arXiv)

The digital industry demands high-quality, diverse modular 3D assets, especially for user-generated content~(UGC). In this work, we introduce AssetFormer, an autoregressive Transformer-based model designed to generate modular 3D assets from textual descriptions. Our pilot study leverages real-world modular assets collected from online platforms. AssetFormer tackles the challenge of creating assets composed of primitives that adhere to constrained design parameters for various applications. By innovatively adapting module sequencing and decoding techniques inspired by language models, our approach enhances asset generation quality through autoregressive modeling. Initial results indicate the effectiveness of AssetFormer in streamlining asset creation for professional development and UGC scenarios. This work presents a flexible framework extendable to various types of modular 3D assets, contributing to the broader field of 3D content generation. The code is available at https://github.com/Advocate99/AssetFormer.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 79 of its 96 references that are in the map. First posted on arXiv 12 Feb 2026.

Builds on

79 of 96 references.

References · 79

  1. 2017Attention Is All You Needcited by 59,932
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  3. 2020Language Models are Few-Shot Learnerscited by 32,199
  4. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  5. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  6. 2023GPT-4 Technical Reportcited by 18,132
  7. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
  8. 2023Visual Instruction Tuningcited by 7,792
  9. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
  10. 2022Classifier-Free Diffusion Guidancecited by 5,717
  11. 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,304
  12. 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,581
38 more
  1. 2020Taming Transformers for High-Resolution Image Synthesiscited by 3,229
  2. 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,006
  3. 2022Scaling Instruction-Finetuned Language Modelscited by 2,997
  4. 2019The Curious Case of Neural Text Degenerationcited by 2,881
  5. 2023PaLM-E: An Embodied Multimodal Language Modelcited by 2,037
  6. 2022Make-A-Video: Text-to-Video Generation without Text-Video Datacited by 1,725
  7. 2022Fast Inference from Transformers via Speculative Decodingcited by 1,615
  8. 2018Glow: Generative Flow with Invertible 1x1 Convolutionscited by 1,539
  9. 2022Objaverse: A Universe of Annotated 3D Objectscited by 1,522
  10. 2022Magic3D: High-Resolution Text-to-3D Content Creationcited by 1,285
  11. 2018Hierarchical Neural Story Generationcited by 1,182
  12. 2022MaskGIT: Masked Generative Image Transformercited by 1,082
  13. 2018Learning Implicit Fields for Generative Shape Modelingcited by 1,060
  14. 2023Accelerating Large Language Model Decoding with Speculative Samplingcited by 975
  15. 2022CogVideo: Large-scale Pretraining for Text-to-Video Generation via Transformerscited by 973
  16. 2024Chameleon: Mixed-Modal Early-Fusion Foundation Modelscited by 904
  17. 2023PixArt-α: Fast Training of Diffusion Transformer for Photorealistic Text-to-Image Synthesiscited by 854
  18. 2023DreamGaussian: Generative Gaussian Splatting for Efficient 3D Content Creationcited by 837
  19. 2023LRM: Large Reconstruction Model for Single Image to 3Dcited by 834
  20. 2016Pixel Recurrent Neural Networkscited by 814
  21. 2024Emu3: Next-Token Prediction is All You Needcited by 761
  22. 2024Autoregressive Model Beats Diffusion: Llama for Scalable Image Generationcited by 760
  23. 2024Structured 3D Latents for Scalable and Versatile 3D Generationcited by 742
  24. 2021Diffusion Probabilistic Models for 3D Point Cloud Generationcited by 734
  25. 2023Wonder3D: Single Image to 3D using Cross-Domain Diffusioncited by 682
  26. 2024Autoregressive Image Generation without Vector Quantizationcited by 644
  27. 2023Muse: Text-To-Image Generation via Masked Generative Transformerscited by 640
  28. 2023SyncDreamer: Generating Multiview-consistent Images from a Single-view Imagecited by 638
  29. 2016Learning a Probabilistic Latent Space of Object Shapes via 3D Generative-Adversarial Modelingcited by 558
  30. 2022LION: Latent Point Diffusion Models for 3D Shape Generationcited by 552
  31. 2018PartNet: A Large-scale Benchmark for Fine-grained and Hierarchical Part-level 3D Object Understandingcited by 521
  32. 20233DShape2VecSet: A 3D Shape Representation for Neural Fields and Generative Diffusion Modelscited by 449
  33. 2022GET3D: A Generative Model of High Quality 3D Textured Shapes Learned from Imagescited by 446
  34. 2024CLAY: A Controllable Large-scale Generative Model for Creating High-quality 3D Assetscited by 444
  35. 2024InstantMesh: Efficient 3D Mesh Generation from a Single Image with Sparse-view Large Reconstruction Modelscited by 421
  36. 2025Hunyuan3D 2.0: Scaling Diffusion Models for High Resolution Textured 3D Assets Generationcited by 342
  37. 2023OmniObject3D: Large-Vocabulary 3D Object Dataset for Realistic Perception, Reconstruction and Generationcited by 324
  38. 2020PolyGen: An Autoregressive Generative Model of 3D Meshescited by 267

50 most cited of 79 All 79 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

  1. 2026OmniGameArena: A Unified UE5 Benchmark for VLM Game Agents with Improvement Dynamicscited by 4