mlsanityData to 7 Oct 2026

MeshXL: Neural Coordinate Field for Generative 3D Foundation Models

arXiv 2405.20853 ↗First posted 31 May 2024cs.CVcited by 100

Not on the map. Why?

Abstract (arXiv)

The polygon mesh representation of 3D data exhibits great flexibility, fast rendering speed, and storage efficiency, which is widely preferred in various applications. However, given its unstructured graph representation, the direct generation of high-fidelity 3D meshes is challenging. Fortunately, with a pre-defined ordering strategy, 3D meshes can be represented as sequences, and the generation process can be seamlessly treated as an auto-regressive problem. In this paper, we validate the Neural Coordinate Field (NeurCF), an explicit coordinate representation with implicit neural embeddings, is a simple-yet-effective representation for large-scale sequential mesh modeling. After that, we present MeshXL, a family of generative pre-trained auto-regressive models, which addresses the process of 3D mesh generation with modern large language model approaches. Extensive experiments show that MeshXL is able to generate high-quality 3D meshes, and can also serve as foundation models for various down-stream applications.

Key facts. Cited by 100 papers in the map (data through 7 Oct 2026). Builds on 87 of its 103 references that are in the map. First posted on arXiv 31 May 2024.

Builds on

87 of 103 references.

References · 87

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  4. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  5. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  6. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
  7. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
  8. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
  9. 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,069
  10. 2022Generative Adversarial Networkscited by 5,603
  11. 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,223
  12. 2017Neural Discrete Representation Learningcited by 4,650
38 more
  1. 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,616
  2. 2017PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Spacecited by 4,384
  3. 2022OPT: Open Pre-trained Transformer Language Modelscited by 3,464
  4. 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,088
  5. 2023Mistral 7Bcited by 3,065
  6. 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,006
  7. 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,880
  8. 2023PaLM-E: An Embodied Multimodal Language Modelcited by 2,037
  9. 2021Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fieldscited by 1,957
  10. 2021Structured Denoising Diffusion Models in Discrete State-Spacescited by 1,665
  11. 2022Objaverse: A Universe of Annotated 3D Objectscited by 1,522
  12. 2023Zero-1-to-3: Zero-shot One Image to 3D Objectcited by 1,483
  13. 2019ZeRO: Memory Optimizations Toward Training Trillion Parameter Modelscited by 1,278
  14. 2023ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillationcited by 1,207
  15. 20194D Spatio-Temporal ConvNets: Minkowski Convolutional Neural Networkscited by 1,201
  16. 2023DreamGaussian: Generative Gaussian Splatting for Efficient 3D Content Creationcited by 837
  17. 2023LRM: Large Reconstruction Model for Single Image to 3Dcited by 834
  18. 2023RWKV: Reinventing RNNs for the Transformer Eracited by 814
  19. 2023Objaverse-XL: A Universe of 10M+ 3D Objectscited by 767
  20. 2023ScanNet++: A High-Fidelity Dataset of 3D Indoor Scenescited by 747
  21. 2021Diffusion Probabilistic Models for 3D Point Cloud Generationcited by 734
  22. 2024LGM: Large Multi-View Gaussian Model for High-Resolution 3D Content Creationcited by 730
  23. 2023CogVLM: Visual Expert for Pretrained Language Modelscited by 704
  24. 2022Point-E: A System for Generating 3D Point Clouds from Complex Promptscited by 694
  25. 2016Learning a Probabilistic Latent Space of Object Shapes via 3D Generative-Adversarial Modelingcited by 558
  26. 2023One-2-3-45: Any Single Image to 3D Mesh in 45 Seconds without Per-Shape Optimizationcited by 555
  27. 2019Revisiting Point Cloud Classification: A New Benchmark Dataset and Classification Model on Real-World Datacited by 532
  28. 2023MotionGPT: Human Motion as a Foreign Languagecited by 521
  29. 20213D Shape Generation and Completion through Point-Voxel Diffusioncited by 516
  30. 2021PointCLIP: Point Cloud Understanding by CLIPcited by 461
  31. 2021Deep Marching Tetrahedra: a Hybrid Representation for High-Resolution 3D Shape Synthesiscited by 459
  32. 2022GET3D: A Generative Model of High Quality 3D Textured Shapes Learned from Imagescited by 446
  33. 2024InstantMesh: Efficient 3D Mesh Generation from a Single Image with Sparse-view Large Reconstruction Modelscited by 421
  34. 20203D-FRONT: 3D Furnished Rooms with layOuts and semaNTicscited by 375
  35. 2023An Embodied Generalist Agent in 3D Worldcited by 355
  36. 2023Unleashing Large-Scale Video Generative Pre-training for Visual Robot Manipulationcited by 353
  37. 2024Better & Faster Large Language Models via Multi-token Predictioncited by 344
  38. 2023PointLLM: Empowering Large Language Models to Understand Point Cloudscited by 326

50 most cited of 87 All 87 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 13; 2025: 55; 2026: 32.

100 papers.

Sort:

By area:

  1. 2024MeshAnything: Artist-Created Mesh Generation with Autoregressive Transformerscited by 140
  2. 2024MeshAnything V2: Artist-Created Mesh Generation With Adjacent Mesh Tokenizationcited by 102
  3. 2024LLaMA-Mesh: Unifying 3D Mesh Generation with Language Modelscited by 87
  4. 2024Meshtron: High-Fidelity, Artist-Like 3D Mesh Generation at Scalecited by 87
  5. 2025Step1X-3D: Towards High-Fidelity and Controllable Generation of Textured 3D Assetscited by 85
  6. 2024EdgeRunner: Auto-regressive Auto-encoder for Artistic Mesh Generationcited by 84
  7. 2024Scaling Mesh Generation via Compressive Tokenizationcited by 71
  8. 2025OmniSVG: A Unified Scalable Vector Graphics Generation Modelcited by 71
  9. 2025DeepMesh: Auto-Regressive Artist-mesh Creation with Reinforcement Learningcited by 62
  10. 2025OmniPart: Part-Aware 3D Generation with Semantic Decoupling and Structural Cohesioncited by 60
  11. 2024CAD-GPT: Synthesising CAD Construction Sequence with Spatial Reasoning-Enhanced Multimodal LLMscited by 52
  12. 2025Efficient Part-level 3D Object Generation via Dual Volume Packingcited by 47
38 more
  1. 2025MagicArticulate: Make Your 3D Models Articulation-Readycited by 43
  2. 2025Ultra3D: Efficient and High-Fidelity 3D Generation with Part Attentioncited by 43
  3. 2024MeshArt: Generating Articulated Meshes with Structure-Guided Transformerscited by 40
  4. 2025VoxHammer: Training-Free Precise and Coherent 3D Editing in Native 3D Spacecited by 40
  5. 2025TreeMeshGPT: Artistic Mesh Generation with Autoregressive Tree Sequencingcited by 38
  6. 2024MVPaint: Synchronized Multi-View Diffusion for Painting Anything 3Dcited by 34
  7. 2025ShapeLLM-Omni: A Native Multimodal LLM for 3D Generation and Understandingcited by 34
  8. 2025Retrieval Augmented Generation and Understanding in Vision: A Survey and New Outlookcited by 32
  9. 2025What Is The Best 3D Scene Representation for Robotics? From Geometric to Foundation Modelscited by 29
  10. 2025Generating Physically Stable and Buildable Brick Structures from Textcited by 23
  11. 2025Advances in Feed-Forward 3D Reconstruction and View Synthesis: A Surveycited by 23
  12. 2025Mesh-RFT: Enhancing Mesh Generation via Fine-grained Reinforcement Fine-Tuningcited by 21
  13. 2025Nautilus: Locality-aware Autoencoder for Scalable Mesh Generationcited by 18
  14. 2025MeshLLM: Empowering Large Language Models to Progressively Understand and Generate 3D Meshcited by 18
  15. 2025FastMesh: Efficient Artistic Mesh Generation via Component Decouplingcited by 17
  16. 2024LaGeM: A Large Geometry Model for 3D Representation Learning and Diffusioncited by 16
  17. 2024TAR3D: Creating High-Quality 3D Assets via Next-Part Predictioncited by 16
  18. 2025Sat2City: 3D City Generation from A Single Satellite Image with Cascaded Latent Diffusioncited by 15
  19. 2025TTS-VAR: A Test-Time Scaling Framework for Visual Auto-Regressive Generationcited by 15
  20. 2025Pandora3D: A Comprehensive Framework for High-Quality 3D Shape and Texture Generationcited by 14
  21. 2025AR-1-to-3: Single Image to Consistent 3D Object Generation via Next-View Predictioncited by 14
  22. 2025MeshCraft: Exploring Efficient and Controllable Mesh Generation with Flow-based DiTscited by 14
  23. 2025VertexRegen: Mesh Generation with Continuous Level of Detailcited by 14
  24. 2025iFlame: Interleaving Full and Linear Attention for Efficient Mesh Generationcited by 13
  25. 2025Machine learning for modelling unstructured grid data in computational physics: a reviewcited by 12
  26. 2025MAR-3D: Progressive Masked Auto-regressor for High-Resolution 3D Generationcited by 11
  27. 2025QuadGPT: Native Quadrilateral Mesh Generation with Autoregressive Modelscited by 11
  28. 20243D Shape Tokenization via Latent Flow Matchingcited by 10
  29. 2026LATO: 3D Mesh Flow Matching with Structured TOpology Preserving LAtentscited by 10
  30. 2025CoRe3D: Collaborative Reasoning as a Foundation for 3D Intelligencecited by 9
  31. 2026SegviGen: Repurposing 3D Generative Model for Part Segmentationcited by 9
  32. 2025Towards Scalable Spatial Intelligence via 2D-to-3D Data Liftingcited by 8
  33. 2025PDT: Point Distribution Transformation with Diffusion Modelscited by 8
  34. 2025MeshMosaic: Scaling Artist Mesh Generation via Local-to-Global Assemblycited by 8
  35. 2025MeshRipple: Structured Autoregressive Generation of Artist-Meshescited by 8
  36. 2026MeshFlow: Efficient Artistic Mesh Generation via MeshVAE and Flow-based Diffusion Transformercited by 7
  37. 2024Scene123: One Prompt to 3D Scene Generation via Video-Assisted and Consistency-Enhanced MAEcited by 6
  38. 2025MeshPad: Interactive Sketch-Conditioned Artist-Reminiscent Mesh Generation and Editingcited by 6

50 most cited of 100 All 100 (JSON)