mlsanityData to 14 Oct 2026

A Three-Level Alignment Framework for Large-Scale 3D Retrieval and Controlled 4D Generation

arXiv 2512.22294 ↗First posted 25 Dec 2025cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

We introduce Uni4D, a unified framework for large scale open vocabulary 3D retrieval and controlled 4D generation based on structured three level alignment across text, 3D models, and image modalities. Built upon the Align3D 130 dataset, Uni4D employs a 3D text multi head attention and search model to optimize text to 3D retrieval through improved semantic alignment. The framework further strengthens cross modal alignment through three components: precise text to 3D retrieval, multi view 3D to image alignment, and image to text alignment for generating temporally consistent 4D assets. Experimental results demonstrate that Uni4D achieves high quality 3D retrieval and controllable 4D generation, advancing dynamic multimodal understanding and practical applications.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 45 of its 55 references that are in the map. First posted on arXiv 25 Dec 2025.

Builds on

45 of 55 references.

References · 45

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  3. 2014ImageNet Large Scale Visual Recognition Challengecited by 8,498
  4. 2023Segment Anythingcited by 8,234
  5. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
  6. 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,248
  7. 2015You Only Look Once: Unified, Real-Time Object Detectioncited by 4,852
  8. 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,897
  9. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
  10. 2021Align before Fuse: Vision and Language Representation Learning with Momentum Distillationcited by 1,619
  11. 2023Objaverse-XL: A Universe of 10M+ 3D Objectscited by 774
  12. 2017Mastering Chess and Shogi by Self-Play with a General Reinforcement Learning Algorithmcited by 734
33 more
  1. 2019Revisiting Point Cloud Classification: A New Benchmark Dataset and Classification Model on Real-World Datacited by 532
  2. 2025VLM-R1: A Stable and Generalizable R1-style Large Vision-Language Modelcited by 526
  3. 20203D-FUTURE: 3D Furniture shape with TextUREcited by 311
  4. 2022ULIP: Learning a Unified Representation of Language, Images, and Point Clouds for 3D Understandingcited by 267
  5. 2019Cross-Modal Self-Attention Network for Referring Image Segmentationcited by 263
  6. 2023Uni3D: Exploring Unified 3D Representation at Scalecited by 237
  7. 2023DreamGaussian4D: Generative 4D Gaussian Splattingcited by 194
  8. 20234D-fy: Text-to-4D Generation Using Hybrid Score Distillation Samplingcited by 185
  9. 2024MagicLens: Self-Supervised Image Retrieval with Open-Ended Instructionscited by 119
  10. 2024Diffusion4D: Fast Spatial-temporal Consistent 4D Generation via Video Diffusion Modelscited by 100
  11. 2023CLIP goes 3D: Leveraging Prompt Tuning for Language Grounded 3D Recognitioncited by 77
  12. 2025CF-VLM:CounterFactual Vision-Language Fine-tuningcited by 59
  13. 2025GAM-Agent: Game-Theoretic and Uncertainty-Aware Collaboration for Complex Visual Reasoningcited by 58
  14. 2023CoDA: Collaborative Novel Box Discovery and Cross-modal Alignment for Open-vocabulary 3D Object Detectioncited by 52
  15. 2025KABB: Knowledge-Aware Bayesian Bandits for Dynamic Expert Coordination in Multi-Agent Systemscited by 37
  16. 2025MAT-Agent: Adaptive Multi-Agent Training Optimizationcited by 35
  17. 2025DrDiff: Dynamic Routing Diffusion with Hierarchical Attention for Breaking the Efficiency-Quality Trade-offcited by 34
  18. 2025MM-CoT:A Benchmark for Probing Visual Chain-of-Thought Reasoning in Multimodal Modelscited by 34
  19. 2023DepthSSC: Monocular 3D Semantic Scene Completion via Depth-Spatial Alignment and Voxel Adaptationcited by 32
  20. 2025OSC: Cognitive Orchestration through Dynamic Knowledge Alignment in Multi-Agent LLM Collaborationcited by 30
  21. 2025Failure-Driven Workflow Refinementcited by 20
  22. 2025Hybrid Token Compression for Vision-Language Modelscited by 20
  23. 2025Kolmogorov-Arnold Fourier Networkscited by 18
  24. 2025Learning Dynamics of VLM Finetuningcited by 17
  25. 2025Top-Down Semantic Refinement for Image Captioningcited by 16
  26. 20223DPPE: 3D Point Positional Encoding for Multi-Camera 3D Object Detection Transformerscited by 15
  27. 2025LLM-CAS: Dynamic Neuron Perturbation for Real-Time Hallucination Correctioncited by 15
  28. 2025RaCoT: Plug-and-Play Contrastive Example Generation Mechanism for Enhanced LLM Reasoning Reliabilitycited by 14
  29. 2018Watch the Unobserved: A Simple Approach to Parallelizing Monte Carlo Tree Searchcited by 13
  30. 20253DAlign-DAER: Dynamic Attention Policy and Efficient Retrieval Strategy for Fine-grained 3D-Text Alignment at Scalecited by 12
  31. 2025FlashVLM: Text-Guided Visual Token Selection for Large Multimodal Modelscited by 11
  32. 2024OpenDlign: Open-World Point Cloud Understanding with Depth-Aligned Imagescited by 9
  33. 2018Monte Carlo Tree Search for Asymmetric Treescited by 4

Built on by

Not cited yet.