mlsanityData to 14 Oct 2026

AESOP: Asymmetric Human-Camera Generation with Translation-Intensity Control

arXiv 2609.37229 ↗First posted 29 Sep 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Human motion defines an action, while a camera trajectory determines how it is presented. Camera generation for a given human motion and joint human-camera generation are usually treated as separate tasks, although both share an asymmetric dependency: human motion can be generated independently, whereas the camera responds to the realized action. We introduce AESOP, a unified framework with an independent human pathway and a shared human-conditioned camera generator. Its asymmetric architecture serves both tasks while preserving the human output during camera generation. Although human context anchors the shot to the action and camera text describes its movement, translation intensity remains underspecified. We therefore construct trajectory pairs that differ in camera translation magnitude while sharing human motion and camera text, then use these pairs to learn an explicit intensity condition. Experiments on the PulpMotion dataset demonstrate strong camera distributional and framing quality in both tasks and effective control over camera translation intensity. Project page is available at https://ripemangobox.github.io/AESOP.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 33 of its 43 references that are in the map. First posted on arXiv 29 Sep 2026.

Builds on

33 of 43 references.

References · 33

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  3. 2020Denoising Diffusion Implicit Modelscited by 9,781
  4. 2022Scalable Diffusion Models with Transformerscited by 6,054
  5. 2022Classifier-Free Diffusion Guidancecited by 5,847
  6. 2022Flow Matching for Generative Modelingcited by 5,702
  7. 2022Elucidating the Design Space of Diffusion-Based Generative Modelscited by 3,045
  8. 2018On the Continuity of Rotation Representations in Neural Networkscited by 1,214
  9. 2022Human Motion Diffusion Modelcited by 1,080
  10. 2022MotionDiffuse: Text-Driven Human Motion Generation with Diffusion Modelcited by 780
  11. 2024Autoregressive Image Generation without Vector Quantizationcited by 651
  12. 2023T2M-GPT: Generating Human Motion from Textual Descriptions with Discrete Representationscited by 588
21 more
  1. 2023MotionCtrl: A Unified and Flexible Motion Controller for Video Generationcited by 580
  2. 2022Executing your Commands via Motion Diffusion in Latent Spacecited by 575
  3. 2020Reliable Fidelity and Diversity Metrics for Generative Modelscited by 434
  4. 2023MoMask: Generative Masked Modeling of 3D Human Motionscited by 400
  5. 2023TMR: Text-to-Motion Retrieval Using Contrastive 3D Human Motion Synthesiscited by 198
  6. 2024Multi-Track Timeline Control for Text-Driven 3D Human Motion Generationcited by 91
  7. 2025MotionStreamer: Streaming Motion Generation via Diffusion-based Autoregressive Model in Causal Latent Spacecited by 86
  8. 2024Rethinking Diffusion for Text-Driven Human Motion Generation: Redundant Representations, Evaluation, and Masked Autoregressioncited by 85
  9. 2024DartControl: A Diffusion-Based Autoregressive Motion Model for Real-Time Text-Driven Motion Controlcited by 84
  10. 2025Go to Zero: Towards Zero-shot Motion Generation with Million-scale Datacited by 68
  11. 2026Kimodo: Scaling Controllable Human Motion Generationcited by 37
  12. 2025HY-Motion 1.0: Scaling Flow Matching Models for Text-To-Motion Generationcited by 36
  13. 2024E.T. the Exceptional Trajectories: Text-to-camera-trajectory generation with character awarenesscited by 25
  14. 2025The Quest for Generalizable Motion Generation: Data, Model, and Evaluationcited by 22
  15. 2024Cinematographic Camera Diffusion Modelcited by 18
  16. 2025GenDoP: Auto-regressive Camera Trajectory Generation as a Director of Photographycited by 18
  17. 2025FineMotion: A Dataset and Benchmark with both Spatial and Temporal Annotation for Fine-grained Motion Generation and Editingcited by 11
  18. 2024DanceCamera3D: 3D Camera Movement Synthesis with Music and Dancecited by 8
  19. 2025Pulp Motion: Framing-aware multimodal camera and human motion generationcited by 8
  20. 2026VERTIGO: Visual Preference Optimization for Cinematic Camera Trajectory Generationcited by 3
  21. 2026Auteur: Language-Driven Cinematographic Framing for Human-Centric Video Generationcited by 1

Built on by

Not cited yet.