mlsanityData to 14 Oct 2026

Learning Dolly-In Filming From Demonstration Using a Ground-Based Robot

arXiv 2509.00574 ↗First posted 30 Aug 2025cs.RO cs.LGcited by 0

On the map: Offline RL and imitation learning from data → Imitation learning methods

Abstract (arXiv)

Cinematic camera control demands a balance of precision and artistry - qualities that are difficult to encode through handcrafted reward functions. While reinforcement learning (RL) has been applied to robotic filmmaking, its reliance on bespoke rewards and extensive tuning limits creative usability. We propose a Learning from Demonstration (LfD) approach using Generative Adversarial Imitation Learning (GAIL) to automate dolly-in shots with a free-roaming, ground-based filming robot. Expert trajectories are collected via joystick teleoperation in simulation, capturing smooth, expressive motion without explicit objective design. Trained exclusively on these demonstrations, our GAIL policy outperforms a PPO baseline in simulation, achieving higher rewards, faster convergence, and lower variance. Crucially, it transfers directly to a real-world robot without fine-tuning, achieving more consistent framing and subject alignment than a prior TD3-based method. These results show that LfD offers a robust, reward-free alternative to RL in cinematic domains, enabling real-time deployment with minimal technical effort. Our pipeline brings intuitive, stylized camera control within reach of creative professionals, bridging the gap between artistic intent and robotic autonomy.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Imitation learning methods, one of 13 directions in Offline RL and imitation learning from data. Builds on 7 of its 15 references that are in the map. First posted on arXiv 30 Aug 2025.

Builds on

7 of 15 references.

Closest ancestors · 2

Same direction, newest first

  1. 2022imitation: Clean Imitation Learning Implementations22 Nov
  2. 2018An Algorithmic Perspective on Imitation Learning16 Nov

Other references · 5

  1. 2017Proximal Policy Optimization Algorithmscited by 15,215
  2. 2016OpenAI Gymcited by 1,736
  3. 2016Generative Adversarial Imitation Learningcited by 1,597
  4. 2018Autonomous drone cinematographer: Using artistic principles to create smooth, safe, occlusion-free trajectories for aerial filmingcited by 4
  5. 2020Can We Enable the Drone to be a Filmmaker?cited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Reinforcement Learning of Dolly-In Filming Using a Ground-Based Robot
  2. 2018Injective State-Image Mapping facilitates Visual Adversarial Imitation Learning
  3. 2026ReShoot: Generative Visual Domain Randomization of Recorded Robot Demonstrations for Visuomotor Policy Learning ↗
  4. 2025DRAW2ACT: Turning Depth-Encoded Trajectories into Robotic Demonstration Videos
  5. 2021AMP: Adversarial Motion Priors for Stylized Physics-Based Character Control
  6. 2026Generative adversarial imitation learning for robot swarms: Learning from human demonstrations and trained policies
  7. 2024Efficient Imitation Learning with Conservative World Models
  8. 2025Taming Camera-Controlled Video Generation with Verifiable Geometry Reward