Animation generation for object transportation with a rope using deep reinforcement learning

This article presents a reinforcement learning-based approach to generate animation in which two agents use a rope to collaboratively transport a block. The challenge is that the agents need to master several skills, including approaching the block, using the rope to wrap around it, and then moving the block to a predefined goal position. We propose several reward terms to learn the transportation policy and the adjustment policy that govern the skills of the agents. Experiment results showed that the proposed approach was able to generate various animations in different settings, including rope lengths, block sizes, and block shapes. An ablation test revealed the effects of the reward terms. We also investigated factors that affected the performance of the two policies.