Motion manipulation for characters in videos

Hung Kuo Chu, Che Hua Yeh, Nick C. Tang, Hsiao Rong Tyan, Yu-Shuen Wang, Hong Yuan Mark Liao

研究成果: Conference contribution同行評審

摘要

Multimedia content creation and manipulation have attracted great attention in recent years due to the popularity of mobile image and video capturing devices. In our daily life, the most common subject appearing in the captured content are people. Hence, to create images and videos by manipulating appearances or motions of the human character inside these media becomes an important research issue. In this paper, we propose a novel idea that requires the fusion of video and audio intelligence. We develop a system whose inputs are a monocular video captured by a stationary RGBD sensor and a music clip. In the context of a human character performing a music conducting motion, the output is a re-targeted video where the motion of performer is manipulated according to the emotional cues extracted from the music clip. To achieve this goal, our system is decomposed into three major stages. First, one needs to access to the geometric and appearance information pertaining to meaningful and representative targets in the video sequence. Second, a systematic way is needed to reliably classify and identify important emotions from the music. Third, to complete the emotion transfer, one has to manipulate the video targets based on the extracted music emotions.

原文English
主出版物標題TAAI 2015 - 2015 Conference on Technologies and Applications of Artificial Intelligence
發行者Institute of Electrical and Electronics Engineers Inc.
頁面512-516
頁數5
ISBN(電子)9781467396066
DOIs
出版狀態Published - 12 2月 2016
事件Conference on Technologies and Applications of Artificial Intelligence, TAAI 2015 - Tainan, Taiwan
持續時間: 20 11月 201522 11月 2015

出版系列

名字TAAI 2015 - 2015 Conference on Technologies and Applications of Artificial Intelligence

Conference

ConferenceConference on Technologies and Applications of Artificial Intelligence, TAAI 2015
國家/地區Taiwan
城市Tainan
期間20/11/1522/11/15

指紋

深入研究「Motion manipulation for characters in videos」主題。共同形成了獨特的指紋。

引用此