Dual-stream fusion network for spatiotemporal video super-resolution

Min Yuan Tseng, Yen Chung Chen, Yi Lun Lee, Wei Sheng Lai, Yi Hsuan Tsai, Wei-Chen Chiu

研究成果: Conference contribution同行評審

1 引文 斯高帕斯(Scopus)

摘要

Visual data upsampling has been an important research topic for improving the perceptual quality and benefiting various computer vision applications. In recent years, we have witnessed remarkable progresses brought by the re-naissance of deep learning techniques for video or image super-resolution. However, most existing methods focus on advancing super-resolution at either spatial or temporal direction, i.e, to increase the spatial resolution or the video frame rate. In this paper, we instead turn to discuss both directions jointly and tackle the spatiotemporal upsampling problem. Our method is based on an important observation that: even the direct cascade of prior research in spatial and temporal super-resolution can achieve the spatiotemporal upsampling, changing orders for combining them would lead to results with a complementary property. Thus, we propose a dual-stream fusion network to adaptively fuse the intermediate results produced by two spatiotemporal up-sampling streams, where the first stream applies the spatial super-resolution followed by the temporal super-resolution, while the second one is with the reverse order of cascade. Extensive experiments verify the efficacy of the proposed method against several baselines. Moreover, we investigate various spatial and temporal upsampling methods as the basis in our two-stream model and demonstrate the flexibility with wide applicability of the proposed framework.

原文English
主出版物標題Proceedings - 2021 IEEE Winter Conference on Applications of Computer Vision, WACV 2021
發行者Institute of Electrical and Electronics Engineers Inc.
頁面2684-2693
頁數10
ISBN(電子)9780738142661
DOIs
出版狀態Published - 3 1月 2021
事件2021 IEEE Winter Conference on Applications of Computer Vision, WACV 2021 - Virtual, Online, United States
持續時間: 5 1月 20219 1月 2021

出版系列

名字Proceedings - 2021 IEEE Winter Conference on Applications of Computer Vision, WACV 2021

Conference

Conference2021 IEEE Winter Conference on Applications of Computer Vision, WACV 2021
國家/地區United States
城市Virtual, Online
期間5/01/219/01/21

指紋

深入研究「Dual-stream fusion network for spatiotemporal video super-resolution」主題。共同形成了獨特的指紋。

引用此