DensER: Density-imbalance-Eased Representation for LiDAR-based Whole Scene Upsampling

Tso Yuan Chen, Ching Chun Hsiao, Wen-Huang Cheng, Hong-Han Shuai, Peter Chen, Ching Chun Huang

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

With the development of depth sensors, 3D point cloud upsampling that generates a high-resolution point cloud given a sparse input becomes emergent. However, many previous works focused on single 3D object reconstruction and refinement. Although a few recent works began to discuss 3D structure refine-ment for a more complex scene, they do not target LiDAR-based point clouds, which have density imbalance issues from near to far. This paper proposed DensER, a Density-imbalance-Eased regional Representation. Notably, to learn robust representations and model local geometry under imbalance point density, we designed density-aware multiple receptive fields to extract the regional features. Moreover, founded on the patch reoccurrence property of a nature scene, we proposed a density-aided attentive module to enrich the extracted features of point-sparse areas by referring to other non-local regions. Finally, by coupling with novel manifold-based upsamplers, DensER shows the ability to super-resolve LiDAR-based whole-scene point clouds. The exper-imental results show DensER outperforms related works both in qualitative and quantitative evaluation. We also demonstrate that the enhanced point clouds can improve downstream tasks such as 3D object detection and depth completion.

Original languageEnglish
Title of host publication2021 International Conference on Visual Communications and Image Processing, VCIP 2021 - Proceedings
PublisherInstitute of Electrical and Electronics Engineers Inc.
Number of pages5
ISBN (Electronic)9781728185514
DOIs
StatePublished - 5 Dec 2021
Event2021 International Conference on Visual Communications and Image Processing, VCIP 2021 - Munich, Germany
Duration: 5 Dec 20218 Dec 2021

Publication series

Name2021 International Conference on Visual Communications and Image Processing, VCIP 2021 - Proceedings

Conference

Conference2021 International Conference on Visual Communications and Image Processing, VCIP 2021
Country/TerritoryGermany
CityMunich
Period5/12/218/12/21

Keywords

  • 3D Reconstruction
  • 3D Representation
  • Autonomous Vehicle
  • Manifold-based Upsampling
  • Point Cloud

Fingerprint

Dive into the research topics of 'DensER: Density-imbalance-Eased Representation for LiDAR-based Whole Scene Upsampling'. Together they form a unique fingerprint.

Cite this