Unpaired Translation of 3D Point Clouds with Multi-part Shape Representation

Chih Chia Li, I. Chen Lin*

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

Abstract

Unpaired shape translation is an emerging task for intelligent shape modelling and editing. Recent methods for 3D shape transfer use single- or multi-scale latent codes but a single generator to generate the whole shape. The transferred shapes are prone to lose control of local details. To tackle the issue, we propose a parts-to-whole framework that employs multi-part shape representation to preserve structural details during translation. We decompose the whole shape feature into multiple part features in the latent space. These part features are then processed by individual generators respectively and transformed to point clouds. We constrain the local features of parts within the loss functions, which enable the model to generate more similar shape characteristics to the source input. Furthermore, we propose a part aggregation module that improves the performance when combining multiple point clusters to generate the final output. The experiments demonstrate that our multi-part shape representation can retain more shape characteristics compared to previous approaches.

Original languageEnglish
Article number6
JournalProceedings of the ACM on Computer Graphics and Interactive Techniques
Volume6
Issue number1
DOIs
StatePublished - 16 May 2023

Keywords

  • generative adversarial network
  • multi-part shape modeling
  • shape deformation
  • Unpaired domain translation

Fingerprint

Dive into the research topics of 'Unpaired Translation of 3D Point Clouds with Multi-part Shape Representation'. Together they form a unique fingerprint.

Cite this