B-CANF: Adaptive B-Frame Coding With Conditional Augmented Normalizing Flows

Mu Jung Chen, Yi Hsin Chen, Wen Hsiao Peng*

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

2 Scopus citations

Abstract

Over the past few years, learning-based video compression has become an active research area. However, most works focus on P-frame coding. Learned B-frame coding is under-explored and more challenging. This work introduces a novel B-frame coding framework, termed B-CANF, that exploits conditional augmented normalizing flows for B-frame coding. B-CANF additionally features two novel elements: frame-type adaptive coding and B*-frames. Our frame-type adaptive coding learns better bit allocation for hierarchical B-frame coding by dynamically adapting the feature distributions according to the B-frame type. Our B*-frames allow greater flexibility in specifying the group-of-pictures (GOP) structure by reusing the B-frame codec to mimic P-frame coding, without the need for an additional, separate P-frame codec. On commonly used datasets, B-CANF achieves the state-of-the-art compression performance as compared to the other learned B-frame codecs and shows comparable BD-rate results to HM-16.23 under the random access configuration in terms of PSNR. When evaluated on different GOP structures, our B*-frames achieve similar performance to the additional use of a separate P-frame codec.

Original languageEnglish
Pages (from-to)2908-2921
Number of pages14
JournalIEEE Transactions on Circuits and Systems for Video Technology
Volume34
Issue number4
DOIs
StatePublished - 1 Apr 2024

Keywords

  • B-frame coding
  • Neural video coding
  • conditional coding

Fingerprint

Dive into the research topics of 'B-CANF: Adaptive B-Frame Coding With Conditional Augmented Normalizing Flows'. Together they form a unique fingerprint.

Cite this