IPreMom: A Continual Learning-Based Image Rating Framework for Infant Precious Moments Capturing

Yu Huang, Ju Hui Tseng, Ching Jui Hsiao, Hui Mei Hung, Vincent S. Tseng*

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

The baby monitoring system is a kind of smart IoT system helpful for busy working parents. Besides providing basic safety care, it actually also delivers the moments of baby growing and development by all time recording. Hence, in baby monitoring systems nowadays, capturing and recommending the precious moments of infant growth to their parents has become a real-world demand. How to capture the interesting, worthwhile and exquisite moments with commemorative and catering to the parents' preferences is a challenging problem. In this paper, we propose a novel image rating framework, namely Infant growth Precious Moment capturing (IPreMom), which is based on the concept of continual learning for comprehensively addressing the problem of automatically capturing the precious moments during infant growth. Through a series of experiments, it was shown that our proposed framework delivers excellent performance compared to the baselines, with up to 40% improvement in terms of MAE. Moreover, the proposed framework has been implanted into a commercial baby monitor on the market. To the best of our knowledge, this is the first work that solves the problem of automatically capturing the infant precious moments using continual learning and image rating techniques, which is important and has not been well studied in the academic and industrial communities.

Original languageEnglish
Title of host publicationProceedings of the 37th ACM/SIGAPP Symposium on Applied Computing, SAC 2022
PublisherAssociation for Computing Machinery
Pages1382-1390
Number of pages9
ISBN (Electronic)9781450387132
DOIs
StatePublished - 25 Apr 2022
Event37th ACM/SIGAPP Symposium on Applied Computing, SAC 2022 - Virtual, Online
Duration: 25 Apr 202229 Apr 2022

Publication series

NameProceedings of the ACM Symposium on Applied Computing

Conference

Conference37th ACM/SIGAPP Symposium on Applied Computing, SAC 2022
CityVirtual, Online
Period25/04/2229/04/22

Keywords

  • baby monitoring systems
  • continual learning
  • image recommendation

Fingerprint

Dive into the research topics of 'IPreMom: A Continual Learning-Based Image Rating Framework for Infant Precious Moments Capturing'. Together they form a unique fingerprint.

Cite this