Frametalk: Human and picture frame interaction through the iot technology

Wen-Shu Lai, Yi-Bing Lin, Chung Yun Hsiao*, Li Kuan Chen, Chao Fan Wu, Shu Min Lin

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review


The concept of frame plays a significant role in art design. However, traditional picture frames do not allow interaction with human. To provide another dimension of artwork demonstration of picture frames, we utilize the Internet of Things (IoT) technology to create human and picture frame interaction. Specifically, an application-layer IoT device management platform called IoTtalk is used to quickly establish connections and meaningful interactions between IoT devices. The frame and human interaction is achieved by implementing an output device of IoTtalk called FrameTalk, which provides animation in a digital frame to be controlled by the input devices (typically a smartphone). The FrameTalk device can be displayed in specific frame hardware or the screen of any computing device. We describe the functional block diagram of the FrameTalk device and its default applications. Then we show two FrameTalk application examples. The first example is CalligraphyTalk that allows the audience to interact with the frame to write the poems. The second example is PortraitGuess that allows the audience to guess historical figures through the frame.

Original languageEnglish
Title of host publicationIoT as a Service- 4th EAI International Conference, IoTaaS 2018, Proceedings
EditorsBo Li, Mao Yang, Zhongjiang Yan, Hui Yuan
PublisherSpringer Verlag
Number of pages9
ISBN (Print)9783030146566
StatePublished - 1 Jan 2019
Event4th International Conference on IoT as a Service, IoTaaS 2018 - Xi’an, China
Duration: 17 Nov 201818 Nov 2018

Publication series

NameLecture Notes of the Institute for Computer Sciences, Social-Informatics and Telecommunications Engineering, LNICST
ISSN (Print)1867-8211


Conference4th International Conference on IoT as a Service, IoTaaS 2018


  • Cyber physical interaction
  • Interactive visual design
  • IoTtalk


Dive into the research topics of 'Frametalk: Human and picture frame interaction through the iot technology'. Together they form a unique fingerprint.

Cite this