Handheld object detection and its related event analysis using ratio histogram and mixture of HMMs

Jun-Wei Hsieh*, Jiun Chen Cheng, Li Chih Chen, Chi Hung Chuang, Duan Yu Chen

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

4 Scopus citations


This paper proposes a novel system to analyze human-object interaction events happening between hands and faces in real time. Two challenging problems in this event analysis must be addressed, i.e., there is no prior knowledge (like shape, color, size, and texture) about the handheld objects, and there are large spatial-temporal variations in event representation. For the first challenge, a novel ratio histogram is proposed to find important color bins to locate handheld objects and their trajectories via a code book technique. This scheme is different from other boosted methods which require very time-consuming estimations to search reliable body configurations. For the second challenge, a mixture of HMMs is proposed to describe an event not only from its dynamic context but also its multiplicity context. It can be performed in real time because an exhaustive search process is avoided to find possible interaction pairs between objects and body parts.

Original languageEnglish
Pages (from-to)1399-1415
Number of pages17
JournalJournal of Visual Communication and Image Representation
Issue number6
StatePublished - 1 Jan 2014


  • Behavior analysis
  • Code book
  • Event multiplicity
  • HMMs
  • Hand-held object detection
  • Interaction event
  • Ratio histogram
  • Smoking event detection


Dive into the research topics of 'Handheld object detection and its related event analysis using ratio histogram and mixture of HMMs'. Together they form a unique fingerprint.

Cite this