Online Chinese restaurant process

Chien-Liang Liu, Tsung Hsun Tsai, Chia Hoang Lee

研究成果: Conference contribution同行評審

7 引文 斯高帕斯(Scopus)

摘要

Processing large volumes of streaming data in near-real-time is becoming increasingly important as the Internet, sensor networks and network traffic grow. Online machine learning is a typical means of dealing with streaming data, since it allows the classification model to learn one instance of data at a time. Although many online learning methods have been developed since the development of the Perceptron algorithm, existing online methods assume that the number of classes is available in advance of classification process. However, this assumption is unrealistic for large scale or streaming data sets. This work proposes an online Chinese restaurant process (CRP) algorithm, which is an online and nonparametric algorithm, to tackle this problem. This work proposes a relaxing function as part of the prior and updates the parameters with the likelihood function in terms of the consistency between the true label information and predicted result. This work presents two Gibbs sampling algorithms to perform posterior inference. In the experiments, the online CRP is applied to three massive data sets, and compared with several online learning and batch learning algorithms. One of the data sets is obtained from Wikipedia, which comprises approximately two million documents. The experimental results reveal that the proposed online CRP performs well and efficiently on massive data sets. Finally, this work proposes two methods to update the hyperparameter α of the online CRP. The first method is based on the posterior distribution of α, and the second exploits the property of online learning, namely adapting to change, to adjust α dynamically.

原文English
主出版物標題KDD 2014 - Proceedings of the 20th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining
發行者Association for Computing Machinery
頁面591-600
頁數10
ISBN(列印)9781450329569
DOIs
出版狀態Published - 1 1月 2014
事件20th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, KDD 2014 - New York, NY, United States
持續時間: 24 8月 201427 8月 2014

出版系列

名字Proceedings of the ACM SIGKDD International Conference on Knowledge Discovery and Data Mining

Conference

Conference20th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, KDD 2014
國家/地區United States
城市New York, NY
期間24/08/1427/08/14

指紋

深入研究「Online Chinese restaurant process」主題。共同形成了獨特的指紋。

引用此