A fast method for frequent pattern discovery with secondary memory

Kawuu W. Lin*, Sheng Hao Chung, Ju Chin Chen, Sheng Shiung Huang, Chun-Cheng Lin

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

Abstract

Data mining technology has been widely studied and applied in recent years. Frequent pattern mining is one important technical field of such research. The frequent pattern mining technique is popular not only in academia but also in the business community. With advances in technology, databases have become so large that data mining is impossible because of memory restrictions. In this study, we propose a novel algorithm for Fast mining with Secondary Memory, abbreviated as FSM-Mining, to help improve this situation. FSM-Mining saves a part of the information that is not stored in the memory, and through the use of mixed hard disk and memory mining we are able to complete data mining with limited memory. The results of empirical evaluation under various simulation conditions show that FSM-Mining delivers excellent performance in terms of execution efficiency and scalability.

Original languageEnglish
Pages (from-to)S159-S176
JournalIntelligent Data Analysis
Volume21
Issue numberS1
DOIs
StatePublished - 2017

Keywords

  • Data mining
  • big data
  • frequent patterns

Fingerprint

Dive into the research topics of 'A fast method for frequent pattern discovery with secondary memory'. Together they form a unique fingerprint.

Cite this