Documente Academic
Documente Profesional
Documente Cultură
Web Site: www.ijaiem.org Email: editor@ijaiem.org, editorijaiem@gmail.com Volume 2, Issue 2, February 2013 ISSN 2319 - 4847
ABSTRACT
Sequential pattern mining is an important data mining problem with broad applications. However, it is also a difficult problem since the mining may have to generate or examine a combinatorial explosive number of intermediate subsequences. Most of the previously developed sequential pattern mining methods, such as GSP, explore a candidate generation-and-test approach [1] to reduce the number of candidates to be examined. However, this approach may not be efficient in mining large sequence databases having numerous patterns and/or long patterns. A comprehensive performance study shows that PrefixSpan, in most cases, outperforms the apriori-based algorithm GSP, FreeSpan[2], and SPADE [3] (a sequential pattern mining algorithm that adopts vertical data format), and PrefixSpan[4] integrated with pseudoprojection is the fastest among all the tested algorithms. Furthermore, this mining methodology can be extended to mining sequential patterns with user-specified constraints. The high promise of the pattern-growth approach may lead to its further extension toward efficient mining of other kinds of frequent patterns, such as frequent substructures. Keywords: Data mining algorithm, sequential pattern, frequent pattern, transaction database, sequence
1. INTRODUCTION
The sequential pattern mining problem was first introduced by Agrawal and Skrikant [5] and can be stated as follows. We are given a set of sequences, called data-sequences, as the input data. Each data-sequence is a list of transactions, where each transaction contains a set of literals, called items. Given a user-specified minimum support threshold, sequential pattern mining is to find all of the frequent subsequences in the sequence database, i.e., the subsequences whose ratios of appearance exceed the minimum support threshold. As an example, a retailer may find a sequential pattern having bought a notebook, a customer returns to buy a PDA and a WLAN card from its customer purchase database. Many approaches ([6]) have been proposed to extract sequential patterns from sequence databases. Most of early works focus on the following two directions: 1. Improve the efficiency of the mining process. This direction of research focuses on the efficient mining of sequential patterns in time-related data ([7], [4], [8], [2],). In general, these methods can be categorized into three classes: (1) Apriori-based, horizontal formatting method, such as GSP [1]; (2) Apriori-based, vertical formatting method, such as SPADE [3]; (3) Projection-based pattern growth method, such as PrefixSpan([8]) and (4) Aprioribased candidate generation and pruning using depth-first traversal, such as SPAM [9]. 2. Extend the mining of sequential patterns to other time-related patterns. In addition to improving the efficiency of the mining process, another important direction of research is to find other types of pattern in time-related databases. Important research in this category includes finding frequent episodes in event sequences ([10]); finding frequent traversal patterns in a web log ([11]); finding cyclic patterns in a time-stamped transaction database ([12]).
Page 103
Applying basic Apriori Algorithm: The Apriori algorithm was first proposed by Agrawal in [5], for the discovery of frequent itemsets. It is the most widely used algorithm for the discovery of frequent itemsets and association rules. The main concepts of the Apriori algorithm are as follows: 1. Any subset of a frequent itemset is a frequent itemset. 2. The set of itemsets of size k will be called . 3. The set of frequent itemsets that also satisfy the minimum support constraint is known as . This is the seed set used for the next pass over the data. 4. is generated by joining with itself. The itemsets of each pass have one more element than the itemsets of the previous pass. 5. Similarly, is then generated by eliminating from those elements that do not satisfy the minimum support rule. Because the candidate sequences are generated by starting with the smaller sequences and progressively
Page 104
1-sequence
Table 6 Support Counting of 3-Sequence L3 3-sequence <1 2 3> <1 2 4> <1 3 4> <1 3 5> <2 3 4> Support 2 2 3 2 2
Page 105
Page 106
Figure 1 Sequential Pattern Mining Algorithms. 3. Taxonomy of existing sequential pattern-mining algorithms Taxonomy of existing sequential pattern-mining algorithms is provided in Figure 3.2 in this section, which lists the algorithms, showing a comparative analysis of their different important features. This proposed taxonomy is composed of three main categories of sequential pattern-mining algorithms, namely, apriori-based, pattern-growth and earlypruning algorithms. Algorithms mainly differ in two ways: 1. The way in which candidate sequences are generated and stored. The main goal here is to minimize the number of candidatesequences generated so as to minimize I/O cost.
Page 107
Figure 2 Tabular Taxonomy of Sequential Pattern Mining Algorithms. [19] Careful investigation of Figure 2 shows how slow the Apriori-based SPAM algorithm could become as data set size grows from medium (| D |=200K) to large (| D |=800K), due to the increased number of AND operations and the traversal of the large lexicographical tree; although it is a little faster than PrefixSpan on large data sets due to the utilization of bitmaps as compared to the projected databases of PrefixSpan. Table 1 Comparative analysis of algorithm performance. [19] The symbol - means an algorithm crashes with the parameters provided, and memory usage could not be measured.
Page 108
REFREMCES
[1]Agrawal, R. and R. Srikant, Mining Sequential Patterns: Generalizations and Performance Improvements, Lecture Notes in Computer Science Advances in Database Technology, pp. 317, 1996. [2]J. Pei, J. Han, B. Mortazavi-Asl, Q. Chen, U. Dayal, M. C. Hsu, FreeSpan: frequent pattern-projected sequential pattern mining, Proceedings of 2000 International Conference on Knowledge Discovery and Data Mining, (2000), pp. 355-359. [3]Zaki, M., SPADE: An Efficient Algorithm for Mining Frequent Sequences, Machine Learning, vol. 42, no. 1/2, pp. 3160, and 2001. [4]Pei, J. et al., Mining Sequential Patterns by Pattern Growth: The PrefixSpan Approach, IEEE Transactions on Knowledge and Data Engineering, vol. 16, no. 10, pp. 14241440, Nov. 2004. [5]Agrawal, R, T. Imielinski, and A. Swami, Mining Association Rules Between Sets of Items in Large Databases, Proc. ACM SIGMOD nternational Conference Management of Data, vol. 22, pp. 207216, 1993. [6]M. S. Chen, J. Han, P. S. Yu, Data mining: an overview from a database perspective, IEEE Transactions on Knowledge and Data Engineering, Vol. 8, Iss. 6, (1996), pp. 866-883. [7]R. Agrawal, C. Faloutsos, & A. Swami. Efficient similarity search in sequence databases. Proceedings of Conference on Foundations of Data Organization and Algorithms, (1993), pp. 69-84. [8]J. Pei, J. Han, H. Pinto, Q. Chen, U. Dayal, M. C. Hsu, PrefixSpan: mining sequential patterns efficiently by prefixprojected pattern growth. Proceedings of 2001 International Conference on Data Engineering, (2001), pp. 215-224. [9]Ayres, J. et al., Sequential Pattern Mining Using a Bitmap Representation, Proceedings of Conference on Knowledge Discovery and Data Mining, pp. 429435, 2002. [10]H. Mannila, H. Toivonen, A. I. Verkamo, Discovery of frequent episodes in event sequences, Data Mining and Knowledge Discovery, Vol. 1, Iss. 3, (1997), pp. 259-289. [11]R. Srikant, Y. Yang, Mining web logs to improve website organization, Proceedings of the Tenth International World Wide Web Conference, Hong Kong, (2001). [12]Y. L. Chen, M. C. Chiang, M. T. Kao, Discovering time-interval sequential patterns in sequence databases, Expert Systems with Applications, Vol. 25, Iss. 3, (2003), pp. 343-354. [13]Agrawal, R. and R. Srikant, Mining Sequential Patterns, Proceedings of the 11th Int. Conference on Data Engineering, pp. 314, March 1995. [14]Abramowicz, W. and J. Zurada, Knowledge Discovery for Business Information Systems, Springer, 2001. [15].Masseglia, F., F. Cathala, and P. Poncelet, The PSP Approach for Mining Sequential Patterns, Lecture Notes in Computer Science, Principles of Data Mining and Knowledge Discovery, vol. 1510, pp. 176184, 1998. [16]Zaki, M., N. Lesh, and M. Ogihara, PlanMine: Sequence Mining for Plan Failures, Proceedings of the 4th International Conference on Knowledge Discovery and Data Mining, pp. 369373, 1998. [17]Wu, C.L., J.L. Koh, and P.Y. An, Improved Sequential Pattern Mining Using an Extended Bitmap Representation, Lecture Notes in Computer Science, vol. 3588, pp. 776785, 2005. [18]Yan, X., J. Han, and R. Afshar, CloSpan: Mining Closed Sequential Patterns in Large Datasets, Proceedings of 2003 SIAM nternational Conference Data Mining, 2003. [19]NIZAR R. MABROUKEH and C. I. EZEIFE, A Taxonomy of Sequential Pattern Mining Algorithms, ACM Computing Surveys, Vol. 43, No. 1, Article 3, Publication date: November 2010.
Page 109