Associative classifier

An associative classifier (AC) is a kind of supervised learning model that uses association rules to assign a target value. The term associative classification was coined by Bing Liu et al.,[1] in which the authors defined a model made of rules "whose right-hand side are restricted to the classification class attribute".

Model edit

The model generated by an AC and used to label new records consists of association rules, where the consequent corresponds to the class label. As such, they can also be seen as a list of "if-then" clauses: if the record matches some criteria (expressed in the left side of the rule, also called antecedent), it is then labeled accordingly to the class on the right side of the rule (or consequent).

Most ACs read the list of rules in order, and apply the first matching rule to label the new record.[2]

Metrics edit

The rules of an AC inherit some of the metrics of association rules, like the support or the confidence.[3] Metrics can be used to order or filter the rules in the model[4] and to evaluate their quality.

Implementations edit

The first proposal of a classification model made of association rules was FBM.[5] The approach was popularized by CBA,[1] although other authors had also previously proposed the mining of association rules for classification.[6] Other authors have since then proposed multiple changes to the initial model, like the addition of a redundant rule pruning phase[7] or the exploitation of Emerging Patterns.[8]

Notable implementations include:

References edit

  1. ^ a b Liu, Bing; Hsu, Wynne; Ma, Yiming (1998). "Integrating Classification and Association Rule Mining": 80––86. CiteSeerX 10.1.1.48.8380. {{cite journal}}: Cite journal requires |journal= (help)
  2. ^ Thabtah, Fadi (2007). "A review of associative classification mining" (PDF). The Knowledge Engineering Review. 22 (1): 37–65. doi:10.1017/s0269888907001026. ISSN 0269-8889. S2CID 15986963.
  3. ^ Liao, T Warren; Triantaphyllou, Evangelos (2008). Recent Advances in Data Mining of Enterprise Data: Algorithms and Applications. Series on Computers and Operations Research. WORLD SCIENTIFIC. doi:10.1142/6689. ISBN 9789812779854. S2CID 34599426.
  4. ^ "CBA homepage". Retrieved 2018-10-04.
  5. ^ Webb, Geoffrey (1989). "A Machine Learning Approach to Student Modelling" (PDF). Proceedings of the Third Australian Joint Conference on Artificial Intelligence (AI 89): 195–205.
  6. ^ Ali, Kamal; Manganaris, Stefanos; Srikant, Ramakrishnan (1997-08-14). "Partial classification using association rules". KDD'97. AAAI Press: 115–118. {{cite journal}}: Cite journal requires |journal= (help)
  7. ^ a b Wenmin Li; Jiawei Han; Jian Pei (2001). "CMAR: Accurate and efficient classification based on multiple class-association rules". Proceedings 2001 IEEE International Conference on Data Mining. IEEE Comput. Soc. pp. 369–376. CiteSeerX 10.1.1.13.219. doi:10.1109/icdm.2001.989541. ISBN 978-0769511191. S2CID 2243455.
  8. ^ a b Dong, Guozhu; Zhang, Xiuzhen; Wong, Limsoon; Li, Jinyan (1999), "CAEP: Classification by Aggregating Emerging Patterns", Discovery Science, Springer Berlin Heidelberg, pp. 30–42, CiteSeerX 10.1.1.37.3226, doi:10.1007/3-540-46846-3_4, ISBN 9783540667131, S2CID 6465422
  9. ^ "CMAR Implementation". cgi.csc.liv.ac.uk. Retrieved 2018-10-04.
  10. ^ Yin, Xiaoxin; Han, Jiawei (2003), "CPAR: Classification based on Predictive Association Rules", Proceedings of the 2003 SIAM International Conference on Data Mining, Society for Industrial and Applied Mathematics, pp. 331–335, CiteSeerX 10.1.1.12.7268, doi:10.1137/1.9781611972733.40, ISBN 9780898715453
  11. ^ "THE LUCS-KDD IMPLEMENTATIONS OF THE FOIL, PRM AND CPAR ALGORITHMS". cgi.csc.liv.ac.uk. Retrieved 2018-10-04.
  12. ^ Baralis, E.; Chiusano, S.; Garza, P. (2008). "A Lazy Approach to Associative Classification". IEEE Transactions on Knowledge and Data Engineering. 20 (2): 156–171. doi:10.1109/tkde.2007.190677. ISSN 1041-4347. S2CID 14829459.
  13. ^ "L3 implementation". dbdmg.polito.it. Retrieved 2018-10-08.
  14. ^ Chen, Guoqing; Liu, Hongyan; Yu, Lan; Wei, Qiang; Zhang, Xing (2006). "A new approach to classification based on association rule mining". Decision Support Systems. 42 (2): 674–689. doi:10.1016/j.dss.2005.03.005. ISSN 0167-9236.
  15. ^ Wang, Ke; Zhou, Senqiang; He, Yu (2000). "Growing decision trees on support-less association rules". Proceedings of the sixth ACM SIGKDD international conference on Knowledge discovery and data mining. New York, New York, USA: ACM Press. pp. 265–269. CiteSeerX 10.1.1.36.9265. doi:10.1145/347090.347147. ISBN 978-1581132335. S2CID 8296096.