Construction of neurofuzzy models for imbalanced data classification

[1] M. Stone, “Cross-validatory choice and assessment of statistical predictions,” Journal of the Royal Statistical Society. Series B (Methodological), vol. 36, no. 2, pp. 111–147, 1974. [2] R. H. Myers, Classical and modern regression with applications, 2nd ed. PWS-KENT, Boston, 1990. [3] S. Chen, S. A. Billings, and W. Luo, “Orthogonal least squares methods and their applications to non-linear system identification,” International Journal of Control, vol. 50, pp. 1873–1896, 1989. [4] X. Hong, P. M. Sharkey, and K. Warwick, “Automatic nonlinear predictive model construction using forward regression and the PRESS statistic,” IEE Proceedings - Control Theory and Applications, vol. 150, no. 3, pp. 245–254, 2003. [5] X. Hong, S. Chen, and C. J. Harris, “A fast linear-in-the-parameters classifier construction algorithm using orthogonal forward selection to minimize leave-one-out misclassification rate,” International Journal of Systems Science, vol. 39, no. 2, pp. 119–25, 2008. [6] L. A. Zadeh, “Fuzzy sets,” Information and Control, vol. 8, no. 1, pp. 338–353, 1965. [7] S. Guillaume, “Designing fuzzy inference systems from data: An interpretability-oriented review,” IEEE Transactions on Fuzzy Systems, vol. 9, no. 3, pp. 426 –443, 2001. [8] M. Gan, M. Hanmandlu, and A. H. Tan, “From a gaussian mixture model to additive fuzzy systems,” IEEE Transactions on Fuzzy Systems, vol. 13, no. 3, pp. 303 – 316, 2005. [9] E. H. Mamdani and S. Assilian, “An experiment in linguistic synthesis with a fuzzy logic controller,” International Journal of Man-Machine Studies, vol. 51, pp. 135–147, 1999. [10] P. M. Larsen, “Industrial applications of fuzzy logic control,” International Journal of Man-Machine Studies, vol. 12, no. 1, pp. 3 – 10, 1980. [11] T. Takagi and M. Sugeno, “Fuzzy identification of systems and its applications to modeling and control,” IEEE Transactions on Systems, Man, and Cybernetics, vol. 15, no. 1, pp. 116–132, 1985. [12] M. F. Azeem, M. Hanmandlu, and N. Ahmad, “Generalization of adaptive neuro-fuzzy inference systems,” IEEE Transactions on Neural Networks, vol. 11, no. 6, pp. 1332–1346, 2000. [13] M. Brown and C. Harris, Neurofuzzy adaptive modelling and control. Hertfordshire, UK: Prentice Hall International (UK) Ltd., 1994. [14] C. Harris, X. Hong, and Q. Gan, Adaptive modelling, estimation and fusion from data: a neurofuzzy approach. London, UK: Springer-Verlag, 2002. [15] J. R. Castro, O. Castillo, P. Melin, A. R. Daz, and O. Mendoza, “Universal approximation of a class of interval type-2 fuzzy neural networks illustrated with the case of non-linear identification,” in IFSA/EUSFLAT Conf, Corfu, Greece, 2009, pp. 1382–1387. [16] M. Figueiredo, R. Ballini, S. Soares, M. Andrade, and F. Gomide, “Learning algorithms for a class of neurofuzzy network and application,” Systems, Man, and Cybernetics, Part C: Applications and Reviews, IEEE Transactions on, vol. 34, no. 3, pp. 293–301, 2004. [17] H. Roubos and M. Setnes, “Compact and transparent fuzzy models and classifiers through iterative complexity reduction,” IEEE Transactions on Fuzzy Systems, vol. 9, no. 4, pp. 516 –524, 2001. [18] J. Roubos, M. Setnes, and J. Abonyi, “Learning fuzzy classification rules from labeled data,” Information Sciences, vol. 150, pp. 77–93, 2003. [19] S. Mohagheghi, G. Venayagamoorthy, and R. Harley, “Fully evolvable optimal neurofuzzy controller using adaptive critic designs,” Fuzzy Systems, IEEE Transactions on, vol. 16, no. 6, pp. 1450–1461, 2008. [20] M. Gao, X. Hong, and C. J. Harris, “A unified neurofuzzy model for classification,” International Journal of Systems Science, vol. 0, no. 0, pp. 1–14, 2013. [21] C. M. Bishop, Pattern Recognition and Machine Learning. New York, U.S.: Springer-Verlag New York, Inc., 2006. [22] J. Yen and L. Wang, “Simplifying fuzzy rule-based models using orthogonal transformation methods,” IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics, vol. 29, no. 1, pp. 13–24, 1999. [23] Y. Shi, R. Eberhart, and Y. Chen, “Implementation of evolutionary fuzzy systems,” IEEE Transactions on Fuzzy Systems, vol. 7, no. 2, pp. 109 –119, 1999. [24] M. Setnes and H. Roubos, “GA-fuzzy modeling and classification: complexity and performance,” IEEE Transactions on Fuzzy Systems, vol. 8, no. 5, pp. 509 –522, 2000. [25] X. Hong and C. J. Harris, “A neurofuzzy network knowledge extraction and extended Gram-Schmidt algorithm for model subspace decomposition,” IEEE Transactions on Fuzzy Systems, vol. 11, no. 4, pp. 528–541, 2003. [26] N. Petrick, H. P. Chan, B. Sahiner, and D. Wei, “An adaptive densityweighted contrast enhancement filter for mammographic breast mass detection,” IEEE Transactions on Medical Imaging, vol. 15, no. 1, pp. 59 –67, 1996. [27] T. Fawcett and F. Provost, “Adaptive fraud detection,” Data Mining and Knowledge Discovery, vol. 1, pp. 291–316, 1997. [28] E. P. D. Pednault, B. K. Rosen, and C. Apte, “Handling imbalanced data sets in insurance risk modeling,” IBM Research Report RC-21731, Tech. Rep., 2000. [29] M. Kubat, R. C. Holte, and S. Matwin, “Machine learning for the detection of oil spills in satellite radar images,” Machine Learning, vol. 30, pp. 195–215, 1998. [30] F. Provost, “Machine learning from imbalanced data sets 101,” AAAI Workshop on Learning from Imbalanced Data Sets, 2000. [31] N. V. Chawla, K. W. Bowyer, L. O. Hall, and W. P. Kegelmeyer, “SMOTE: Synthetic minority over-sampling technique,” Journal of Artificial Intelligence Research, vol. 16, pp. 321–357, 2002. [32] Z. Ferandez, M. J. Jesus, and F. Herrera, “On the influence of an adaptive inference system in fuzzy rule based classification systems for imbalanced data sets,” Expert Systems with Applications, vol. 36, pp. 9805–9812, 2009. [33] M. Gao, X. Hong, S. Chen, and C. J. Harris, “A combined SMOTE and PSO based RBF classifier for two-class imbalanced problems,” Neurocomputing, vol. 74, no. 17, pp. 3456–3466, 2011. [34] M. Gao, X. Hong, S. Chen, and C. Harris, “Probability density function estimation based over-sampling for imbalanced two-class problems,” in the 2012 International Joint Conference on Neural Networks (IJCNN), 2012, pp. 1–8. [35] A. P. Bradley, “The use of the area under the ROC curve in the evaluation of machine learning algorithms,” Pattern Recognition, vol. 30, pp. 1145– 1159, 1997. [36] C. van Rijsbergen, Information Retrieval. London, U.K.: Butterworths, 1979. [37] X. Hong, S. Chen, and C. J. Harris, “A kernel-based two-class classifier for imbalanced data sets,” IEEE Transactions on Neural Networks, vol. 18, no. 1, pp. 28–41, 2007. [38] C. Elkan, “The foundations of cost-sensitive learning,” in Proceedings of the 17th international joint conference on Artificial intelligence, Seattle, WA, USA, 2001, pp. 973–978. [39] K. M. Ting, “An instance-weighting method to induce cost-sensitive trees,” IEEE Transactions on Knowledge and Data Engineering, vol. 14, no. 3, pp. 659–665, 2002. [40] Q. Gan and C. J. Harris, “Fuzzy local linearization and local basis function expansion in nonlinear system modeling,” IEEE Transactions on Systems, Man, and Cybernetics, vol. 29, no. 4, pp. 559–565, 1999. [41] A. P. Dempster, N. M. Laird, and D. B. Rubin, “Maximum likelihood from incomplete data via the EM algorithm,” Journal Of The Royal Statistical Society, Series B, vol. 39, no. 1, pp. 1–38, 1977. [42] M. Gao, X. Hong, and C. Harris, “A neurofuzzy classifier for two class problems,” in the 12th UK Workshop on Computational Intelligence (UKCI), 2012, pp. 1–6. [43] A. Frank and A. Asuncion, “UCI machine learning repository,” 2010. [Online]. Available: http://archive.ics.uci.edu/ml [44] K. K. Lee, C. J. Harris, S. R. Gunn, and P. Reed, “Classification of imbalanced data with transparent kernel,” in Proceedings of INNS-IEEE International Joint Conference on Neural Network (IJCNN), Washington DC, USA, 2001, pp. 2410–2415. [45] J. Moody and C. J. Darken, “Fast learning in networks of locally-tuned processing units,” Neural Computation, vol. 1, pp. 281–294, 1989. [46] S. Haykin, Neural Networks: A Comprehensive Foundation, 2nd ed. Upper Saddle River, NJ, USA: Prentice Hall PTR, 1998. 1063-6706 (c) 2013 IEEE. Personal use is permitted, but republication/redistribution requires IEEE permission. See http://www.ieee.org/publications_standards/publications/rights/index.html for more information. This article has been accepted for publication in a future issue of this journal, but has not been fully edited. Content may change prior to final publication. Citation information: DOI 10.1109/TFUZZ.2013.2296091, IEEE Transactions on Fuzzy Systems 13 [47] M. Gao, X. Hong, S. Chen, and C. Harris, “On combination of SMOTE and particle swarm optimization based radial basis function classifier for imbalanced problems,” in the 2011 International Joint Conference on Neural Networks (IJCNN), 2011, pp. 1146–1153.