利用旋转森林变换的异构多分类器集成算法

doi:10.3969/j.issn.1001-2400.2014.05.009

Abstract

Abstract:

In order to boost the diversity among individual classifiers of an ensemble, a new ensemble method is proposed that combines two different classifier models via a transformation of rotation forest, named by isomerous multiple classifier ensemble．Firstly, the original samples are transformed and divided by the rotating forest to obtain new samples．Then support vector machine with the high accuracy of classification or kernel matching pursuit with the speedy classification is selected as a basic classifier model based on a special proportion, the selected classifier is used to classify the new samples, and the predictive labels are obtained. Finally, the predictive labels given by two different models are combined to obtain the final predictive labels of an ensemble. Particularly, the proposed method achieves the complementarity of accuracy and speed by combining two different classifier models, and it is important that isomerous classifier ensemble improve the generalization error of an ensemble and increases the classification performance. According to the experimental results of classification for UCI datasets and remote sensing image datasets, it is illustrated that the proposed method shortens obviously the running time and improves the accuracy of classification, compared with an ensemble based on the single classifier model.

Key words: classifier ensemble, rotation forest, support vector machine, kernel matching pursuit

CLC Number:

G623.58

MAO Shasha;XIONG Lin;JIAO Licheng;ZHANG Shuang;CHEN Bo. Isomerous multiple classifier ensemble via transformation of the rotating forest[J].J4, 2014, 41(5): 48-53.

References

［1］ Kuncheva L I. Combining Pattern Classifiers: Methods and Algorithms ［M］. New Jersey: John Wiley ＆ Sons, 2004.
［2］ Rodriguez J J, Kuncheva L I, Alonso C J. Rotation Forest: A New Classifier Ensemble Method ［J］. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2006, 28(10): 1619-1630.
［3］ Zhang L, Zhou W D. Sparse Ensemble Using Weighted Combination Methods based on Linear Programming ［J］. Pattern Recognition, 2011, 44(1): 97-106.
［4］ Hansen L K, Salamon P. Neural Network Ensembles ［J］. IEEE Transactions on Pattern Analysis and Machine Intelligence, 1990, 12(10): 993-1001.
［5］吴建鑫, 周志华, 沈学华, 等. 一种选择性神经网络集成构造方法［J］. 计算机研究与发展, 2000, 37(9): 1039-1044.
Wu Jianxin, Zhou Zhihua, Shen Xuehua, et al. A Selective Constructing Approach for Neural Network Ensemble［J］. Journal of Computer Research and Development, 2000, 37(9): 1039-1044.
［6］李青, 焦李成. 利用集成支撑矢量机提高分类性能［J］. 西安电子科技大学学报, 2007, 34(1): 68-70.
Li Qing, Jiao Licheng. Improvement Classification Performance by The Support Vector Machine Ensemble［J］. Journal of Xidian University, 2007, 34(1): 68-70.
［7］ Alham N K, Li M Z, Liu Y, et al. A Distributed SVM Ensemble for Image Classification and Annotation ［C］//9th International Conference on Fuzzy Systems and Knowledge Discovery. Piscataway: IEEE, 2012: 1581-1584.
［8］ Ghorai S, Mukherjee A, Sengupta S, et al. Cancer Classification from Gene Expression Data by NPPC Ensemble ［J］. IEEE/ACM Transactions on Computational Biology and Bioinformatics, 2011, 8(3): 659-671.
［9］ Vapnik V. The Nature of Statistical Learning Theory ［M］. Berlin: Springer-Verlag, 1999.
［10］ Vincent P, Bengio Y. Kernel Matching Pursuit ［J］. Machine Learning, 2002, 48(1-3): 165-187.
［11］ Opitz D W. Feature Selection for Ensemble ［C］//Proceedings of the National Conference on Artificial Intelligence. New York: ACM, 1999: 379-384.
［12］ Margineantu D D, Dietterich T G. Pruning Adaptive Boosting ［C］//Proceedings of the 14th International Conference on Machine Learning. New York: ACM, 1997: 211-218.
［13］焦李成, 公茂果, 王爽, 等. 自然计算、机器学习与图像理解前沿［M］. 西安：西安电子科技大学出版社, 2008.
［14］ Breiman L. Bagging Predictors ［J］. Machine learning, 1996, 24(2): 123-140.
［15］ Tumer K, Ghosh J. Ensembles of Radial Basis Function Networks for Spectroscopic Detection of Cervical Precancer ［J］. IEEE Transactions on Biomedical Engineering, 1998, 45(8): 953-961.
［16］ Kuncheva L I, Whitaker C J. Measures of Diversity in Classifier Ensembles and Their Relationship with the Ensemble Accuracy ［J］. Machine Learning, 2003, 51(2): 181-207.
［17］ Valentini G, Muselli M, Ruffino F. Bagged Ensembles of Support Vector Machines for Gene Expression Data Analysis ［C］//Proceedings of the International Joint Conference on Neural Networks. Piscataway: IEEE, 2003: 1844-1849.
［18］ Yuan Hanning, Fang Meng, Zhu Xingquan. Hierarchical Sampling for Multi-Instance Ensemble Learning［J］. IEEE Transactions on Knowledge and Data Engineering, 2013, 25(12): 2900-2905.

[1]	WANG Junxiang,HUANG Lin,ZHANG Ying,NI Jiangqun,LIN Lang. Algorithm for the detection of a low complexity contrast enhanced image source [J]. Journal of Xidian University, 2021, 48(1): 96-106.
[2]	LI Hai,SHANG Jinlei,SUN Tingyi,FENG Qing,ZHUANG Zibo. Method for hydrometeor classification based on MC-DTSVMs [J]. Journal of Xidian University, 2020, 47(4): 132-140.
[3]	AN Yali,ZHOU Shuisheng,CHEN Li,WANG Baojun. Robust support vector machines and their sparse algorithms [J]. Journal of Xidian University, 2019, 46(1): 64-72.
[4]	LI Meiling;HU Yaogai;ZHOU Chen;ZHAO Zhengyu;ZHANG Yuannong;LIU Jing;DENG Z X. On the short-term regional prediction of foF2 based on the support vector machine [J]. J4, 2015, 42(5): 147-153+206.
[5]	YAO Chao;LU Zhaoyang;LI Jing;JIANG Wei;FAN Zhihui. Hybrid classifier based method for similar handwritten Chinese character recognition [J]. J4, 2015, 42(5): 26-32.
[6]	CAI Yanyan;SONG Xiaodong. New fuzzy SVM model used in imbalanced datasets [J]. J4, 2015, 42(5): 120-124+160.
[7]	XIONG Lin;JIAO Licheng;MAO Shasha . Selective ensemble based on the integer matrix linear transformation and its application to radar target recognition [J]. J4, 2015, 42(2): 13-19.
[8]	JIANG Jianguo;ZHAO Yuan;MENG Hongwei;LI Bo. SVM decision-tree multi-classification strategy via electromagnetism-like mechanism [J]. J4, 2014, 41(6): 83-88.
[9]	YANG Xi;LI Jie;HAN Bing;GAO Xinbo. Wavelet hierarchical model for aurora images classification [J]. J4, 2013, 40(2): 18-24.
[10]	. A Wavelet Hierarchical Model for Aurora Images Classification [J]. J4, 2013, 40(2): 18-24.
[11]	LIU Xiaopei;LU Zhaoyang;LI Jing. Complex scene text location method based on WTLBP and SVM [J]. J4, 2012, 39(4): 103-108.
[12]	WANG Shiqiang;ZHANG Dengfu;BI Duyan;XUE Deyou;YONG Xiaoju. Research on recognizing the radar signal using the bispectrum cascade feature [J]. J4, 2012, 39(2): 127-132+191.
[13]	QIN Chuandong;LIU Sanyang;ZHANG Shifang. Method for extracting the tumor gene based on the support vector machine [J]. J4, 2012, 39(1): 191-196.
[14]	SHE Xiangyang;LI Chonggui;YAO Wanqiang. Research on the geometric correction algorithm for the remote sensing image by a support vector machine [J]. J4, 2011, 38(5): 121-128+146.
[15]	DU Yaqin；HONG Bo；GUO Lei；YANG Ning. Novel curve fitting edge feature extraction algorithm [J]. J4, 2011, 38(3): 164-168+188.

Isomerous multiple classifier ensemble via transformation of the rotating forest

PDF (PC)

Like

Knowledge

Cited

Abstract

Cite this article

share this article

References

Related Articles 15

Metrics

Comments

Recommended 0