快速随机多核学习分类算法

doi:10.3969/j.issn.1001-2400.2016.01.007

J4 ›› 2016, Vol. 43 ›› Issue (1): 36-40.doi: 10.3969/j.issn.1001-2400.2016.01.007

快速随机多核学习分类算法

孙涛;冯婕

(西安电子科技大学智能感知与图像理解教育部重点实验室，陕西西安 710071)

收稿日期:2014-08-31 出版日期:2016-02-20 发布日期:2016-04-06
通讯作者: 孙涛
作者简介:孙涛(1984-)，男，西安电子科技大学博士研究生，E-mail：taosun@mail.xidian.edu.cn．
基金资助:
国家973计划资助项目(2013CB329402)；国家自然科学基金资助项目(61272282)；新世纪人才计划资助项目(NCET-13-0948)

Fast randommultiple kernel learning for classification

SUN Tao;FENG Jie

(Ministry of Education Key Lab. of Intelligent Perception and Image Understanding, Xidian Univ., Xi'an 710071, China)

Received:2014-08-31 Online:2016-02-20 Published:2016-04-06
Contact: SUN Tao

摘要/Abstract

摘要：

多核学习是整合多个子核在一个优化框架内，从而寻求到多个子核之间的一个最佳线性组合，而且多核学习可以获得比单核学习更好的分类性能．受极限学习思想的启发，提出了快速随机多核学习分类方法．当满足极限学习的理论框架时，可以在构造核的过程中，对参数随机赋值，构造一种随机核．可以缩减子核的规模，加快了多核学习的计算时间，并且节省了内存空间，使得多核学习可以处理更大规模的问题．另外，通过使用经验Rademacher复杂度来分析多核学习的一般性误差，从而获得比原有多核学习更高的分类精度．结果表明，与经典的快速多核学习算法相比，文中提供的算法计算更快，占用内存空间更小，分类精度更高．

关键词: 多核学习, 极限学习, 随机核, 经验Rademacher复杂度

Abstract:

Multiple kernel learning (MKL) combines multiple kernels in a convex optimization framework and seeks the best line combination of them. Generally, MKL can get better results than single kernel learning, but heavy computational burden makes MKL impractical. Inspired by the extreme learning machine (ELM), a novel fast MKL method based on the random kernel is proposed. When the framework of ELM is satisfied, the kernel parameters can be given randomly, which produces the random kernel. Thus, the sub-kernel scale is reduced largely, which accelerates the training time and saves the memory. Furthermore, the reduced kernel scale can reduce the error bound of MKL by analyzing the empirical Rademacher complexity of MKL. It gives a theoretical guarantee that the proposed method gets a higher classification accuracy than traditional MKL methods. Experiments indicate that the proposed method uses a faster speed, more small memory and gets better results than several classical fast MKL methods.

Key words: multiple kernel learning, extreme learning machine, random kernel, empirical rademacher complexity

中图分类号:

TP775

孙涛;冯婕. 快速随机多核学习分类算法[J]. J4, 2016, 43(1): 36-40.

SUN Tao;FENG Jie. Fast randommultiple kernel learning for classification[J]. J4, 2016, 43(1): 36-40.

参考文献

［1］ KWAK N. Nonlinear Projection Trick in Kernel Methods: an Alternative to the Kernel Trick ［J］. IEEE Transactions on Neural Networks and Learning Systems, 2013, 24(12): 2113-2119.
［2］ SHAO Z F, ZHANG L, ZHOU X R, et al. A Novel Hierarchical Semisupervised SVM for Classification of Hyperspectral Images ［J］. IEEE Geoscience and Remote Sensing Letters, 2014, 11(9): 92-97.
［3］ WON K, SAUNDERS C, PRGEL-BENNETT A. Evolving Fisher Kernels for Biological Sequence Classification ［J］. Evolutionary Computation, 2013, 21(1): 81-105.
［4］李映, 焦李成. 基于核Fisher判别分析的目标识别［J］. 西安电子科技大学学报, 2003, 30(2): 179-182.
LI Ying, JIAO Licheng. Target Recognition Based on Kernel Fisher Discriminant ［J］. Journal of Xidian University, 2003, 30(2): 179-182.
［5］ SUN T, JIAO L C, LIU F, et al. Selective Multiple Kernel Learning for Classification with Ensemble Strategy ［J］. Pattern Recognition, 2013, 46(11): 3081-3090.
［6］ BACH F, LANCKRIET G, JORDAN M. Multiple Kernel Learning, Conic Duality, and the SMO Algorithm ［C］//Proceedings of 21th International Conference on Machine Learning. New York: ACM, 2004: 41-48.
［7］ SONNENBURG S, RATSCH G, SCHAFER C, et al. Large Scale Multiple Kernel Learning ［J］. Journal of Machine Learning Research, 2006, 7(1): 1531-1565.
［8］ BACH F, RAKOTOMAMONJY A, CANU S, et al. Simple MKL ［J］. Journal of Machine Learning Research, 2008, 9: 2491-2521.
［9］ XU Z L, JIN R, YANG H Q, et al. Simple and Efficient Multiple Kernel Learning by Group Lasso ［C］//Proceedings of the International Conference on Machine Learning. London: Elsevier Limited, 2010: 1175-1182.
［10］ KLOFT M, BREFELD U, SONNENBURG S, et al. Lp-Norm Multiple Kernel Learning ［J］. Journal of Machine Learning Research, 2011, 12: 953-997.
［11］ HUANG G B, WANG D H, LAN Y. Extreme Learning Machines: a Survey ［J］. International Journal of Machine Learning and Cybernetics, 2011, 2(2): 107-122.
［12］ CHEN J Y, ZHENG G Z, CHEN H J. ELM-MapReduce: MapReduce Accelerated Extreme Learning Machine for Big Spatial Data Analysis ［C］//IEEE International Conference on Control and Automation. Washington: IEEE Computer Society, 2013: 400-405.
［13］ CORTES C, MOHRI M, ROSTAMIZADEH A. Generalization Bounds for Learning Kernels ［C］//Proceedings of the 27th International Conference on Machine Learning. London: Elsevier Limited, 2010: 247-254.

快速随机多核学习分类算法

Fast randommultiple kernel learning for classification

PDF (PC)

赞

可视化

被引次数

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 1

Metrics

本文评价

推荐阅读 10