一种有效的通信网络告警分析方法

doi:10.19665/j.issn1001-2400.2019.04.001

Abstract

Abstract:

Considering the irrationality of this hypothesis that previous most alarm analysis studies were based on the premise that all alarms in the communication network are equal, a weighted alarm analysis method is proposed. First, according to the significance of the alarm in the network, the entropy method is used to assign different weight values for different alarms, and these values are transformed into a sequence dataset suitable for data mining. Then, a weighted alarm sequential pattern mining algorithm is proposed which uses an original pruning strategy to reduce the size of dataset needing to be mined to improve the efficiency of the algorithm. Finally, the algorithm is used to mine sequential relationship in alarm data. Experimental results show that this weighted alarm analysis approach has a good performance in pruning effectiveness, mining of the important alarm sequential pattern and execution efficiency.

Key words: correlation analysis, network management, entropy method, pruning strategy, weighted alarm sequence pattern mining algorithm

CLC Number:

TP301

QI Xiaogang,HU Qiuqiu,YAO Xuqing,LIU Lifang. Efficient alarm analysis approach for communication networks[J].Journal of Xidian University, 2019, 46(4): 1-8.

Figures/Tables 8

References 17

[1]	王意洁, 程力, 马行空 . 运用警报关联的威胁行为检测技术综述[J]. 国防科技大学学报, 2017,8(5):128-138.
	WANG Yijie, CHENG Li, MA Xingkong . Survey of Alert-correlation Based on Network Threat Detection Techniques[J]. Journal of National University of Defense Technology, 2017,8(5):128-138.
[2]	李龙营, 李金库, 马建峰 , 等. 采用攻击策略图的实时警报综合分析方法[J]. 西安电子科技大学学报, 2014,41(5):84-90. doi: 10.3969/j.issn.1001-2400.2014.05.015
	LI Longying, LI Jinku, MA Jianfeng , et al. Comprehensive Analysis of Real-time Alerts with Attack Strategy Graphs[J]. Journal of Xidian University, 2014,41(5):84-90. doi: 10.3969/j.issn.1001-2400.2014.05.015
[3]	WANG C H, YANG J M. Adaptive Feature-weighted Alert Correlation System Applicable in Cloud Environment [C]//Proceedings of the 2013 8th Asia Joint Conference on Information Security. Washington: IEEE Computer Society, 2013: 41-47.
[4]	RAMAKI A A, AMINI M, EBRAHIMI ATANI R . RTECA: Real Time Episode Correlation Algorithm for Multi-step Attack Scenarios Detection[J]. Computers and Security, 2015,49:206-219.
[5]	WANG Y, LI G C, XU Y K , et al. An Algorithm for Mining of Association Rules for the Information Communication Network Alarms Based on Swarm Intelligence[J]. Mathematical Problems in Engineering, 2014,2014:894205.
[6]	WANG Y, XU Y, LI G , et al. Association Rules Mining Algorithm Using Sharing Mechanism Niche Leaping Ant Colony Based on Apriori Algorithm[J]. Journal of Computational and Theoretical Nanoscience, 2015,12(10):3223-3231.
[7]	LI C, HUANG X. Research on FP-growth Algorithm for Massive Telecommunication Network Alarm Data Based on Spark [C]//Proceedings of the 2017 IEEE International Conference on Software Engineering and Service Science. Washington: IEEE Computer Society, 2017: 875-879.
[8]	AGRAWAL R, SRIKANT R. Mining Sequential Patterns [C]//Proceedings of the 1995 International Conference on Data Engineering. Piscataway: IEEE, 1995: 3-14.
[9]	WANG J, LI H, HUANG J , et al. Association Rules Mining Based Analysis of Consequential Alarm Sequences in Chemical Processes[J]. Journal of Loss Prevention in the Process Industries, 2016,41:178-185.
[10]	LIM H K, KIM Y, KIM M K . Failure Prediction Using Sequential Pattern Mining in the Wire Bonding Process[J]. IEEE Transactions on Semiconductor Manufacturing, 2017,30(3):285-292.
[11]	WANG J, HE C, LIU Y , et al. Efficient Alarm Behavior Analytics for Telecom Networks[J]. Information Sciences, 2017,402:1-14.
[12]	MIHAELA L, MARTHA V K, VINCENT H. Relation Discovery of Mobile Network Alarms with Sequential Pattern Mining [C]//Proceedings of the 2017 International Conference on Computing, Networking and Communications. Piscataway: IEEE, 2017: 363-367.
[13]	罗明, 孟传伟, 黄海量 . 基于加权频繁模式树的通信网络告警规则挖掘方法[J]. 计算机工程, 2016,42(4):190-196. doi: 10.3969/j.issn.1000-3428.2016.04.034
	LUO Ming, MENG Chuanwei, HUANG Hailiang . Alarm Rule Mining Method in Telecommunication Network Based on Weighted Frequent Pattern-tree[J]. Computer Engineering, 2016,42(4):190-196. doi: 10.3969/j.issn.1000-3428.2016.04.034
[14]	MURUGEST T, AIYER C A . Analysis and Optimization of Alarm[J]. Journal of System and Management Sciences, 2013,3(4):1-17.
[15]	汪星, 黄小瑜, 刘瑄璞 , 等. 面向工业大数据的多层增量特征提取方法[J]. 西安电子科技大学学报, 2018,45(4):112-117.
	WANG Xing, HUANG Xiaoyu, LIU Xuanpu , et al. Multi-layer Incremental Feature Extraction Method for Industrial Big Data[J]. Journal of Xidian University, 2018,45(4):112-117.
[16]	PEI J, HAN J, MORTAZAVI-ASL B , et al. Mining Sequential Patterns by Pattern-Growth: The Prefix Span Approach[J]. IEEE Transactions on Knowledge and Data Engineering, 2004,16(11):1424-1440.
[17]	GOETHALS B . Frequent Itemset Mining Implementations Repository[EB/OL]. [ 2019- 2- 20]. http://fimi.cs.helsinki.fi/.

属性	内容	属性	内容	属性	内容
告警设备类型	PTN	网元名称	53-147-XX-HW-PTN1	对设备的影响	无影响
告警标题	ETL_LOS	告警发生时间	2018-10-30 01:45:49	对业务的影响	可能全阻
告警级别	三级告警	告警清除时间	2018-10-30 01:46:16

告警标题	对设备的影响	对业务的影响	告警级别
告警a	局部故障	可能受影响	一级告警
告警b	性能下降	可能受影响	三级告警
告警c	可能受影响	无影响	四级告警
告警d	无影响	质量降低	四级告警
告警e	可能受影响	受影响	二级告警

告警序列ID	告警序列
F1	<a(bd)bcb(ade)>
F2	<(ef)(ab)(df)cb>
F3	<(ad)(bf)abf>
F4	<eg(af)bc>

数据信息	告警数量	网元名称数量	告警标题数量
原始告警数据信息	258103	8930	405
清洗后告警数据信息	72346	5748	165

Efficient alarm analysis approach for communication networks

RichHTML

PDF (PC)

Like

Knowledge

Abstract

Cite this article

share this article

Figures/Tables 8

References 17

Related Articles 12

Metrics

Comments

Recommended 10

[1]	FENG Dengguo. On the significance and function of the Xiao-Massey theorem [J]. Journal of Xidian University, 2021, 48(1): 7-13.
[2]	WANG Xing;HUANG Xiaoyu;LIU Xuanpu;KONG Xianguang;NIU Meng. Multi-layer incremental feature extraction method for industrial big data [J]. Journal of Xidian University, 2018, 45(4): 106-111.
[3]	LI Longying;LI Jinku;MA Jianfeng;JIANG Qi. Comprehensive analysis of real-time alerts with attack strategy graphs [J]. J4, 2014, 41(5): 84-90.
[4]	ZHAO Jing;LI Xinghua;XUE Feijie;MA Jianfeng. Wireless network access selection method with the non-cooperative game [J]. J4, 2014, 41(5): 98-104.
[5]	GAI Bingshuai;WANG Jinlin;LIU Xue. Service-related data sampling methodology [J]. J4, 2013, 40(2): 54-59+158.
[6]	WANG Lei;SHI Ya;JI Hongbing. Specific radar emitter identification using multiset canonical correlation analysis [J]. J4, 2013, 40(2): 164-171.
[7]	CHEN Chang-hong;ZHAO Heng;LIANG Ji-min;JIAO Li-cheng. Influence of feature selection on FHMM [J]. J4, 2010, 37(5): 934-940.
[8]	HAN Wei-zhan;ZHANG Si-dong;SUN Yu. Research on and evaluation of the reliability of a communication network management and control system [J]. J4, 2008, 35(1): 133-139.
[9]	LI Tong-yan; LI Xing-ming. An efficient method for association rules mined in telecommunication alarm correlation analysis [J]. J4, 2007, 34(7): 39-42.
[10]	LUO Feng;DUAN Pei-pei;WU Shun-jun. Research on short sequence power spectrum estimates based on the Burg algorithm [J]. J4, 2005, 32(5): 724-728.
[11]	SHEN Zhong;CHANG Yi-lin;ZHANG Xin. A cluster maintenance method for self-organized network management [J]. J4, 2005, 32(5): 762-767.
[12]	LIU Fu-jie;CHANG Yi-lin;SHEN Zhong;ZHANG Xin;LI Song-quan. An implementation method for self-organized network management [J]. J4, 2004, 31(2): 182-185.