CNN-Transformer轻量级智能调制识别算法

doi:10.19665/j.issn1001-2400.2023.03.004

西安电子科技大学学报 ›› 2023, Vol. 50 ›› Issue (3): 40-49.doi: 10.19665/j.issn1001-2400.2023.03.004

• 面向IT3.0的感通算融合6G关键技术专题 • 上一篇下一篇

CNN-Transformer轻量级智能调制识别算法

杨静雅^1,^2,³(),齐彦丽^1,^2,³(),周一青^1,^2,³(),赵登攀⁴(),王尚权^1,^2,³(),石晶林^1,^2,³()

1.中国科学院计算技术研究所处理器芯片全国重点实验室,北京 100190
2.中国科学院大学计算机科学与技术学院,北京 100049
3.中国科学院计算技术研究所移动计算与新型终端北京市重点实验室,北京 100190
4.中国人民解放军77646部队,西藏自治区日喀则 858600

收稿日期:2022-12-16 出版日期:2023-06-20 发布日期:2023-10-13
通讯作者: 周一青
作者简介:杨静雅(1995—),女,中国科学院计算技术研究所博士研究生,E-mail:yangjingya19b@ict.ac.cn；|齐彦丽(1991—),女,助理研究员,E-mail:qiyanli@ict.ac.cn；|赵登攀(1982—),男,中国人民解放军77646部队,E-mail:375914615@qq.com；|王尚权(2000—),男,中国科学院计算技术研究所硕士研究生,E-mail:13207502540@163.com；|石晶林(1972—),男,研究员,E-mail:sjl@ict.ac.cn
基金资助:
国家重点研发计划(2020YFB1807800)

Algorithm for recognition of lightweight intelligent modulation based on the CNN-transformer networks

YANG Jingya^1,^2,³(),QI Yanli^1,^2,³(),ZHOU Yiqing^1,^2,³(),ZHAO Dengpan⁴(),WANG Shangquan^1,^2,³(),SHI Jinglin^1,^2,³()

1. State Key Lab of Processors,Institute of Computing Technology,Chinese Academy of Sciences,Beijing 100190,China
2. School of Computer Science and Technology,University of Chinese Academy of Sciences,Beijing 100049,China
3. Beijing Key Laboratory of Mobile Computing and Pervasive Device,Institute of Computing Technology, Chinese Academy of Sciences,Beijing 100190,China
4. Unit 77646 of PLA,Shigatse 858600,China

Received:2022-12-16 Online:2023-06-20 Published:2023-10-13
Contact: Yiqing ZHOU

摘要/Abstract

摘要：

现有基于深度学习的调制识别方法,当存在噪声及不确定信道干扰影响时识别率较低,同时由于模型参数量大,难以直接应用到移动终端。针对该问题,提出一种基于卷积神经网络(CNN)和Transformer的轻量级智能调制识别方法。该方法首先利用卷积神经网络对信号进行局部信息特征提取,然后利用卷积神经网络通道注意力和Transformer时域注意力模块分别从信号的通道和时域两个维度关注最有利于识别的特征,降低信道或噪声等的影响,以提升识别率。所提方法可以适应多种信号表征,如原始IQ信号、幅度相位信号及变换域特征。仿真表明,在RadioML2016.10b数据集上,相较现有基于卷积神经网络的方法,所提方法的平均识别率提升了约8%~12%,相比基于残差神经网络和长短时记忆网络的方法,参数量降低了约90%~92%,计算量降低了约83%~93%。实验结果验证了所提方法增加模型分类精度的同时,有效地降低了模型的参数量和计算量。

关键词: 调制识别, 通道注意力, 时域注意力, 轻量级网络

Abstract:

Existing modulation recognition methods based on deep learning have the problems of low recognition accuracy under the influence of noise and uncertain channel interference,and are difficult to apply to mobile terminals due to a large number of parameters.This paper proposes a lightweight modulation recognition method based on the Convolutional Neural Network (CNN) and Transformer to solve the above problems.In order to improve the accuracy,the CNN is first used to extract the local features of the signal.Then,the CNN-based channel attention and Transformer-based temporal attention modules are used to focus on the features that are most conducive to recognition from the two dimensions of the signal channel and time domain,respectively,while reducing the impact of the channel,noise,etc.The proposed method can be applied to a variety of signal representations,such as raw IQ signals,amplitude-phase signals,and transform domain features.Simulation shows that on the RadioML2016.10b dataset,compared with the existing convolutional network methods,the average recognition accuracy of the proposed method is increased by 8%~12%.Compared with the methods based on the residual neural network and long-term memory network,the number of parameters is reduced by 90%~92%,and the amount of calculation is reduced by about 83%~93%.Experimental results show that the proposed method can improve the accuracy of model classification while effectively reducing the number of parameters and the amount of calculation.

Key words: modulation recognition, channel attention, temporal attention, lightweight network

中图分类号:

TN911.7

杨静雅,齐彦丽,周一青,赵登攀,王尚权,石晶林. CNN-Transformer轻量级智能调制识别算法[J]. 西安电子科技大学学报, 2023, 50(3): 40-49.

YANG Jingya,QI Yanli,ZHOU Yiqing,ZHAO Dengpan,WANG Shangquan,SHI Jinglin. Algorithm for recognition of lightweight intelligent modulation based on the CNN-transformer networks[J]. Journal of Xidian University, 2023, 50(3): 40-49.

图/表 12

图1

图2

图3

图4

图5

图6

图7

图8

图9

图10

图11

表1

参考文献 36

[1]	LIU L, ZHOU Y Q, YUAN J H, et al. Economically Optimal MS Association for Multimedia Content Delivery in Cache-Enabled Heterogeneous Cloud Radio Access Networks[J]. IEEE Journal on Selected Areas in Communications, 2019, 37(3):1584-1593. doi: 10.1109/JSAC.49
[2]	LIU L, ZHOU Y Q, ZHUANG W H, et al. Tractable Coverage Analysis for Hexagonal Macrocell-Based Heterogeneous UDNs with Adaptive Interference Aware CoMP[J]. IEEE Transactions on Wireless Communications, 2019, 18(1):503-517. doi: 10.1109/TWC.2018.2882434
[3]	ZHOU Y Q, LIU H, PAN Z G, et al. Cooperative Multicast with Location Aware Distributed Mobile Relay Selection:Performance Analysis and Optimized Design[J]. IEEE Transactions on Vehicular Technology, 2017, 66(9):8291-8302. doi: 10.1109/TVT.2017.2682903
[4]	ZHOU Y Q, LIU H, PAN Z G, et al. Energy Efficient Two-stage Cooperative Multicast Based on Device to Device Transmissions:Effect of User Density[J]. IEEE Transactions on Vehicular Technology, 2016, 65(9):7297-7307. doi: 10.1109/TVT.2015.2494066
[5]	GONG S Q, XING C W, LIU H, et al. Hardware-Impaired RIS-Assisted mmWave Hybrid Systems:Beamforming Design and Performance Analysis[J]. IEEE Transactions on Communications, 2023, 71(4):2317-2334. doi: 10.1109/TCOMM.2023.3241328
[6]	ZHAO Z X, DU Q H, KARAGIANNIDIS G K, et al. Improved Grant-Free Access for URLLC via Multi-Tier-Driven Computing:Network-Load Learning,Prediction,and Resource Allocation[J]. IEEE Journal on Selected Areas in Communications, 2023, 41(3):607-622. doi: 10.1109/JSAC.2023.3234696
[7]	GONG S Q, XING C W, WANG S, et al. Throughput Maximization for Intelligent Reflecting Surface Aided MIMO WPCNs with Different DL/UL Reflection Patterns[J]. IEEE Transactions on Signal Processing, 2021, 69:2706-2724. doi: 10.1109/TSP.2021.3073813
[8]	GONG S Q, XING C W,K. LAU V N, et al. Majorization-Minimization Aided Hybrid Transceivers for MIMO Interference Channels[J]. IEEE Transactions on Signal Processing, 2020, 68:4903-4918. doi: 10.1109/TSP.78
[9]	DU Q H, SONG H B, ZHU X J. Social-Feature Enabled Communications Among Devices Toward the Smart IoT Community[J]. IEEE Communications Magazine, 2019, 57(1):130-137.
[10]	ZHANG Z Q, XIAO Y, MA Z, et al. 6G Wireless Networks:Vision,Requirements,Architecture,and Key Technologies[J]. IEEE Vehicular Technology Magazine, 2019, 14(3):28-41.
[11]	ZHOU Y Q, LIU L, WANG L, et al. Service-Aware 6G:An Intelligent and Open Network Based on the Convergence of Communication,Computing and Caching[J]. Digital Communications and Networks, 2020, 6(3):253-260. doi: 10.1016/j.dcan.2020.05.003
[12]	于浩洋, 尹良, 李书芳. 生成对抗网络小样本雷达调制信号识别算法[J]. 西安电子科技大学学报, 2021, 48(6):96-104.
	YU Haoyang, YIN Liang, LI Shufang, et al. Recognition Algorithm for the Little Sample Radar Modulation Signal Based on the Generative Adversarial Network[J]. Journal of Xidian University, 2021, 48(6):96-104.
[13]	GHASEMZADEH P, BANERJEE S, HEMPEL M, et al. A Novel Deep Learning and Polar Transformation Framework for an Adaptive Automatic Modulation Classification[J]. IEEE Transactions on Vehicular Technology, 2020, 69(11):13243-13258. doi: 10.1109/TVT.25
[14]	XU J L, SU W, ZHOU M C. Software-Defined Radio Equipped with Rapid Modulation Recognition[J]. IEEE Transactions on Vehicular Technology, 2010, 59(4):1659-1667. doi: 10.1109/TVT.2010.2041805
[15]	XU J L, SU W, ZHOU M C. Likelihood-Ratio Approaches to Automatic Modulation Classification[J]. IEEE Transactions on Systems,Man,and Cybernetics,Part C (Applications and Reviews), 2010, 41(4):455-469. doi: 10.1109/TSMCC.2010.2076347
[16]	HUANG S, LIN C S, XU W J, et al. Identification of Active Attacks in Internet of Things:Joint Model-and Data-Driven Automatic Modulation Classification Approach[J]. IEEE Internet of Things Journal, 2020, 8(3):2051-2065. doi: 10.1109/JIoT.6488907
[17]	WANG Y, GUI G, OHTSUKI T, et al. Multi-Task Learning for Generalized Automatic Modulation Classification Under Non-Gaussian Noise with Varying SNR Conditions[J]. IEEE Transactions on Wireless Communications, 2021, 20(6):3587-3596. doi: 10.1109/TWC.2021.3052222
[18]	DOBRE O A, ABDI A, BAR-NESS Y, et al. Survey of Automatic Modulation Classification Techniques:Classical Approaches and New Trends[J]. IET communications, 2007, 1(2):137-156. doi: 10.1049/iet-com:20050176
[19]	BOUTTE D, SANTHANAM B. A Hybrid ICA-SVM Approach to Continuous Phase Modulation Recognition[J]. IEEE Signal Processing Letters, 2009, 16(5):137-156. doi: 10.1109/LSP.2008.2008948
[20]	PENG S L, SUN S J, YAO Y D. A Survey of Modulation Classification Using Deep Learning:Signal Representation and Data Preprocessing[J]. IEEE Transactions on Neural Networks and Learning Systems, 2022, 33(12):7020-7038. doi: 10.1109/TNNLS.2021.3085433
[21]	O’SHEA T J, HOYDIS J, CLANCY T C. Convolutional Radio Modulation Recognition Networks[C]//International Conference on Engineering Applications of Neural Networks. Heidelberg:Springer, 2016:213-226.
[22]	TU Y, LIN Y, HOU C B, et al. Complex-Valued Networks for Automatic Modulation Classification[J]. IEEE Transactions on Vehicular Technology, 2020, 69(9):137-156.
[23]	O’SHEA T J, ROY T, CLANCY T C. Over the Air Deep Learning Based Radio Signal Classification[J]. IEEE Journal of Selected Topics in Signal Processing, 2018, 12(1):168-179. doi: 10.1109/JSTSP.2018.2797022
[24]	RAJENDRAN S, MEERT W, GIUSTINIANO D, et al. Deep Learning Models for Wireless Signal Classification with Distributed Low-Cost Spectrum Sensors[J]. IEEE Transactions on Cognitive Communications and Networking, 2018, 4(3):433-445. doi: 10.1109/TCCN.2018.2835460
[25]	WEST N E, OSHEA T S. Deep Architectures for Modulation Recognition[C]//2017 IEEE International Symposium on Dynamic Spectrum Access Networks (DySPAN). Piscataway:IEEE, 2017:1-6.
[26]	VASWANI A, SHAZEER N, PARMAR N, et al. Attention is All You Need[C]// Advances in Neural Information Processing Systems(NIPS). San Diego: NIPS, 2017:6000-6010.
[27]	刘文婷, 卢新明. 基于计算机视觉的Transformer研究进展[J]. 计算机工程与应用. 2022, 58(6):1-16. doi: 10.3778/j.issn.1002-8331.2106-0442
	LIU Wenting, LU Xinming. Research Progress of Transformer Based on Computer Vision[J]. Computer Engineering and Applications. 2022, 58(6):1-16. doi: 10.3778/j.issn.1002-8331.2106-0442
[28]	李振星, 赵晓蕾, 刘伟承. 基于Transformer的通信信号调制识别方法[J]. 太赫兹科学与电子信息学报, 2022, 20(12):1311-1317.
	LI Zhenxing, ZHAO Xiaolei, LIU Weicheng, et al. A Modulation Recognition Method of Communication Signal Based on Transformer[J]. Journal of Terahertz Science and Electronic Information Technology, 2022, 20(12):1311-1317.
[29]	CHEN Y T, DONG B H, LIU C T, et al. Abandon Locality:Frame-Wise Embedding Aided Transformer for Automatic Modulation Recognition[J]. IEEE Communications Letters, 2023, 27(1):327-331. doi: 10.1109/LCOMM.2022.3213523
[30]	KONG W S, YANG Q H, JIAO X, et al. A Transformer-Based CTDNN Structure for Automatic Modulation Recognition[C]// 2021 7th International Conference on Computer and Communications.Piscataway:IEEE, 2021:159-163.
[31]	HAMIDI-RAD S, JAIN S. MCformer:A Transformer Based Deep Neural Network for Automatic Modulation Classification[C]//2021 IEEE Global Communications Conference. Piscataway:IEEE, 2021:1-6.
[32]	SU H, FAN X Y, LIU H J. Robust and Efficient Modulation Recognition with Pyramid Signal Transformer[C]//2022 IEEE Global Communications Conference. Piscataway:IEEE, 2022:1868-1874.
[33]	黄思嘉, 杜庆治, 龙华, 等. 幅度与相位分步识别的QAM调制模式识别算法[J]. 通信技术, 2020, 53(2):261-267.
	HUANG Sijia, DU Qingzhi, LONG Hua, et al. QAM Modulation Pattern Recognition Algorithm by Step-by-Step Identification of Amplitude and Phase[J]. Communications technology, 2020, 53(2):261-267.
[34]	WANG C, WANG J, ZHANG X D. Automatic Radar Waveform Recognition Based on Time-Frequency Analysis and Convolutional Neural Network[C]//2017 IEEE nternational Conference on Acoustics,Speech and Signal Processing (ICASSP). Piscataway:IEEE, 2017:2437-2441.
[35]	ZHANG H, ZU K K, LU J, et al. EPSANet:An Efficient Pyramid Squeeze Attention Block on Convolutional Neural Network (2021)[J/OL].[2021-05-30]. https://arxiv.org/abs/2105.14447.
[36]	HU J, SHEN L, SUN G. Squeeze-and-Excitation Networks[C]//IEEE/CVF Conference on Computer Vision and Pattern Recognition. Piscataway:IEEE, 2018:7132-7141.

模型	参数量/KB	Flops/M	识别率/%
CNN2	2 830.0	38.3	57.09
Complex	2 749.0	38.4	59.25
ResNet	150.0	10.6	63.18
LSTM	202.0	25.8	62.82
CLDNN	164.0	13.8	59.30
文中模型	15.2	1.8	64.01

CNN-Transformer轻量级智能调制识别算法

Algorithm for recognition of lightweight intelligent modulation based on the CNN-transformer networks

RichHTML

PDF (PC)

赞

可视化

摘要/Abstract

引用本文

使用本文

图/表 12

参考文献 36

相关文章 6

Metrics

本文评价

推荐阅读 0

[1]	刘博翀, 蔡怀宇, 杨诗远, 李灏天, 汪毅, 陈晓冬. 一种用于自动驾驶场景的轻量级语义分割网络[J]. 西安电子科技大学学报, 2023, 50(1): 118-128.
[2]	刘侍刚,张同,杨建功,葛宝. 递进式空洞残差深度双目立体匹配网络[J]. 西安电子科技大学学报, 2022, 49(5): 175-180.
[3]	刘明骞;李兵兵;石亚云. Alpha稳定分布噪声下数字调制识别新方法[J]. J4, 2015, 42(6): 1-5.
[4]	刘沛;水鹏朗;郭永明;李宁. 用于调制识别的二维累积量特征统计模型[J]. J4, 2014, 41(2): 44-50.
[5]	刘明骞;李兵兵;赵雷. 多径信道下OFDM信号子载波的调制方式识别新方法[J]. J4, 2011, 38(5): 20-26.
[6]	韩钢(1;2);李建东(1);李长乐(1). 自适应OFDM中信号盲检测技术[J]. J4, 2006, 33(4): 602-606.