［1］ Marinho J, Monteiro E. Cognitive Radio: Survey on Communication Protocols, Spectrum Decision Issues, and Future Research Directions［J］. Wireless Networks, 2012, 18(2): 147-164.
［2］ Mitola J, Maguire Jr G Q. Cognitive Radio: Making Software Radios More Personal［J］. IEEE Personal Communications, 1999, 6(4): 13-18.
［3］ Tragos E Z, Zeadally S, Fragkiadakis A G, et al. Spectrum Assignment in Cognitive Radio Networks: a Comprehensive Survey［J］. IEEE Communications Surveys and Tutorials, 2013, 15(3): 1108-1135.
［4］ Gavrilovska L, Atanasovski V, Macaluso I, et al. Learning and Reasoning in Cognitive Radio Networks［J］. IEEE Communications Surveys ＆ Tutorials, 2013, 15(4): 1761-1777.
［5］ Xu Y, Wang J, Wu Q, et al. Opportunistic Spectrum Access in Unknown Dynamic Environment: a Game-theoretic Stochastic Learning Solution［J］. IEEE Wireless Communications, 2012, 11(4): 1380-1391.
［6］ Chen Z, Qiu R C. Q-learning Based Bidding Algorithm for Spectrum Auction in Cognitive Radio［C］//Proceedings of IEEE Southeastcon. Piscataway: IEEE, 2011: 409-412.
［7］ Liu C B, Jiang H, Yang Y C, et al. Q-learning-based Cross-layer Learning Engine Design for Cognitive Radio Network［C］//Proceedings of SPIE: 8784. Bellingham: SPIE, 2013: 878419.
［8］ Peng J, Li J, Li S, et al. Multi-relay Cooperative Mechanism with Q-learning in Cognitive Radio Multimedia Sensor Networks［C］//Proceedings of the IEEE 10th International Conference on Trust, Security and Privacy in Computing and Communications. Piscataway: IEEE, 2011: 1624-1629.
［9］ Bkassiny M, Li Y, Jayaweera S K. A Survey on Machine-learning Techniques in Cognitive Radios［J］. IEEE Communications Surveys ＆ Tutorials, 2013, 15(3): 1136-1159.
［10］ Rummery G A, Niranjan M. On-line Q-learning Using Connectionist Systems［M］. Cambridge: University of Cambridge, 1994.