一种邻域一致性的NSCT域多传感器图像融合算法

doi:10.3969/j.issn.1001-2400.2010.04.033

Abstract

Abstract:

For the fusion problem of the multi-sensor images of the same scene, a new algorithm is proposed based on neighbor energy and variance in the nonsubsampled Contourlet transform (NSCT) domain. Source images are firstly decomposed in the NSCT domain. For low frequency sub-band coefficients selection, the decision value of variance and energy based on neighbor variance and average neighbor energy is constructed for each pixel, and the rule based on the maximum of the decision value is adopted, so as to keep both image luminance and image details. For band-pass directional sub-band coefficients selection, the rule of maximum neighbor energy is used to keep more edge information. Finally the fused image is obtained through inverse transform. The algorithm has been used to merge multi-focus images and also infrared and visible light images. Experimental results indicate that the proposed method avoids the introduction of artifacts, with better edge details and luminance information, so that the fused image has a better subjective visual effect and objective evaluation criteria.

Key words: multi-sensor, image fusion, neighbor energy, decision value, nonsubsampled Contourlet transform

HUO Guan-ying;LI Qing-wu;SHI Dan. Multi-sensor image fusion algorithm considering neighborhood consistency in the nonsubsampled contourlet transform domain[J].J4, 2010, 37(4): 770-776.

References

[1] Hall D L, Linas J. An Introduction to Multisensor Data Fusion [J]. Proceedings of the IEEE, 1997, 85(10): 6-23.
[2] Toet A, Ruyven L V, Velaton J. Merging Thermal and Visual Images By a Contrast Pyramid [J]. Optical Engineering, 1989, 28(7): 789-792.
[3] 晁锐, 张科, 李言俊. 一种基于小波变换的图像融合算法[J]. 电子学报, 2004, 32(5): 750-753.
Chao Rui, Zhang Ke, Li Yanjun. An Image Fusion Algorithm Using Wavelet Transform[J]. Acta Electronica Sinica, 2004, 32(5): 750-753.
[4] 杨晓慧, 金海燕, 焦李成. 基于DT-CWT的红外与可见光图像自适应融合[J]. 红外与毫米波学报, 2007, 26(6): 419-424.
Yang Xiaohui, Jin Haiyan, Jiao Licheng. Adaptive Image Fusion Algorithm for Infrared and Visible Light Images Based on DT-CWT[J]. J Infrared Millim Waves, 2007, 26(6): 419-424.
[5] 那彦, 杨万海, 史林. 基于成像机理的遥感图像融合[J]. 西安电子科技大学学报, 2004, 31(4): 608-610.
Na Yan, Yang Wanhai, Shi Lin. Remote Sensing Image Fusion Based on the Imaging Principle[J]. Journal of Xidian University, 2004, 31(4): 608-610.
[6] 焦李成, 谭山. 图像的多尺度几何分析回顾和展望[J]. 电子学报, 2003, 31(12A): 1975-1981.
Jiao Licheng, Tan Shan. Development and Prospect of Image Multiscale Geometric Analysis[J]. Acta Electronic Sinica, 2003, 31(12A): 1975-1981.
[7] Do M N, Vetterli M. The Coutourlet transform: an Efficient Directional Multiresolution Image Representation[J]. IEEE Trans on Image Processing, 2005, 14(12): 2091-2106.
[8] 才溪, 赵巍. Contourlet变换低通滤波器对图像融合算法影响的讨论[J]. 自动化学报, 2009, 35(3): 258-266.
Cai Xi, Zhao Wei. Discussion Upon Effects of Contourlet Lowpass Filter on Contourlet-based Image Fusion Algorithms[J]. Acta Automatica Sinica, 2009, 35(3): 258-266.
[9] 张强, 郭宝龙. 基于非采样Contourlet变换多传感器图像融合算法[J]. 自动化学报, 2008, 34(2): 135-141.
Zhang Qiang, Guo Baolong. Fusion of Multi-sensor Images Based on the Nonsubsampled Contourlet Transform[J]. Acta Automatica Sinica, 2008, 34(2): 135-141.
[10] 叶传奇, 苗启广, 王宝树. 基于非子采样Contourlet变换的图像融合方法[J]. 计算机辅助设计与图形学学报, 2007, 19(10): 1274-1278.
Ye Chuanqi, Miao Qiguang, Wang Baoshu. Image Fusion Method Based on the Nonsubsampled Contourlet Transform[J]. Journal of Computer-Aided Design & Computer Graphics, 2007, 19(10): 1274-1278.
[11] 叶传奇, 王宝树, 苗启广. 基于NSCT变换的红外与可见光图像融合算法[J]. 系统工程与电子技术, 2008, 30(4): 593-596.
Ye Chuanqi, Wang Baoshu, Miao Qiguang. Fusion Algorithm of Infrared and Visible Light Images Based on NSCT Transform[J]. Systems Engineering and Electronics, 2008, 30(4): 593-596.
[12] 张强, 郭宝龙. 一种基于Curvelet变换多传感器图像融合算法[J]. 光电子·激光, 2006, 17(9): 1123-1127.
Zhang Qiang, Guo Baolong. Fusion of Multisensor Images Based on the Curvelet Transform[J]. Journal of Optoelectronics Laser, 2006, 17(9): 1123-1127.
[13] 杨镠, 郭宝龙, 倪伟. 基于区域特性的Contourlet域多聚焦图像融合算法[J]. 西安交通大学学报, 2007, 41(4): 448-452.
Yang Liu, Guo Baolong, Ni Wei. Multi-focus Image Fusion Algorithm Based on Region Statistics in Contourlet Domain[J]. Journal of Xi'an Jiaotong University, 2007, 41(4): 448-452.
[14] Burt P J, Kolczynski R J. Enhanced Image Capture through Fusion[C]//Proceedings 4th International Conference on Computer Vision. Berlin: PICCV, 1993: 173-182.
[15] Cunha A L, Zhou J, Do M N. The Nonsubsampled Contourlet Transform: Theory, Design, and Applications[J]. IEEE Trans on Image Processing, 2006, 15(10): 3089-3101.
[16] Xydeas C S, Petrovic V. Objective Image Fusion Performance Measure[J]. Electronics Letters, 2000, 36(4): 308-309.

Multi-sensor image fusion algorithm considering neighborhood consistency in the nonsubsampled contourlet transform domain

PDF (PC)

Like

Knowledge

Cited

Abstract

Cite this article

share this article

References

Related Articles 15

Metrics

Comments

Recommended 0

[1]	LI Jiawei,JIANG Jing,WU Weihua,ZHENG Yujun. Maximum likelihood registration for systemic error based on statistical linear regression [J]. Journal of Xidian University, 2021, 48(4): 73-82.
[2]	LU Liping,ZHANG Xiaoqian. Datafusion method of multi-sensor target recognition in complex environment [J]. Journal of Xidian University, 2020, 47(4): 31-38.
[3]	HUANG Zhangqin,MU Zhao,CEN Chen,GAO Han. 360-degree real-time stitching technology for multi-channel video [J]. Journal of Xidian University, 2020, 47(2): 1-8.
[4]	YANG Xiaoli,LIN Suzhen. Method for multi-band image feature-level fusion based on the attention mechanism [J]. Journal of Xidian University, 2020, 47(1): 120-127.
[5]	BAO Wanting,WANG Junping,WEI Shulei,LI Yanbo,ZHOU Yong. Novel image defogging algorithm for sky region segmentation correction [J]. Journal of Xidian University, 2019, 46(2): 164-169.
[6]	YI Xiang,WANG Bingjian. Fusion of infrared and visual images guided by visual saliency [J]. Journal of Xidian University, 2019, 46(1): 27-32.
[7]	LI Hong;LIU Fang;ZHANG Kai. Remote sensing image fusion based on sparse non-negative matrix factorization [J]. Journal of Xidian University, 2016, 43(2): 193-198.
[8]	LIU Fan;ZHANG Kai;JIAO Licheng;YANG Shuyuan. Novel Pan-sharpening method via an optimal intensity component [J]. J4, 2014, 41(6): 45-50.
[9]	LI Jin;WANG Junping;WAN Guoting;LI Ziyang;XU Dan;CAO Honghua;ZHANG Guangyan. Novel algorithm for image enhancement with histogram equalization and MSRCR [J]. J4, 2014, 41(3): 103-109.
[10]	XU Ran;LI Yachao;XING Mengdao. Wide angle SAR imaging via sparse non-negative matrix factorization [J]. J4, 2014, 41(3): 49-55.
[11]	YONG Xiaoju;FANG Yangwang;GAO Xiang;YANG Pengfei. Time registration using the curve fitting algorithm of the adaptive changed length moving window [J]. J4, 2014, 41(3): 209-213.
[12]	YANG Zhenping;NIU Haijun;DING Lei. New image super-resolution restoration method by NSCT [J]. J4, 2012, 39(1): 34-37+85.
[13]	NING Beijia;JI Feng;GAO Xinbo. Fast super-resolution reconstruction algorithms for multi-frame images with random shifts [J]. J4, 2012, 39(1): 105-110.
[14]	CUI Lingling;LU Zhaoyang;LI Jing;LI Yihong. Novel algorithm for automated detection of fabric defect images [J]. J4, 2011, 38(5): 65-72.
[15]	YAN Chunman；GUO Baolong；YANG Xiuhong. High efficiency algorithm with antinoise properties for multi-focus image fusion [J]. J4, 2011, 38(3): 63-68.