Sep. 2016

Article Contents

Chinese Optics> 2016> 9(5): 523-531.

CHEN Qing-jiang, ZHANG Yan-bo, CHAI Yu-zhou, WEI Bing-zhe. Fusion of infrared and visible images based on finite discrete shearlet domain[J]. Chinese Optics, 2016, 9(5): 523-531. doi: 10.3788/CO.20160905.0523

Citation:

CHEN Qing-jiang, ZHANG Yan-bo, CHAI Yu-zhou, WEI Bing-zhe. Fusion of infrared and visible images based on finite discrete shearlet domain[J].Chinese Optics, 2016, 9(5): 523-531.doi:10.3788/CO.20160905.0523

Citation:

CHEN Qing-jiang, ZHANG Yan-bo, CHAI Yu-zhou, WEI Bing-zhe. Fusion of infrared and visible images based on finite discrete shearlet domain[J].Chinese Optics, 2016, 9(5): 523-531.doi:10.3788/CO.20160905.0523

PDF( 1443 KB)

Fusion of infrared and visible images based on finite discrete shearlet domain

doi:10.3788/CO.20160905.0523

College of Science, Xi'an University of Architecture and Technology, Xi'an 710055, China

Funds:

Shaanxi Provincial Natural Science Foundation of China2015JM1024

Shaanxi Provincial Natural Science Foundation of China2013JK0568

More Information

Corresponding author:E-mail:qjchen66xytu@126.com
Received Date:18 Apr 2016
Rev Recd Date:11 May 2016
Publish Date:01 Oct 2016

Abstract

Abstract

Aiming at the deficiency of the current image fusion process, combining with good directional sensitivity and parabolic scaling properties of Finite Discrete Shearlet Transform(FDST), a new image fusion algorithm based on FDST is proposed. Firstly, the registration multi sensing images are decomposed by FDST, and the low frequency sub-band coefficients and high frequency sub-band coefficients of different scales and directions are obtained. The fusion principle of low frequency sub-band coefficients is based on the method of combining the differences between global attribute and each pixel with region spatial frequency matching degree. As for high frequency sub-band coefficients, sum of the directional weight contrast can be adopted as the fusion rule, which combines with the relative region average gradient and relative region variance. Finally, the low frequency information and high frequency information are reconstructed to image by Finite Discrete Shearlet Inverse Transform. The results indicate that the algorithm proposed in this paper has a good subjective visual effect, and its quality indexes has been increased averagely by 0.9%、3.8%、3.1%, 2.6%、3.8%、2.9% and 1.5%、125%、59% respectively compared with other fusion algorithms, which shows that the algorithm is superior to other fusion algorithms.
- image fusion,
- finite discrete shearlet,
- contrast,
- regional average gradient,
- shift-invariant

FullText(HTML)

References (18)

References

[1]	杨桄, 童涛, 陆松岩, 等.基于多特征的红外与可见光图像融合[J].光学精密工程, 2014, 22(2):489-496. http://www.cnki.com.cn/Article/CJFDTOTAL-GXJM201402034.htm YANG G, TONG T, SONG-YAN L U, et al..Fusion of infra-red and visible images based on multi-features[J].Optics & Precision Engineering, 2014, 22(2):489-496.(in Chinese) http://www.cnki.com.cn/Article/CJFDTOTAL-GXJM201402034.htm
[2]	MEHRA I, NISHCHAL N K.Wavelet-based image fusion for securing multiple images through asymmetric keys[J].Optics Communications, 2015, 335:153-160. doi:10.1016/j.optcom.2014.09.040
[3]	ZHANG H, CAO X.A way of image fusion based on wavelet transform[C].2013 IEEE 9th International Conference on Mobile Ad-hoc and Sensor Networks, IEEE Computer Society, 2013:498-501.
[4]	CHENG J, LIU H, LIU T, et al..Remote sensing image fusion via wavelet transform and sparse represent-tation[J].Isprs J.Photogrammetry & Remote Sensing, 2015, 104:158 173.
[5]	YANG Y.Multimodal medical image fusion through a new DWT based technique[C].2010 4th International Conference on Bioinformatics and Biomedical Engineering(iCBBE), IEEE, 2010:1-4.
[6]	WANG X, LIU Q, WANG R, et al..Natural image statistics based 3D reduced reference image quality assessment in contourlet domain[J].Neurocomputing, 2015, 151:683 691. doi:10.1016/j.neucom.2014.05.090
[7]	杨粤涛, 朱明, 贺柏根, 等.采用改进投影梯度非负矩阵分解和非采样Contourlet变换的图像融合方法[J].光学精密工程, 2011, 19(5):1143-1150. doi:10.3788/OPE. YANG Y T, ZHU M, HE B G, et al..Fusion algori-thm based on improved projected gradient NMF and NSCT[J].Opt.Precision Eng., 2011, 19(5):1143-1150.(in Chinese) doi:10.3788/OPE.
[8]	陈小林, 王延杰.非下采样变换的红外与可见光图像融合[J].中国光学, 2011, 4(5):489-496. //www.illord.com/CN/abstract/abstract8724.shtml CHEN X L, WANG Y J.Infrared and visible image fusion based on nonsubsampled Contourlet transform[J].Chinese Optics, 2011, 04(5):489-496.(in Chinese) //www.illord.com/CN/abstract/abstract8724.shtml
[9]	张蕾, 金龙旭, 韩双丽, 等.采用非采样Contourlet变换与区域分类的红外和可见光图像融合[J].光学精密工程, 2015, 23(3):810-818. http://www.cnki.com.cn/Article/CJFDTOTAL-GXJM201503027.htm ZHANG L, JIN L X, HAN SH L, et al..Fusion of infrared and visual images based on non-sampled contourlet transform and region classification[J].Optics Communications, 2015, 23(3):810-818.(in Chinese) http://www.cnki.com.cn/Article/CJFDTOTAL-GXJM201503027.htm
[10]	RANGASWAMY Y, RAJA K B, VENUGOPAL K R.FRDF:face recognition using fusion of DTCWT and FFT features[J].Procedia Computer Science, 2015, 54:809-817. doi:10.1016/j.procs.2015.06.095
[11]	陈贞, 邢笑雪.基于非下采样Shearlet变换与压缩感知的图像融合[J].液晶与显示, 2015(6):1024-1031. http://www.cnki.com.cn/Article/CJFDTOTAL-YJYS201506020.htm CHEN ZH, XING X X.Image fusion algorithm based on non-subsampled Shearlet transform and compressed sensing[J].2015, 30(6):1024-1031.(in Chinese) http://www.cnki.com.cn/Article/CJFDTOTAL-YJYS201506020.htm
[12]	HAUSER S, STEIDL G.Convex multiclass segmentation with shearlet regularization[J].International J.Computer Mathematics, 2013, 90(1/2):62-81. http://www.researchgate.net/publication/51962975_Convex_Multiclass_Segmentation_with_Shearlet_Regularization
[13]	蒲恬, 方庆喆, 倪国强.基于对比度的多分辨率图像融合[J].电子学报, 2000, 12:116-118. http://www.cnki.com.cn/article/cjfdtotal-dzxu200012035.htm PU T, FANG Q ZH, NI G Q.Contrast-based multiresolution image fusion[J].Acta Electronica Sinica, 2000, 12:116-118.(in Chinese) http://www.cnki.com.cn/article/cjfdtotal-dzxu200012035.htm
[14]	ZHAO CH H, GUO Y T, WANG Y L.A fast fusion scheme for infrared and visible light images in NSCT domain[J].Infrared Physics and Technology, 2015, 72:266-275. doi:10.1016/j.infrared.2015.07.026
[15]	LIU X, ZHOU Y, WANG J.Image fusion based on Shearlet transform and regional features[J].AEU-International J.Electronics and Communications, 2013, 68(6):471-477.
[16]	石智, 张卓, 岳彦刚.基于Shearlet变换的自适应图像融合算法[J].光子学报, 2013, 42(1):115-120. doi:10.3788/gzxb SHI ZH, ZHANG ZH, YUE Y G.Adaptive image fusion algorithm based on shearlet transform[J].Acta Photonica Sinica, 2013, 42(1):115-120.(in Chinese) doi:10.3788/gzxb
[17]	徐小军, 王友仁, 陈帅.基于下采样分数阶小波变换的图像融合新方法[J].仪器仪表学报, 2014(9):2061-2069. http://www.cnki.com.cn/Article/CJFDTOTAL-YQXB201409018.htm XU X J, WANG Y R, CHEN SH.Novel image fusion method based on downsampling fractional wavelet transform[J].Chinese J.Scientific Instrument, 2014(9):2061-2069.(in Chinese) http://www.cnki.com.cn/Article/CJFDTOTAL-YQXB201409018.htm
[18]	陈广秋, 高印寒, 刘广文, 等.有限离散剪切波域结合区域客观评价的图像融合[J].吉林大学学报(工学版), 2014, 44 (6):1849-18 59. http://www.cnki.com.cn/Article/CJFDTOTAL-JLGY201406049.htm CHEN G Q, GAO Y H, LIU G W, et al..Image fusion based on area objective assessment in finite discrete shearlet transform domain[J].J.Jilin University(Engineering and Techonlogy Edition), 2014, 44(6):1849-1859.(in Chinese) http://www.cnki.com.cn/Article/CJFDTOTAL-JLGY201406049.htm