True color transfer for dual band image fusion
-
摘要: 针对基于颜色传递的双波段(中波红外、可见光)图像融合时,由于参考图像选择不当,造成的彩色融合图像对比度差、图像边缘细节下降等问题,提出了基于拉普拉斯金字塔分解及对比度可调的色彩传递图像融合算法。对待融合的两幅图像进行拉普拉斯金字塔三级分解,每一级按照不同的融合规则进行融合,以重构后的灰度融合图像作为融合结构的亮度分量Y,将可见光与红外图像的差值图像作为U分量,以红外图像为V分量。在颜色传递公式中,加入可调的比例系数,通过适当调节比例系数可调节融合图像的对比度。实验结果表明,获得的融合图像较好地保留了可见光图像的细节,既突出了红外目标同时又具有参考图像的颜色特征。图像评价结果表明,融合图像的均值、方差、熵等评价指标均得到较大提高。Abstract: Because of the inappropriate choose of reference image, double band(midwave infrared and visible) color fusion image based on the color transfer method has low contrast, decreasing image edge details and the infrared target is not prominent. We present a new algorithm based on the Laplacian Pyramid, and the contrast could be adjusted anywhere. We use the Laplacian reconstructed image as the luminance component of the YUV image fusion constructure, the differential image of visible image and infrared image as the U component, and the infrared image as the V component. In the color transfer formula, the adjustable scaling factor is brought in to adjust the contrast of fusion image. Experiments show that by using the improved method, the color fusion image retains meaningful details. The infrared target is prominent and the fusion image has similar color distribution with the reference image. We evaluate the quality of fusion image by using objective methods, and the result shows that evaluation indexes such as the mean, variance, entropy, average gradient and spatial frequency are improved.
-
Key words:
- color image fusion /
- laplacian pyramid /
- color transfer /
- quality evaluation
-
[1] 陈浩,王延杰. 基于小波变换的图像融合技术研究[J]. 微电子学与计算机,2010,27(5):39-41. CHEN H,WANG Y J. Study for image fusion based on wavelet transform[J]. Microelectronics Computer,2010,27(5):39-41.(in Chinese) [2] 傅瑶,孙雪晨,薛旭成,等. 基于非下采样轮廓波变换的全色图像与多光谱图像融合方法研究[J]. 液晶与显示,2013,28(3):429-434. FU Y,SUN X CH,XUE X CH,et al.. Panchromatic and multispectral image fusion method based on nonsubsampled contourlet transform[J]. Chinese J. Liquid Crystals and Displays,2013,28(3):429-434.(in Chinese) [3] 王安宙,张智杰,余徽,等. 基于亮度对比度传递的红外与可见光图像融合方法研究[J]. 光学与光电技术,2013,11(6):7-10. WANG A ZH,ZHANG ZH J,YU H,et al.. Research on the image fusion algorithm based on brightness-contrast transfer[J]. Optics Optoelectronic Technology,2013,11(6):7-10.(in Chinese) [4] 赵飞翔,陶忠祥. 基于小波包变换的红外与可见光图像融合[J]. 光学与光电技术,2013,11(6):11-14. ZHAO F X,TAO ZH X. Fusion algorithm of infrared and visible images based on wavelet packet transform[J]. Optics Optoelectronic Technology,2013,11(6):11-14.(in Chinese) [5] OZDARICI A,AKYUREK Z. Evaluation of image fusion methods on agricultural lands[J]. J. Earth Science and Engineering,2011,1:107-113. [6] 倪国强,肖蔓君,秦庆旺. 近自然彩色图像融合算法及其实时处理系统的发展[J]. 光学学报,2007,27(12):2101-2109. NI G Q,XIAO M J,QIN Q W.Development of near nature color image fusion algorithms and real-time image fusion system[J]. Acta Optica Sinica,2007,27(12):2101-2109.(in Chinese) [7] TOET A,WALRAVEN J. New false color mapping for imaging fusion[J]. Opt. Engng,1996,35(3):650-658. [8] MAARTEN A. Hogervorst and Alexander Toet.Method for applying daytime colors to nighttime imagery in realtime[J]. SPIE,2008,6974:697403. [9] 李光鑫,吴伟平,胡君. 红外和彩色可见光图像亮度-对比度传递融合算法[J]. 中国光学,2011,4(2):161-168. LI G X,WU W P,HU J. Luminance-contrast transfer based fusion algorithm for infrared and color visible images[J]. Chinese Optics,2011,4(2):161-168.(in Chinese) [10] 陈小林,王延杰. 非下采样变换的红外与可见光图像融合[J]. 中国光学,2011,4(5):489-496. CHEN X L,WANG Y J.Infrared and visible image fusion based on nonsubsampled Contourlet transform[J]. Chinese Optics,2011,4(5):489-496.(in Chinese) [11] BURT P J,ADELSON E H. The Laplacian pyramid as a compact image code[J]. IEEE,1983,COM-31(4):532-540. [12] 楚恒,朱维乐. 基于DCT变换的图像融合方法研究[J]. 光学 精密工程,2006,14(2):266-273. CHU H,ZHU W L. Image fusion algorithms using discrete cosine transform[J]. Opt. Precision Eng.,2006,14(2):266-273.(in Chinese) [13] 宋江山,徐建国,司书春. 改进的曲波变换图像融合方法[J]. 中国光学与应用光学,2009,2(2):145-149. SONG J SH,XU J G,SI SH CH. Improved image fusion method based on curvelet transform[J]. Chinese J. Opt. Appl. Optics,2009,2(2):145-149.(in Chinese) [14] 武治国,王延杰,李桂菊. 应用小波变换的自适应脉冲耦合神经网络在图像融合中的应用[J]. 光学 精密工程,2010,18(3):708-715. WU ZH G,WANG Y J,LI G J. Application of adaptive PCNN based on wavelet transform to image fusion[J]. Opt. Precision Eng.,2010,18(3):708-715.(in Chinese) [15] 金伟其,王岭雪. 夜视图像的彩色融合技术及其进展[J]. 红外技术,2003,25(1):6-12. JIN W Q,WANG L X. Color fusion technology for night vision imaging and its progress[J]. Infrared Technology,2003,25(1):6-12.(in Chinese) [16] SAHU D K,PARSAI M P. Different image fusion techniques a critical review[J]. 2012,2(5):4298-4301. [17] 李光鑫,徐抒岩. 适于图像融合的快速颜色传递方法[J]. 光学 精密工程,2009,17(9):2301-2310. LI G X,XU SH Y. Fast color transfer method for image fusion[J]. Opt. Precision Eng.,2009,17(9):2301-2310.(in Chinese) [18] HOGERVORST M A,TOET A. Fast natural color mapping for night-time imagery[J]. Information Fusion,2010,11:69-77. [19] 裴闯,蒋晓瑜,等. 自然彩色化双通道实时图像融合系统[J]. 光学 精密工程,2013,21(5):1333-1339. PEI CH,JIANG X Y. Dual-channel real-time image fusion system with nature color[J]. Opt. Precision Eng.,2013,21(5):1333-1339.(in Chinese) [20] DESHMUKH M,BHOSALE U. Image fusion and image quality assessment of fused images[J]. International J. Image Processing(JIP),2010,4(5):484-508. [21] 张小凤. 可见光和红外图像融合质量评价研究 [D].武汉:华中科技大学,2005. ZHAO X F. Quality evaluation research of visible and infrared image fusion [D]. Wuhan:Huazhong University of Science and Technology,2005.(in Chinese)
点击查看大图
计量
- 文章访问数: 2095
- HTML全文浏览量: 555
- PDF下载量: 740
- 被引次数: 0