Joint AIHS and Particle Swarm Optimization for Pan-sharpening

doi:10.11947/j.JGGS.2020.0211

Abstract

Abstract:

Pan-sharpening is a process of obtaining a high spatial and spectral multispectral image (HMS) by combining a low-resolution multispectral image (LMS) with a high-resolution panchromatic image (PAN). In this paper, a pan-sharpening method called PAIHS is proposed, which is based on adaptive intensity-hue-saturation (AIHS) transformation, variational pan-sharpening framework and the two fidelity hypotheses. The suitable objective function is established and optimized by adopting particle swarm optimization (PSO) to obtain the optimal control parameters and minimum value. This value corresponds to the best pan-sharpening quality. The experimental results show that the proposed method has high efficiency and reliability, and the obtained performance index is superior to the four mainstream pan-sharpening methods.

Key words: pan-sharpening; multispectral image; panchromatic image; AIHS transformation; particle swarm optimization; objective function

Yingxia CHEN,Yan CHEN,Cong LIU. Joint AIHS and Particle Swarm Optimization for Pan-sharpening[J]. Journal of Geodesy and Geoinformation Science, 2020, 3(2): 105-113.

Figures/Tables 8

Fig.1

Fig.2

Fig.3

Fig.4

Fig.5

Tab.1

Tab.2

Tab.3

References 26

[1]	EL-MEZOUAR M C, TALEB N, KPALMA K, et al. An IHS-based fusion for color distortion reduction and vegetation enhancement in IKONOS imagery[J]. IEEE Transactions on Geoscience and Remote Sensing, 2011,49(5):1590-1602. doi: 10.1109/TGRS.2010.2087029
[2]	RAHMANI S, STRAIT M, MERKURJEV D, et al. An adaptive IHS Pan-sharpening method[J]. IEEE Geoscience and Remote Sensing Letters, 2010,7(4):746-750. doi: 10.1109/LGRS.2010.2046715
[3]	LABEN C A, BROWER B V. Process for enhancing the spatial resolution of multispectral imagery using Pan-sharpening:USA,6011875[P].2000-01-04.
[4]	LU Xiaochen, ZHANG Junping. Panchromatic and multispectral images fusion based on modified GS-SWT [C]//Proceedings of 2014 IEEE Geoscience and Remote Sensing Symposium. Quebec, Canada:IEEE, 2014: 2530-2533.
[5]	ZHANG Hankui, ROY D P. Computationally inexpensive Landsat 8 operational land imager (OLI) Pan-sharpening[J]. Remote Sensing, 2016,8(3):180. doi: 10.3390/rs8030180
[6]	PARK J H, KIM K O, YANG Y K. Image fusion using multiresolution analysis [C]//Proceedings of 2001 IEEE International Geoscience and Remote Sensing Symposium. Sydney,Australia:IEEE, 2001: 864-866.
[7]	ZHOU J, CIVCO D L, SILANDER J A. A wavelet transform method to merge Landsat TM and SPOT panchromatic data[J]. International Journal of Remote Sensing, 1998,19(4):743-757. doi: 10.1080/014311698215973
[8]	METEALLI M R, NASR A H, FARAGALLAH O S, et al. Efficient Pan-sharpening of satellite images with the contourlet transform[J]. International Journal of Remote Sensing, 2014,35(5):1979-2002. doi: 10.1080/01431161.2013.873832
[9]	AIAZZI B, ALPARONE L, BARONTI S, et al. Context-driven fusion of high spatial and spectral resolution images based on oversampled multiresolution analysis[J]. IEEE Transactions on Geoscience and Remote Sensing, 2002,40(10):2300-2312. doi: 10.1109/TGRS.2002.803623
[10]	MÖLLER M, WITTMAN T, BERTOZZI A L, et al. Avariational approach for sharpening high dimensional images[J]. SIAM Journal on Imaging Sciences, 2012,5(1):150-178. doi: 10.1137/100810356
[11]	BALLESTER C, CASELLES V, IGUAL L, et al. Avariational model for P+XS image fusion[J]. International Journal of Computer Vision, 2006,69(1):43-58. doi: 10.1007/s11263-006-6852-x
[12]	MOELLER M, WITTMAN T, BERTOZZI A L. Variational wavelet Pan-sharpening[J]. IEEE Transactions on Geoscience and Remote Sensing, 2008: 1-9.
[13]	ALY H A, SHARMA G. A regularized model-based optimization framework for Pan-sharpening[J]. IEEE Transactions on Image Processing, 2014,23(6):2596-2608. doi: 10.1109/TIP.2014.2316641
[14]	FANG Faming, LI Fang, SHEN Chaomin, et al. A variational approach for Pan-sharpening[J]. IEEE Transactions on Image Processing, 2013,22(7):2822-2834. doi: 10.1109/TIP.2013.2258355
[15]	MUMTAZ A, MAJID A, MUMTAZ A. Genetic algorithms and its application to image fusion [C]//Proceedings of the 4th International Conference on Emerging Technologies. Rawalpindi,Pakistan:IEEE, 2008: 6-10.
[16]	CHEN Yingxia, ZHANG Guixu. A Pan-sharpening method based on evolutionary optimization and IHS transformation[J]. Mathematical Problems in Engineering, 2017(4):1-8.
[17]	ZHOU Zeming, YANG Pinglv, LI Yuanxiang, et al. Joint IHS and variational methods for Pan-sharpening of very high resolution imagery [C]//Proceedings of 2013 IEEE International Geoscience and Remote Sensing Symposium. Melbourne, VIC, Australia:IEEE, 2014: 2597-2600.
[18]	XU Ning, XIAO Xinyao, YOU Hongjian, et al. A Pansharpening method based on HCT and joint sparse model[J]. Acta Geodaetica et Cartographica Sinica, 2016,45(4):434-441. DOI: 10.11947/j.AGCS.2016.20150372.
[19]	KENNEDY J, EBERHART R C. Particle swarm optimization [C]//Proceedings of ICNN’95-International Conference on Neural Networks. Perth,Australia:IEEE, 1995: 1942-1948.
[20]	VENTER G, SOBIESZCZANSKI-SOBIESKI J. Particle swarmoptimization[J]. AIAA Journal, 2003,41(8):1583-1589. doi: 10.2514/2.2111
[21]	PUSHPARAJ J, HEGDE A V. Evaluation of Pan-sharpening methods for spatial and spectral quality[J]. Applied Geomatics, 2017,9(1):1-12. doi: 10.1007/s12518-016-0179-2
[22]	ALPARONE L, WALD L, CHANUSSOT J, et al. Comparison of Pansharpening algorithms:outcome of the 2006 GRS-S data-fusion contest[J]. IEEE Transactions on Geoscience and Remote Sensing, 2007,45(10):3012-3021. doi: 10.1109/TGRS.2007.904923
[23]	WANG Z, BOVIK A C. A universal image qualityindex[J]. IEEE Signal Processing Letters, 2002,9(3):81-84. doi: 10.1109/97.995823
[24]	TOET A, HOGERVORST M A. Performance comparison of different gray-level image fusion schemes through a universal image quality index [C]//Proceedings Volume 5096, Signal Processing, Sensor Fusion, and Target Recognition XII. Orlando, Florida, United States:SPIE, 2003: 552-561.
[25]	CHOI M. A new intensity-hue-saturation fusion approach to image fusion with a tradeoff parameter[J]. IEEE Transactions on Geoscience and Remote Sensing, 2006,44(6):1672-1682. doi: 10.1109/TGRS.2006.869923
[26]	FANG Faming, ZHANG Guixu, LI Fang, et al. Framelet based Pan-sharpening via a variational method[J]. Neurocomputing, 2014(10):362-377.

		CC	ERGAS	QAVE	RASE	RMSE	SAM	SID
References		0	0	1	0	0	0	0
Methods	AIHS	0.0006	1.0045	0.9984	4.0418	4.2767	0.0499	0.0018
	Wavelet	0.0036	0.7726	0.9934	3.0880	3.2674	0.5443	0.0021
	PCA	0.1115	2.5759	0.9859	10.3819	10.9851	0.4691	0.0074
	Brovey	0.0064	12.4610	0.8547	33.6737	35.6303	2.2867	0.0033
	PAIHS	0.0002	0.1149	0.9999	0.4623	0.4892	0.0061	0.0002

		CC	ERGAS	QAVE	RASE	RMSE	SAM	SID
References		0	0	1	0	0	0	0
Methods	AIHS	0.0545	7.3116	0.9476	28.8038	31.1956	4.1938	0.2017
	Wavelet	0.1701	7.4309	0.8730	29.2623	31.6922	6.8051	0.2172
	PCA	0.4251	9.0091	0.7555	36.5307	39.5641	6.7451	0.0472
	Brovey	0.2933	10.8484	0.8042	50.0742	54.2322	1.3403	0.0474
	PAIHS	0.0269	2.0305	0.9956	7.9900	8.6534	1.0377	0.0465

		CC	ERGAS	QAVE	RASE	RMSE	SAM	SID
References		0	0	1	0	0	0	0
Methods	AIHS	0.0441	5.5480	0.9677	21.6790	27.1457	2.6021	0.0826
	Wavelet	0.1455	5.5423	0.8364	21.6710	27.1352	5.2060	0.1072
	PCA	0.1406	5.7503	0.8824	23.7538	29.7433	3.4299	0.0372
	Brovey	0.1701	7.8409	0.8795	35.3711	44.2898	0.0700	0.0020
	PAIHS	0.0196	1.4551	0.9976	5.6824	7.1152	0.6346	0.0172