基于空间通道双流注意力的Sentinel-2遥感影像超分辨率重建

高璞, 王钧泽, 李林辉, 景维鹏

南京林业大学学报(自然科学版) ›› 2026, Vol. 50 ›› Issue (2) : 261-270.

PDF(5872 KB)
PDF(5872 KB)
南京林业大学学报(自然科学版) ›› 2026, Vol. 50 ›› Issue (2) : 261-270. DOI: 10.12302/j.issn.1000-2006.202410014
研究论文

基于空间通道双流注意力的Sentinel-2遥感影像超分辨率重建

作者信息 +

Super-resolution reconstruction of Sentinel-2 remote sensing images based on spatial and channel dual stream attention

Author information +
文章历史 +

摘要

【目的】通过深度学习和图像融合技术提高Sentinel-2遥感影像的空间分辨率,增强地表信息的精确性与可靠性,为后续森林资源的精确调查和监测、农业产量预测等方面提供数据支持。【方法】提出了一种基于空间通道双流注意力的Sentinel-2遥感影像超分辨率方法,针对遥感影像多光谱与多分辨率特性设计了一种双分支模型,分别对高分辨率波段和低分辨率波段的信息进行差异化处理。其中对高分辨率波段通过引入空间注意力机制,精准捕获影像中的空间特征细节;对低分辨率波段则通过通道注意力机制动态调整光谱特征的权重分布,强化了光谱特征表达能力。在特征融合阶段,模型采用特征深度提取策略,将空间特征与光谱特征高效整合,生成包含多维度信息的复合特征表示。同时通过组合损失(即L1损失和边缘损失)实现有效地反馈学习,最终完成超分辨率重建。【结果】分别在3个地区的降级采样图像和真实图像2种数据规模下进行超分辨率重建试验,结果表明所提出的算法的客观评价指标和主观视觉效果均优于对比算法。对于降级采样图像数据,所提出的算法的均方根误差(RMSE)较Bicubic插值算法至少下降了50.33,较DSen2算法至少下降了1.64。对于真实图像数据,所提出的算法视觉效果更清晰自然。【结论】提出的基于空间通道双流注意力的遥感影像超分辨率模型能有效提高Sentinel-2遥感影像光谱的空间分辨率,为作物健康监测、土地利用分析等提供了数据支持,并扩展了Sentinel-2卫星在各个领域的应用范围。

Abstract

【Objective】This study aims to enhance the spatial resolution of Sentinel-2 satellite remote sensing imagery by applying deep learning and image fusion techniques, thereby improving the accuracy and reliability of surface information extraction, so as to provide robust data support for subsequent precise investigation and monitoring of forest resources, agricultural yield prediction, and related applications.【Method】A super-resolution reconstruction method for Sentinel-2 imagery, based on a spatial-channel dual-stream attention mechanism, was proposed. Considering the inherent multi-spectral and multi-resolution characteristics of remote sensing images, a dual-branch model was designed to differentially process high-resolution (HR) and low-resolution (LR) spectral bands. The spatial attention mechanism was introduced into the HR branch to precisely capture intricate spatial details. Conversely, the channel attention mechanism was applied to the LR branch to dynamically adjust the weight distribution of spectral features, enhancing spectral feature representation. During the feature fusion stage, a deep feature extraction strategy was employed to effectively integrate spatial and spectral features, generating composite multidimensional feature representations. Additionally, a combined loss function incorporating both L1 loss and edge loss was utilized to facilitate effective feedback learning, ultimately achieving high-quality super-resolution reconstruction.【Result】Experiments were conducted on two data scales: downsampled images from three distinct regions and real Sentinel-2 images. The results demonstrated that the proposed method outperformed comparative algorithms in both objective evaluation metrics and subjective visual quality. Specifically, for the downsampled image data, the proposed method achieved a reduction in Root Mean Square Error (RMSE) of at least 50.33 compared with the bicubic interpolation method, and at least 1.64 compared to the DSen2 method. For the real image data, the proposed method yielded significantly clearer and more natural visual results.【Conclusion】The dual-stream attention model proposed in this study effectively improved the spatial resolution of Sentinel-2 satellite imagery. This enhancement can facilitate the generation of high-quality data for applications such as crop health detection and land use analysis, thereby expanding the potential utility of Sentinel-2 data across multiple domains.

关键词

遥感技术 / 深度学习 / 超分辨率 / Sentinel-2 / 注意力机制

Key words

remote sensing technique / deep learning / super-resolution / Sentinel-2 / attention mechanism

引用本文

导出引用
高璞, 王钧泽, 李林辉, . 基于空间通道双流注意力的Sentinel-2遥感影像超分辨率重建[J]. 南京林业大学学报(自然科学版). 2026, 50(2): 261-270 https://doi.org/10.12302/j.issn.1000-2006.202410014
GAO Pu, WANG Junze, LI Linhui, et al. Super-resolution reconstruction of Sentinel-2 remote sensing images based on spatial and channel dual stream attention[J]. Journal of Nanjing Forestry University (Natural Sciences Edition). 2026, 50(2): 261-270 https://doi.org/10.12302/j.issn.1000-2006.202410014
中图分类号: TP7;S771.8   

参考文献

[1]
丁相元, 陈尔学, 李增元, 等. 国家森林资源清查遥感应用主要技术进展[J]. 南京林业大学学报(自然科学版), 2023, 47(1):1-12.
DING X Y, CHEN E X, LI Z Y, et al. A review of remote sensing application in national forest inventory[J]. Journal of Nanjing Forestry University (Natural Sciences Edition), 2023, 47(1):1-12. DOI: 10.12302/j.issn.1000-2006.202209009.
[2]
ROSHANI, SAJJAD H, RAHAMAN M H, et al. Assessing forest health using remote sensing-based indicators and fuzzy analytic hierarchy process in Valmiki Tiger Reserve,India[J]. International Journal of Environmental Science and Technology, 2023, 20(8):8579-8598. DOI: 10.1007/s13762-022-04512-1.
[3]
HAN D Y, ZHANG J L, XU D F, et al. Improving Pinus densata carbon stock estimations through remote sensing in Shangri-La:a nonlinear mixed-effects model integrating soil thickness and topographic variables[J]. Forests, 2024, 15(2):394. DOI: 10.3390/f15020394.
[4]
王艳芳, 谭露, 郭红丽, 等. 基于多源遥感数据的溧阳市林地植被覆盖度时空差异研究[J]. 南京林业大学学报(自然科学版), 2023, 47(6):183-191.
WANG Y F, TAN L, GUO H L, et al. Study on spatial and temporal variation of forest fractional vegetation cover in Liyang based on multi-source remote sensing data[J]. Journal of Nanjing Forestry University (Natural Sciences Edition), 2023, 47(6):183-191. DOI: 10.12302/j.issn.1000-2006.202204048.
[5]
LI X, ORCHARD M T. New edge-directed interpolation[J]. IEEE Transactions on Image Processing, 2001, 10(10):1521-1527. DOI: 10.1109/83.951537.
[6]
UNSER M, ALDROUBI A, EDEN M. Fast B-spline transforms for continuous image representation and interpolation[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 1991, 13(3):277-285. DOI: 10.1109/34.75515.
[7]
IRANI M, PELEG S. Improving resolution by image registration[J]. CVGIP:Graphical Models and Image Processing, 1991, 53(3):231-239. DOI: 10.1016/1049-9652(91)90045-L.
[8]
STARK H, OSKOUI P. High-resolution image recovery from image-plane arrays,using convex projections[J]. Journal of the Optical Society of America.A,Optics and Image Science, 1989, 6(11):1715-1726. DOI: 10.1364/josaa.6.001715.
[9]
WANG Z H, CHEN J, HOI S C H. Deep learning for image super-resolution:a survey[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2021, 43(10):3365-3387. DOI: 10.1109/TPAMI.2020.2982166.
[10]
LI J, PEI Z, ZENG T. From beginner to master: a survey for deep learning-based single-image super-resolution[J]. arXiv preprint arXiv: 2109. 14335, 2021, 2. DOI: 10.1145/3659100.
[11]
DONG C, LOY C C, HE K M, et al. Image super-resolution using deep convolutional networks[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2016, 38(2):295-307. DOI: 10.1109/TPAMI.2015.2439281.
[12]
LEDIG C, THEIS L, HUSZÁR F, et al. Photo-realistic single image super-resolution using a generative adversarial network[C]// 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).July 21-26,2017,Honolulu,HI,USA.IEEE, 2017:105-114. DOI: 10.1109/CVPR.2017.19.
[13]
XIE Z X, WANG J, SONG W, et al. CFFormer:channel Fourier transformer for remote sensing super resolution[J]. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 2024, 18:569-583.
[14]
WANG Y, SHAO Z F, LU T, et al. Remote sensing image super-resolution via multiscale enhancement network[J]. IEEE Geoscience and Remote Sensing Letters, 2023, 20:5000905. DOI: 10.1109/LGRS.2023.3248069.
[15]
XIAO Y, YUAN Q Q, JIANG K, et al. From degrade to upgrade:learning a self-supervised degradation guided adaptive network for blind remote sensing image super-resolution[J]. Information Fusion, 2023, 96:297-311. DOI: 10.1016/j.inffus.2023.03.021.
[16]
WANG J R, LU Y T, WANG S Z, et al. Two-stage spatial-frequency joint learning for large-factor remote sensing image super-resolution[J]. IEEE Transactions on Geoscience and Remote Sensing, 2024, 62:5606813. DOI: 10.1109/TGRS.2024.3357173.
[17]
PALSSON F, SVEINSSON J R, ULFARSSON M O. Sentinel-2 image fusion using a deep residual network[J]. Remote Sensing, 2018, 10(8):1290. DOI: 10.3390/rs10081290.
[18]
LANARAS C, BIOUCAS-DIAS J, GALLIANI S, et al. Super-resolution of Sentinel-2 images:learning a globally applicable deep neural network[J]. ISPRS Journal of Photogrammetry and Remote Sensing, 2018, 146:305-319. DOI: 10.1016/j.isprsjprs.2018.09.018.
[19]
MORAES D, BARBOSA B, COSTA H, et al. Continuous forest loss monitoring in a dynamic landscape of central Portugal with Sentinel-2 data[J]. International Journal of Applied Earth Observation and Geoinformation, 2024, 130:103913. DOI: 10.1016/j.jag.2024.103913.
[20]
LIU L S, XIE Y C, ZHU B X, et al. Rice leaf chlorophyll content estimation with different crop coverages based on Sentinel-2[J]. Ecological Informatics, 2024, 81:102622. DOI: 10.1016/j.ecoinf.2024.102622.
[21]
SZEGEDY C, IOFFE S, VANHOUCKE V, et al. Inception-v4,inception-ResNet and the impact of residual connections on learning[J]. Proceedings of the AAAI Conference on Artificial Intelligence, 2017, 31(1):4278-4284. DOI: 10.1609/aaai.v31i1.11231
[22]
WOO S, PARK J, LEE J Y, et al. CBAM:convolutional block attention module[C]// Computer Vision-ECCV 2018.Cham: Springer, 2018:3-19. DOI: 10.1007/978-3-030-01234-2_1.
[23]
ZHANG Y L, LI K P, LI K, et al. Image super-resolution using very deep residual channel attention networks[C]// Computer Vision-ECCV 2018.Cham: Springer, 2018:294-310. DOI: 10.1007/978-3-030-01234-2_18.
[24]
VIVONE G, ALPARONE L, CHANUSSOT J, et al. A critical comparison among pansharpening algorithms[J]. IEEE Transactions on Geoscience and Remote Sensing, 2015, 53(5):2565-2586. DOI: 10.1109/TGRS.2014.2361734.
[25]
WANG Z, BOVIK A C, SHEIKH H R, et al. Image quality assessment:from error visibility to structural similarity[J]. IEEE Transactions on Image Processing, 2004, 13(4):600-612. DOI: 10.1109/tip.2003.819861.
[26]
ALPARONE L, BARONTI S, GARZELLI A, et al. A global quality measurement of pan-sharpened multispectral imagery[J]. IEEE Geoscience and Remote Sensing Letters, 2004, 1(4):313-317. DOI: 10.1109/LGRS.2004.836784.
[27]
KINGMA D P, BA J, HAMMAD M M. Adam:a method for stochastic optimization[EB/OL]. 2014:412.6980. https://arxiv.org/abs/1412.6980v9.

基金

内蒙古自治区科技计划(2022YFSJ0037)

责任编辑: 孟苗婧
PDF(5872 KB)

Accesses

Citation

Detail

段落导航
相关文章

/