
Crown segmentation of CHM based on the enhanced frost local filtering and distance map reconstruction
ZHANG Huacong, TAN Xinjian, YU Longhua, LI Yueqiao, CHEN Yongfu, LIU Ren, ZHANG Huaiqing
JOURNAL OF NANJING FORESTRY UNIVERSITY ›› 2023, Vol. 47 ›› Issue (5) : 9-18.
Crown segmentation of CHM based on the enhanced frost local filtering and distance map reconstruction
【Objective】We used the enhanced Frost local filtering and single-tree distance map reconstruction marking technology to segment a canopy height model (CHM), improving the accuracy and efficiency of unpiloted aerial system (UAV)-light detection and ranging (LiDAR) segmentation in single-tree crowns.【Method】 We selected three forest types - coniferous mixed, coniferous-broad mixed, and broad-leaved mixed - in the Shanxia Experimental Forest Farm of Fenyi, Jiangxi Province. We then used UAV-LiDAR data to construct the CHM. To combat the increased pores in the crown area of the high-resolution CHM, we used the enhanced Frost local filtering to optimize the CHM and results were compared with different filtering methods. Next we applied the distance map reconstruction marker segmentation technology to segment and analyze the CHM-with resolutions of 0.1, 0.2, 0.5 and 1.0 m after optimization of the enhanced Froest local filter. Finally, we determined the CHM with the optimal resolution, and compared segmentation results with that of a watershed algorithm with the same resolution and mean-shift segmentation algorithm. 【Result】 Applying the enhanced Frost local filter indeed optimized the CHM-preserving image details while suppressing phase crown noise. A resolution of 0.2 m performed best for the CHM segmentation. An overall accuracy of 0.96, 0.84 and 0.75 was observed for coniferous mixed, coniferous-broad mixed, and broad-leaved mixed forests, respectively. The crown width of a single tree was calculated according to crown segmentation results, and the R2 estimated at 0.83, 0.82 and 0.71, respectively. 【Conclusion】Through the enhanced Frost local filtering and distance map reconstruction marking technology, the single-tree segmentation and crown estimation of laser point cloud CHMs can be realized, meeting key requirements of forest surveys and monitoring.
UAV laser point cloud / cannopy height model(CHM) / enhance Frost / distance map marker and reconstruction / crown segmentation
[1] |
解宇阳, 王彬, 姚扬, 等. 基于无人机激光雷达遥感的亚热带常绿阔叶林群落垂直结构分析[J]. 生态学报, 2020, 40(3):196-207.
|
[2] |
陈宗铸, 杨琦, 雷金睿, 等. 基于激光雷达数据的热带森林冠高模型生成及平均树高估计[J]. 中南林业科技大学学报, 2018, 38(7):1-7.
|
[3] |
巨一琳, 姬永杰, 黄继茂, 等. 联合LiDAR和多光谱数据森林地上生物量反演研究[J]. 南京林业大学学报(自然科学版), 2022, 46(1):58-68.
|
[4] |
Accurate measurement of forest growing stock is a prerequisite for implementing climate-smart forestry strategies. This study deals with the use of airborne laser scanning data to assess carbon stock at the tree level. It aims to demonstrate that the combined use of two unsupervised techniques will improve the accuracy of estimation supporting sustainable forest management. Based on the heterogeneity of tree height and point cloud density, we classified 31 forest stands into four complexity categories. The point cloud of each stand was further divided into three horizontal layers, improving the accuracy of tree detection at tree level for which we calculated volume and carbon stock. The average accuracy of tree detection was 0.48. The accuracy was higher for forest stands with lower tree density and higher frequency of large trees, as well as a dense point cloud (0.65). The prediction of carbon stock was higher with a bias ranging from –0.3% to 1.5% and a root mean square error ranging from 0.14% to 1.48%.
|
[5] |
Timely updates of carbon stock distribution are needed to better understand the impacts of deforestation and degradation on forest carbon stock dynamics. This research aimed to explore an approach for estimating aboveground carbon density (ACD) in the Brazilian Amazon through integration of MODIS (moderate resolution imaging spectroradiometer) and a limited number of light detection and ranging (Lidar) data samples using linear regression (LR) and random forest (RF) algorithms, respectively. Airborne LiDAR data at 23 sites across the Brazilian Amazon were collected and used to calculate ACD. The ACD estimation model, which was developed by Longo et al. in the same study area, was used to map ACD distribution in the 23 sites. The LR and RF methods were used to develop ACD models, in which the samples extracted from LiDAR-estimated ACD were used as dependent variables and MODIS-derived variables were used as independent variables. The evaluation of modeling results indicated that ACD can be successfully estimated with a coefficient of determination of 0.67 and root mean square error of 4.18 kg C/m2 using RF based on spectral indices. The mixed pixel problem in MODIS data is a major factor in ACD overestimation, while cloud contamination and data saturation are major factors in ACD underestimation. These uncertainties in ACD estimation using MODIS data make it difficult to examine annual ACD dynamics of degradation and growth, however this method can be used to examine the deforestation-induced ACD loss.
|
[6] |
张冬, 云挺, 薛联凤, 等. 基于力场的点云树木骨架提取方法[J]. 南京林业大学学报(自然科学版), 2016, 40(2):160-166.
|
[7] |
The most common method for modeling forest attributes with airborne lidar, the area-based approach, involves summarizing the point cloud of individual plots and relating this to attributes of interest. Tree- and voxel-based approaches have been considered as alternatives to the area-based approach but are rarely considered in an area-based context. We estimated three forest attributes (basal area, overstory biomass, and volume) across 1680 field plots in Arizona and New Mexico. Variables from the three lidar approaches (area, tree, and voxel) were created for each plot. Random forests were estimated using subsets of variables based on each individual lidar approach and mixtures of each approach. Boruta feature selection was performed on variable subsets, including the mixture of all lidar-approach predictors (KS-Boruta). A corrected paired t test was utilized to compare six validated models (area-Boruta, tree-Boruta, voxel-Boruta, KS-Boruta, KS-all, and ridge-all) for each forest attribute. Based on significant reductions in error (SMdAPE), basal area and biomass were best modeled with KS-Boruta, while volume was best modeled with KS-all. Analysis of variable importance shows that voxel-based predictors are critical for the prediction of the three forest attributes. This study highlights the importance of multiresolution voxel-based variables for modeling forest attributes in an area-based context.
|
[8] |
李文娟, 赵传燕, 别强, 等. 基于机载激光雷达数据的森林结构参数反演[J]. 遥感技术与应用, 2015, 30(5):917-924.
|
[9] |
|
[10] |
王辉, 韩娜娜, 吕程序, 等. 基于Mask R-CNN的单株柑橘树冠识别与分割[J]. 农业机械学报, 2021, 52(5):169-174.
|
[11] |
程晓菲, 武刚. 基于高分辨率卫星影像的CV模型单木定位法[J]. 南京林业大学学报(自然科学版), 2022, 46(5):143-151.
|
[12] |
孙振峰, 张晓丽, 李霓雯. 机载与星载高分遥感影像单木树冠分割方法和适宜性对比[J]. 北京林业大学学报, 2019, 41(11):66-75.
|
[13] |
|
[14] |
|
[15] |
|
[16] |
|
[17] |
徐志扬, 刘浩栋, 陈永富, 等. 基于无人机LiDAR的杉木树冠上部外轮廓模拟与可视化研究[J]. 林业科学研究, 2021, 34(4):9.
|
[18] |
|
[19] |
|
[20] |
|
[21] |
Accurate individual tree crown (ITC) segmentation from scanned point clouds is a fundamental task in forest biomass monitoring and forest ecology management. Light detection and ranging (LiDAR) as a mainstream tool for forest survey is advancing the pattern of forest data acquisition. In this study, we performed a novel deep learning framework directly processing the forest point clouds belonging to the four forest types (i.e., the nursery base, the monastery garden, the mixed forest, and the defoliated forest) to realize the ITC segmentation. The specific steps of our approach were as follows: first, a voxelization strategy was conducted to subdivide the collected point clouds with various tree species from various forest types into many voxels. These voxels containing point clouds were taken as training samples for the PointNet deep learning framework to identify the tree crowns at the voxel scale. Second, based on the initial segmentation results, we used the height-related gradient information to accurately depict the boundaries of each tree crown. Meanwhile, the retrieved tree crown breadths of individual trees were compared with field measurements to verify the effectiveness of our approach. Among the four forest types, our results revealed the best performance for the nursery base (tree crown detection rate r = 0.90; crown breadth estimation R2 > 0.94 and root mean squared error (RMSE) < 0.2m). A sound performance was also achieved for the monastery garden and mixed forest, which had complex forest structures, complicated intersections of branches and different building types, with r = 0.85, R2 > 0.88 and RMSE < 0.6 m for the monastery garden and r = 0.80, R2 > 0.85 and RMSE < 0.8 m for the mixed forest. For the fourth forest plot type with the distribution of crown defoliation across the woodland, we achieved the performance with r = 0.82, R2 > 0.79 and RMSE < 0.7 m. Our method presents a robust framework inspired by the deep learning technology and computer graphics theory that solves the ITC segmentation problem and retrieves forest parameters under various forest conditions.
|
[22] |
Rubber trees in southern China are often impacted by natural disturbances that can result in a tilted tree body. Accurate crown segmentation for individual rubber trees from scanned point clouds is an essential prerequisite for accurate tree parameter retrieval. In this paper, three plots of different rubber tree clones, PR107, CATAS 7-20-59, and CATAS 8-7-9, were taken as the study subjects. Through data collection using ground-based mobile light detection and ranging (LiDAR), a voxelisation method based on the scanned tree trunk data was proposed, and deep images (i.e., images normally used for deep learning) were generated through frontal and lateral projection transform of point clouds in each voxel with a length of 8 m and a width of 3 m. These images provided the training and testing samples for the faster region-based convolutional neural network (Faster R-CNN) of deep learning. Consequently, the Faster R-CNN combined with the generated training samples comprising 802 deep images with pre-marked trunk locations was trained to automatically recognize the trunk locations in the testing samples, which comprised 359 deep images. Finally, the point clouds for the lower parts of each trunk were extracted through back-projection transform from the recognized trunk locations in the testing samples and used as the seed points for the region’s growing algorithm to accomplish individual rubber tree crown segmentation. Compared with the visual inspection results, the recognition rate of our method reached 100% for the deep images of the testing samples when the images contained one or two trunks or the trunk information was slightly occluded by leaves. For the complicated cases, i.e., multiple trunks or overlapping trunks in one deep image or a trunk appearing in two adjacent deep images, the recognition accuracy of our method was greater than 90%. Our work represents a new method that combines a deep learning framework with point cloud processing for individual rubber tree crown segmentation based on ground-based mobile LiDAR scanned data.
|
[23] |
黄昕晰, 夏凯, 冯海林, 等. 基于无人机影像与Mask R-CNN的单木树冠检测与分割[J]. 林业工程学报, 2021, 6(2):133-140.
|
[24] |
|
[25] |
|
[26] |
王鑫运, 黄杨, 邢艳秋, 等. 基于无人机高密度LiDAR点云的人工针叶林单木分割算法[J]. 中南林业科技大学学报, 2022, 42(8):66-77.
|
[27] |
李岩, 史泽林, 程坤, 等. 运用激光雷达数据的单木树冠提取算法对帽儿山林场单木参数估测的影响[J]. 东北林业大学学报, 2019, 47(11):61-67.
|
[28] |
张海清, 李向新, 王成, 等. 结合DSM的机载LiDAR单木树高提取研究[J]. 地球信息科学学报, 2021, 23(10):1873-1881.
机载LiDAR在提取地形坡度较大区域的冠层高度模型(CHM)时易产生畸变,降低单木树高的提取精度,为此提出一种CHM与数字表面模型(DSM)相结合的树高估算方法。首先基于预处理后的点云生成的CHM,利用局部最大值算法和标记控制分水岭分割算法进行分割,得到单木树冠轮廓多边形;然后结合DSM,采用固定窗口的局部最大值算法探测树顶点并提取其高程,继而与使用狄洛尼三角网和高程内插得到的地面点相减获取树高;最后,以广西兴安县富江村附近地形起伏较大的针叶林为试验区,测试3种不同坡度下,在CHM、CHM结合DSM获得的树高与实测树高分别进行精度分析。结果表明,当树木分别位于平均坡度为32°、27°和15°的试验区时,CHM中提取的树高与实测数据拟合的R<sup>2</sup>分别为0.84、0.85和0.87,RMSE为1.48、1.41和1.58 m,结合DSM后R<sup>2</sup>为0.92、0.91和0.93,RMSE为0.93、1.02和1.16 m;在地形坡度较大的区域,本文方法可以有效提高单木树高的估算精度。
|
[29] |
|
[30] |
贾惠珍, 王同罕. 基于自适应微调因子的改进 frost 滤波[J]. 计算机工程与设计, 2011, 32(11): 3793-3795.
|
[31] |
Two different formal definitions of gray-scale reconstruction are presented. The use of gray-scale reconstruction in various image processing applications discussed to illustrate the usefulness of this transformation for image filtering and segmentation tasks. The standard parallel and sequential approaches to reconstruction are reviewed. It is shown that their common drawback is their inefficiency on conventional computers. To improve this situation, an algorithm that is based on the notion of regional maxima and makes use of breadth-first image scannings implemented using a queue of pixels is introduced. Its combination with the sequential technique results in a hybrid gray-scale reconstruction algorithm which is an order of magnitude faster than any previously known algorithm.
|
[32] |
李增元, 庞勇, 刘清旺, 等. 激光雷达森林参数反演技术与方法[M]. 北京: 科学出版社, 2015.
|
[33] |
王娟, 张超, 陈巧, 等. 结合无人机可见光和激光雷达数据的杉木树冠信息提取[J]. 西南林业大学学报, 2022, 42(1):133-141.
|
[34] |
汪垚, 张志玉, 倪文俭, 等. 基于机载LiDAR数据的林下地形提取算法比较与组合分析[J]. 北京林业大学学报, 2017, 39(12):25-35.
|
/
〈 |
|
〉 |