Research on plant stem complement based on L1-medial skeleton extraction

JIANG Jincen, LI Liandui, WANG Meili

JOURNAL OF NANJING FORESTRY UNIVERSITY ›› 2022, Vol. 46 ›› Issue (1) : 40-50.

PDF(4179 KB)
南京林业大学学报（自然科学版）
PDF(4179 KB)
JOURNAL OF NANJING FORESTRY UNIVERSITY ›› 2022, Vol. 46 ›› Issue (1) : 40-50. DOI: 10.12302/j.issn.1000-2006.202110040

Research on plant stem complement based on L1-medial skeleton extraction

Author information +
History +

Abstract

【Objective】 Plant visualization technology is an important part of digital forestry research. This study used the stem missing points to propose a plant stem complement based on L1-medial skeleton extraction to provide technical support for plant visualization. 【Method】 First, a method to determine the position of the missing part based on topological connection was utilized. Based on the density of the point cloud, the point cloud was classed by using the union-find sets. The weight of the edge of the cluster between nodes was calculated based on the probability graph model, and the minimum spanning tree was used to determine the topological connection between clusters; this enabled the determination of the position of missing parts. Following this, a search-based method was used to determine the set of points to be fitted. The L1-medial local iterative method was used to extract the stem point cloud skeleton. A search algorithm based on nearest neighbor distance was proposed to sort the skeleton point set for the disorder of the point cloud, to determine points to be fitted for missing parts. To address issues with inaccurate skeleton extraction, an iterative optimization method of stem skeleton based on Gauss kernel weight was proposed. This approach used Gauss smoothing stem direction vector, and the Gauss weighted average to calculate stem radius and the updated stem skeleton point set. Finally, a method of point cloud completion of missing parts based on fitting was utilized. The stem radius of missing parts was fitted based on the least squares method, and the stem line of missing parts was fitted based on the Bezier curve. A method based on point cloud density to adjust the generation of the fitting point cloud was proposed to better fit the actual point cloud. 【Result】 The experimental results show that the method proposed in this paper can effectively complete the plant point cloud with leaf and stem missing separation; the fitting result was smooth and has certain practical, physical significance. 【Conclusion】 To some extent, the research results in this paper make up for the defects of scanning, building a complete and realistic three-dimensional point cloud model of plants; this may be more effectively applied to the three-dimensional visual modeling of plants.

Key words

3D point cloud / detail completion / skeleton optimization / point cloud sorting / spatial fitting / plant visualization technology

Cite this article

EndNote

Ris (Procite)

Bibtex

Download Citations
JIANG Jincen , LI Liandui , WANG Meili. Research on plant stem complement based on L1-medial skeleton extraction[J]. JOURNAL OF NANJING FORESTRY UNIVERSITY. 2022, 46(1): 40-50 https://doi.org/10.12302/j.issn.1000-2006.202110040

References

List( Publishing order | Descend order by publishing year | Descend order by cited within ) Chart analysis
[1]
赵春江, 陆声链, 郭新宇, 等. 数字植物研究进展:植物形态结构三维数字化[J]. 中国农业科学, 2015, 48(17):3415-3428.
ZHAO C J, LU S L, GUO X Y, et al. Advances in research of digital plant:3D digitization of plant morphological structure[J]. Sci Agric Sin, 2015, 48(17):3415-3428.DOI: 10.3864/j.issn.0578-1752.2015.17.009.
https://doi.org/10.3864/j.issn.0578-1752.2015.17.009
Cited in this article [1]
[2]
史川石, 郑倩, 黄惠. 基于叶片识别的侵入式室内植物建模[J]. 计算机辅助设计与图形学学报, 2021, 33(2):161-168.
SHI C S, ZHENG Q, HUANG H. Intrusive indoor plant modeling guided by leaf recognition[J]. J Comput Aided Des Comput Graph, 2021, 33(2):161-168.
Cited in this article [1]
[3]
胡春华, 李萍萍. 树木三维可视化建模技术研究述评[J]. 南京林业大学学报(自然科学版), 2015, 39(6):148-154.
HU C H, LI P P. A survey of 3D visualization modeling technologies for trees[J]. J Nanjing For Univ (Nat Sci Ed), 2015, 39(6):148-154.
Cited in this article [1]
[4]
ZENG L L. 3D plants reconstruction based on point cloud[J]. Int J Perform Eng, 2018, 14(1):121.DOI: 10.23940/ijpe.18.01.p13.121133.
https://doi.org/10.23940/ijpe.18.01.p13.121133
Cited in this article [1]
[5]
辛卫涛. 基于参数智能提取的植物建模方法研究[D]. 杭州:浙江工业大学, 2020.
XIN W T. Research on plant modeling method based on intelligent parameter extraction[D]. Hangzhou:Zhejiang University of Technology, 2020.
Cited in this article [1]
[6]
MURCIA H F, SANABRIA D A, DEHYRO-MÉNDEZ, et al. Development of a simulation tool for 3D plant modeling based on 2D LiDAR sensor[C]// 2020 Virtual Symposium in Plant Omics Sciences (OMICAS).November 23-27,2020.BogotáColombia: IEEE, 2020:1-6.DOI: 10.1109/OMICAS52284.2020.9535651.
https://doi.org/10.1109/OMICAS52284.2020.9535651
Cited in this article [1]
[7]
PATURKAR A, GUPTA G S, BAILEY D. Effect on quality of 3D model of plant with change in number and resolution of images used:an investigation[M]// Lecture Notes in Electrical Engineering.Singapore:Springer Singapore, 2021:377-388.DOI: 10.1007/978-981-15-8391-9_28.
https://doi.org/10.1007/978-981-15-8391-9_28
Cited in this article [1]
[8]
朱超, 苗腾, 许童羽, 等. 基于骨架和最优传输距离的玉米点云茎叶分割和表型提取[J]. 农业工程学报, 2021, 37(4):188-198.
ZHU C, MIAO T, XU T Y, et al. Segmentation and phenotypic trait extraction of maize point cloud stem-leaf based on skeleton and optimal transportation distances[J]. Trans Chin Soc Agric Eng, 2021, 37(4):188-198.
Cited in this article [1]
[9]
LARI Z, HABIB A, A novel hybrid approach for the extraction of linear/cylindrical features from laser scanning data[J]. ISPRS Ann Photogramm Remote Sens Spatial Inf Sci, 2013, II-5/W2:151-156.DOI: 10.5194/isprsannals-ii-5-w2-151-2013.
https://doi.org/10.5194/isprsannals-ii-5-w2-151-2013
https://www.isprs-ann-photogramm-remote-sens-spatial-inf-sci.net/II-5-W2/151/2013/
Cited in this article [1]
[10]
ZHAN Q, LIANG Y, XIAO Y. Color-based segmentation of point clouds[J]. Laser Scanning, 2009, 38(3):155-161.
Cited in this article [1]
[11]
PAULUS S, DUPUIS J, MAHLEIN A K, et al. Surface feature based classification of plant organs from 3D laserscanned point clouds for plant phenotyping[J]. BMC Bioinformatics, 2013, 14:238.DOI: 10.1186/1471-2105-14-238.
https://doi.org/10.1186/1471-2105-14-238
https://doi.org/10.1186/1471-2105-14-238
Cited in this article [1]
[12]
GELARD W, DEVY M, HERBULOT A, et al. Model-based segmentation of 3D point clouds for phenotyping sunflower plants[C]// Proceedings of the 12th International Joint Conference on Computer Vision,Imaging and Computer Graphics Theory and Applications.February 27-March 1,2017.Porto,Portugal: SCITEPRESS-Science and Technology Publications, 2017:459-467.DOI: 10.5220/0006126404590467.
https://doi.org/10.5220/0006126404590467
Cited in this article [1]
[13]
李杨先, 张慧春, 杨旸. 一种基于图像处理技术的植物形态表型参数获取方法[J]. 林业工程学报, 2020, 5(6):128-136.
LI Y X, ZHANG H C, YANG Y. A method for obtaining plant morphological phenotypic parameters using image processing technology[J]. J For Eng, 2020, 5(6):128-136.doi: 10.13360/j.issn.2096-1359.201911003.
https://doi.org/10.13360/j.issn.2096-1359.201911003
Cited in this article [1]
[14]
TAGLIASACCHI A, ZHANG H, COHEN-OR D. Curve skeleton extraction from incomplete point cloud[C]//ACM SIGGRAPH 2009 papers on-SIGGRAPH’09.August 3-7,2009.New Orleans,Louisiana. New York: ACM Press, 2009:1-9. DOI: 10.1145/1576246.1531377.
https://doi.org/10.1145/1576246.1531377
Cited in this article [1]
[15]
HUANG H, WU S H, COHEN-OR D, et al. L1 -medial skeleton of point cloud[J]. ACM Trans Graph, 2013, 32(4):1-8.DOI: 10.1145/2461912.2461913.
https://doi.org/10.1145/2461912.2461913
Cited in this article [3]
[16]
WU S H, HUANG H, GONG M L, et al. Deep points consolidation[J]. ACM Trans Graph, 2015, 34(6):1-13.DOI: 10.1145/2816795.2818073.
https://doi.org/10.1145/2816795.2818073
Cited in this article [1]
[17]
ZHANG Q S, SONG X, SHAO X W, et al. Unsupervised skeleton extraction and motion capture from 3D deformable matching[J]. Neurocomputing, 2013, 100:170-182.DOI: 10.1016/j.neucom.2011.11.032.
https://doi.org/10.1016/j.neucom.2011.11.032
https://linkinghub.elsevier.com/retrieve/pii/S0925231212003499
Cited in this article [3]
[18]
LU X, CHEN H, YEUNG S K, et al. Unsupervised articulated skeleton extraction from point set sequences captured by a single depth camera[C]// Thirty-Second AAAI Conference on Artificial Intelligence. 2018:7226-7234
Cited in this article [1]
[19]
LU X Q, DENG Z G, LUO J, et al. 3D articulated skeleton extraction using a single consumer-grade depth camera[J]. Comput Vis Image Underst, 2019, 188:102792.DOI: 10.1016/j.cviu.2019.102792.
https://doi.org/10.1016/j.cviu.2019.102792
https://linkinghub.elsevier.com/retrieve/pii/S1077314218303606
Cited in this article [1]
[20]
CHARLES R Q, HAO S, MO K C, et al. PointNet:deep learning on point sets for 3D classification and segmentation[C]// 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).July 21-26,2017. Honolulu: IEEE, 2017:77-85.DOI: 10.1109/CVPR.2017.16.
https://doi.org/10.1109/CVPR.2017.16
Cited in this article [1]
[21]
YU L Q, LI X Z, FU C W, et al. PU-net:point cloud upsampling network[C]// 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.June 18-23,2018. Salt Lake City, IEEE, 2018:2790-2799.DOI: 10.1109/CVPR.2018.00295.
https://doi.org/10.1109/CVPR.2018.00295
Cited in this article [1]
[22]
YU L Q, LI X Z, FU C W, et al. EC-net:an edge-aware point set consolidation network[M]//Computer Vision: ECCV 2018. Cham: Springer International Publishing, 2018:398-414. DOI: 10.1007/978-3-030-01234-2_24.
https://doi.org/10.1007/978-3-030-01234-2_24
Cited in this article [1]
[23]
YIFAN W, WU S H, HUANG H, et al. Patch-based progressive 3D point set upsampling[C]// 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).June 15-20,2019. Long Beach: IEEE, 2019:5951-5960.DOI: 10.1109/CVPR.2019.00611.
https://doi.org/10.1109/CVPR.2019.00611
Cited in this article [1]
[24]
罗开乾, 朱江平, 周佩, 等. 基于多分支结构的点云补全网络[J]. 激光与光电子学进展, 2020, 57(24):209-216.
LUO K Q, ZHU J P, ZHOU P, et al. Point cloud completion network based on multibranch structure[J]. Laser Optoelectron Prog, 2020, 57(24):209-216.
Cited in this article [1]
[25]
WEN X, HAN Z Z, CAO Y P, et al. Cycle4Completion:unpaired point cloud completion using cycle transformation with missing region coding[C]// 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).June 20-25,2021. Nashville: IEEE, 2021:13075-13084.DOI: 10.1109/CVPR46437.2021.01288.
https://doi.org/10.1109/CVPR46437.2021.01288
Cited in this article [1]
[26]
ZHANG X C, FENG Y T, LI S Q, et al. View-guided point cloud completion[C]// 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).June 20-25,2021,Nashville: IEEE, 2021:15885-15894.DOI: 10.1109/CVPR46437.2021.01563.
https://doi.org/10.1109/CVPR46437.2021.01563
Cited in this article [1]

RIGHTS & PERMISSIONS

Copyright reserved © 2022
PDF(4179 KB)

Accesses

Citation

Detail
Sections
Recommended
The full text is translated into English by AI, aiming to facilitate reading and comprehension. The core content is subject to the explanation in Chinese.

Author

Reader

Reviewer

www.nldxb.njfu.edu.cn

Edited ＆ Published by Editorial Department of Nanjing Forestry University(Natural Sciences Edition)
Address： No.159 Longpan Road,Nanjing 210037 Jiangsu,P.R.China
E-mail ：xuebao@njfu.edu.cn , xuebao@njfu.com.cn
Telephone +86-25-85428247,85427076
Distributed by China International Book Trading Corporation P.O. Box 399, Beijing ,P.R. China

/

〈 〉