JOURNAL OF NANJING FORESTRY UNIVERSITY ›› 2022, Vol. 46 ›› Issue (2): 63-70.doi: 10.12302/j.issn.1000-2006.202109030

Special Issue: 第二届中国林草计算机大会论文精选

Previous Articles     Next Articles

Research on extraction of shape features of Camellia oleifera fruits based on camera photography

JI Yu1(), YIN Xianming1, YAN Enping1, JIANG Jiamin1, PENG Shaofeng2, MO Dengkui1,*()   

  1. 1. Hunan Provincial Key Laboratory of Forestry Remote Sensing Big Data and Ecological Security, South Key Laboratory of Forest Resources Management and Monitoring, NFGA, College of Forestry, Central South University of Forestry and Technology, Changsha 410004, China
    2. Hunan Academy of Forestry, Changsha 410004, China
  • Received:2021-09-15 Accepted:2021-11-11 Online:2022-03-30 Published:2022-04-08
  • Contact: MO Dengkui E-mail:820013975@qq.om;Dengkuimo@csuft.edu.cn

Abstract:

【Objective】Camellia oleifera, one of the four major woody oilseeds in the world, has a comprehensive utilization value. As a key rural industry in southern China, it plays an important role in the development of the agricultural economy. In recent years, with a vigorous support from the national government at all levels, the C. oleifera planting area has been expanding annually. Therefore, it is important to obtain information on the shapes of C. oleifera fruits quickly and accurately to determine the size distribution, guide fruit grading, and calculate rapid yield measurements. This paper proposes a batch extraction method for C. oleifera fruit shape feature parameters based on camera photography. 【Method】First, the picked C. oleifera fruits were placed on a background plate with a scale, using a camera to quickly obtain images of C. oleifera fruits and a correction of the geometric distortions produced by photography. Then, the Mask R-CNN model was used for a fast detection and counting of the C. oleifera fruits in the image. According to the generated mask, the number of pixels of the feature parameters (length of the long axis and short axis, area and perimeter) of the camellia fruits was counted using the elliptic fitting method. Finally, the image pixel size calculated with the help of the background plate scale was used to obtain the key parameters of the oil tea fruits, while the accuracy was verified using the actual measured values. 【Result】The average recognition accuracy and recall of the mask R-CNN model were 99.55% and 91.19%, respectively, and the F-measure value was 95.22%, showing that the method was suitable for describing C. oleifera fruit shape parameters statistically. The estimated accuracy of the area of the C. oleifera fruits was the highest with the coefficient of determination (R2), mean absolute error (MAE), and root mean square error (RMSE) of 0.999 0, 10.75 mm2, and 14.88 mm2, followed by the perimeter and length of the long axis, and the lowest accuracy of length of the the short axis with R2, MAE, and RMSE of 0.864 7, 3.15 mm, and 3.74 mm, respectively. 【Conclusion】The method achieved a rapid and accurate counting of C. oleifera fruits shape feature parameters after picking and batch extraction. Thus, the technique can rapidly and accurately detect a large number of fruit feature parameters and provide a scientific basis for the C. oleifera fruit grading and rapid yield measurement.

Key words: close-range photogrammetry, shape feature extraction, image processing, convolutional neural network, Camellia oleifera fruit

CLC Number: