Research on landscape construction system based on gesture interaction

DOU Lei, ZHANG Chenzhe, MIAO Yulu, MAO Rui, WANG Meili

Journal of Nanjing Forestry University (Natural Sciences Edition) ›› 2026, Vol. 50 ›› Issue (2) : 271-279.

PDF(6447 KB)
PDF(6447 KB)
Journal of Nanjing Forestry University (Natural Sciences Edition) ›› 2026, Vol. 50 ›› Issue (2) : 271-279. DOI: 10.12302/j.issn.1000-2006.202407026

Research on landscape construction system based on gesture interaction

Author information +
History +

Abstract

【Objective】Traditional garden landscape construction requires a series of processes such as hand-drawn plan drawings, computer-aided modeling, scene rendering, etc., which display the problems of cumbersome process, high learning cost, and lack of intuitiveness. Based on virtual reality (VR) gesture interaction technology, this system proposes a novel virtual garden landscape layout system, aiming to improve the user experience and efficiency of garden landscape design.【Method】Firstly, a virtual wetland landscape scene was designed based on remote sensing satellite maps, and secondly, the Oculus Quest 2 device was used to collect hand information for recognizing multiple gesture patterns, and combined with the $P point cloud recognizer to design dynamic gesture classification algorithms to match the user’s gesture trajectories which realized the accurate recognition of five trajectories of garden plants: solitary planting, clump planting, row planting, piece planting and free layout. In addition, this system also designed gesture interaction system suitable for virtual scenes to facilitate the use of users.【Result】The system designed in this research adopted the unity platform and used C# scripting language for programming implementation, and finally realized the function of using gesture interaction to select plants and construct a garden landscape in a virtual scene. Through comparative experiments, the layout time required for this system was slightly higher than that of keyboard and mouse operations in the solitary planting mode, and lower than those of the keyboard and mouse operation in the row planting, clump planting, piece planting and free arrangement modes.【Conclusion】The gesture set generated by this research design system is intuitive, easy to execute and memorize, and can well accomplish the task of landscape layout. The system can make a certain contribution to improving the interaction and user experience of landscape layout.

Key words

landscape design / gesture interaction / virtual reality / trajectory recognition / scene modeling

Cite this article

Download Citations
DOU Lei , ZHANG Chenzhe , MIAO Yulu , et al . Research on landscape construction system based on gesture interaction[J]. Journal of Nanjing Forestry University (Natural Sciences Edition). 2026, 50(2): 271-279 https://doi.org/10.12302/j.issn.1000-2006.202407026

References

[1]
杨至德. 风景园林设计原理[M]. 武汉: 华中科技大学出版社, 2021.
YANG Z D. Principle of landscape design[M]. Wuhan: Huazhong University of Science and Technology Press, 2021.
[2]
彭艺. 手绘在园林景观设计中的应用[J]. 建筑科学, 2020, 36(1):156-157.
PENG Y. Application of hand-drawing in landscape design[J]. Building Science, 2020, 36(1):156-157.
[3]
岳忙芳. 虚拟现实(VR)技术在风景园林规划与设计中的应用研究[J]. 工程建设与设计, 2021(2):163-164.
YUE M F. Application research of virtual reality technology in landscape planning and design[J]. Construction & Design for Engineering, 2021(2):163-164. DOI: 10.13616/j.cnki.gcjsysj.2021.01.272.
[4]
宋仁波, 朱瑜馨, 郭仁杰, 等. 基于多源数据集成的城市建筑物三维建模方法[J]. 自然资源遥感, 2022, 34(1):93-105.
SONG R B, ZHU Y X, GUO R J, et al. A method for 3D modeling of urban buildings based on multi-source data integration[J]. Remote Sensing for Natural Resources, 2022, 34(1):93-105. DOI: 10.6046/zrzyyg.2021039.
[5]
唐丽玉, 陈崇成, 林定, 等. 虚拟园林植被景观交互式设计方法:CN103366068A[P].2013-10-23.
TANG L Y, CHEN C C, LIN D, et al. Interactive design method of virtual garden vegetation landscape:CN103366068A[P].2013-10-23.
[6]
林荣锟, 邹杰, 陈崇成, 等. 虚拟树木形态结构的交互式编辑技术及其实现[J]. 农业工程学报, 2012, 28(S1):175-180.
LIN R K, ZOU J, CHEN C C, et al. Interactive editing technique and its implementation for virtual tree structure[J]. Transactions of the Chinese Society of Agricultural Engineering, 2012, 28(S1):175-180.
[7]
史尚睿. 当代增强现实技术(AR触控)与风景园林设计深度融合的思考与展望[J]. 农业科技与信息, 2022(23):123-128.
SHI S R. Thinking and prospect of deep integration of contemporary augmented reality technology (AR touch) and landscape architecture design[J]. Information of Agricultural Science and Technology, 2022(23):123-128. DOI: 10.3969/j.issn.1003-6997.2022.23.033.
[8]
张维, 林泽一, 程坚, 等. 动态手势理解与交互综述[J]. 软件学报, 2021, 32(10):3051-3067.
ZHANG W, LIN Z Y, CHENG J, et al. Survey of dynamic hand gesture understanding and interaction[J]. Journal of Software, 2021, 32(10):3051-3067. DOI: 10.13328/j.cnki.jos.006217.
[9]
王思元, 吴丹子. 虚拟现实技术在“风景园林设计” 课程教学中的应用[J]. 中国林业教育, 2019, 37(3):51-55.
WANG S Y, WU D Z. Application of virtual reality technology in the teaching of landscape architecture design[J]. Forestry Education in China, 2019, 37(3):51-55. DOI: 10.3969/j.issn.1001-7232.2019.03.012.
[10]
HAN S C, LIU B B, CABEZAS R, et al. MEgATrack:monochrome egocentric articulated hand-tracking for virtual reality[J]. ACM Transactions on Graphics, 2020, 39(4):87:1-87: 13. DOI: 10.1145/3386569.3392452.
[11]
VATAVU R D, ANTHONY L, WOBBROCK J O. Gestures as point clouds:a $P recognizer for user interface prototypes[C]// Proceedings of the 14th ACM International Conference on Multimodal Interaction. Santa Monica California USA.ACM,2012:273-280. DOI: 10.1145/2388676.2388732.
[12]
WOBBROCK J O, WILSON A D, LI Y. Gestures without libraries,toolkits or training:a $1 recognizer for user interface prototypes[C]// Proceedings of the 20th Annual ACM Symposium on User Interface Software and Technology. Newport Rhode Island USA.ACM,2007:159-168. DOI: 10.1145/1294211.1294238.
[13]
ANTHONY L, WOBBROCK J O. $ N-protractor: a fast and accurate multistroke recognizer[C]// Proceedings of Graphics Interface 2012. Canadian Information Processing Society, 2012:117-120.
[14]
BRADEN B. The surveyor’s area formula[J]. The College Mathematics Journal, 1986, 17(4):326-337.
[15]
CASELLA G, ROBERT C P, WELLS M T. Generalized accept-reject sampling schemes[M]// A Festschrift for Herman Rubin. Beachwood,Ohio,USA: Institute of Mathematical Statistics,2004:342-347. DOI: 10.1214/lnms/1196285403.
[16]
林一, 陈靖, 刘越, 等. 基于心智模型的虚拟现实与增强现实混合式移动导览系统的用户体验设计[J]. 计算机学报, 2015, 38(2):408-422.
LIN Y, CHEN J, LIU Y, et al. User experience design of VR-AR hybrid mobile browsing system based on mental model[J]. Chinese Journal of Computers, 2015, 38(2):408-422. DOI: 10.3724/SP.J.1016.2015.00408.
PDF(6447 KB)

Accesses

Citation

Detail

Sections
Recommended
The full text is translated into English by AI, aiming to facilitate reading and comprehension. The core content is subject to the explanation in Chinese.

/