Towards Smart Pruning: ViNet, a Deep-Learning Approach for Grapevine Structure Estimation
| Type of publication: | Journal paper |
| Citation: | Gentilhomme_COMPAG_2023 |
| Publication status: | Published |
| Journal: | Computers and Electronics in Agriculture |
| Volume: | 207 |
| Year: | 2023 |
| Month: | April |
| Pages: | 107736 |
| ISSN: | 0168-1699 |
| URL: | https://www.sciencedirect.com/... |
| DOI: | https://doi.org/10.1016/j.compag.2023.107736 |
| Abstract: | Image and video tools for analysing crop scenes and plants are essential for applying precision agriculture to crop maintenance, harvesting, or pruning. In this paper, we are interested in vine pruning, a task that requires a precise understanding of the vine structure with branch type identification, orientations, and node locations. However, estimating such a structure is highly challenging, given the large variety in grapevine appearances, lighting conditions, viewpoint, the interweaving of branches, occlusions, and the level of details needed. To address these challenges, we propose ViNet: a deep-learning approach for estimating the structure of grapevine, which comprises two main steps: The first one detects nodes and identifies the branch types of the plant, as well as the spatial relation between them, whilst the second one uses the extracted nodes and branches to build a graph, out of which the structure of the grapevine is inferred. In doing so, we make three main contributions: (i) we put forward for the first time a method for automatic segmentation and extraction of the grapevine structure from images; (ii) we propose a novel approach leveraging powerful stacked hourglass network to infer node location and branch types, along with a novel shortest path weighted graph optimization step to extract connections between nodes and infer the structure, allowing to address the problem of having an unknown number of branches in the tree; (iii) we publicly release a dataset of more than 1500 grapevine images fully annotated with the structure information. Extensive experiments on this dataset demonstrate the efficiency of our approach at predicting the structure of a grapevine, achieving a precision and recall for node prediction of 95% and 90%, respectively, as well as ablation studies validating our design choices. |
| Keywords: | convolutional network, deep learning, grapevine pruning, plant skeleton, precision viticulture, vineyard |
| Projects |
Idiap |
| Authors | |
| Added by: | [UNK] |
| Total mark: | 0 |
|
Attachments
|
|
|
Notes
|
|
|
|
|