Three Dimensional Root CT Segmentation using Multi-Resolution Encoder-Decoder Networks

Abstract

We address the complex problem of reliably segmenting root structure from soil in X-ray Computed Tomography (CT) images. We utilise a deep learning approach, and propose a state-of-the-art multi-resolution architecture based on encoder-decoders. While previous work in encoder-decoders implies the use of multiple resolutions simply by downsampling and upsampling images, we make this process explicit, with branches of the network tasked separately with obtaining local high-resolution segmentation, and wider low-resolution contextual information. The complete network is a memory efficient implementation that is still able to resolve small root detail in large volumetric images. We evaluate our approach by comparing against a number of different encoder-decoder based architectures from the literature, as well as a popular existing image analysis tool designed for root CT segmentation. We show qualitatively and quantitatively that a multi-resolution approach offers substantial accuracy improvements over a both a small receptive field size in a deep network, or a larger receptive field in a shallower network. We obtain a Dice score of 0.59 compared with 0.41 for the closest competing method. We then further improve performance using an incremental learning approach, in which failures in the original network are used to generate harder negative training examples. Results of this process raise the precision of the network, and improve the Dice score to 0.66. Our proposed method requires no user interaction, is fully automatic, and identifies large and fine root material throughout the whole volume. The 3D segmented output of our method is well-connected, allowing the recovery of structured representations of root system architecture, and so may be successfully utilised in root phenotyping.