Jointly Optimized Spatial Histogram UNET Architecture (JOSHUA) for Adipose Tissue Segmentation

Abstract

ObjectiveWe quantify adipose tissue deposition at surgical sites as a function of biomaterial implantation. Impact StatementTo our knowledge, this study is the first investigation to apply convolutional neural network (CNN) models to identify and segment adipose tissue in histological images from silk fibroin biomaterial implants. IntroductionWhen designing biomaterials for the treatment of various soft tissue injuries and diseases, one must consider the extent of adipose tissue deposition. In this work, we implant silk fibroin biomaterials in a rodent subcutaneous injury model. Current strategies for quantifying adipose tissue after biomaterial implantation are often tedious and prone to human bias during analysis. MethodsWe used CNN models with novel spatial histogram layer(s) that can more accurately identify and segment regions of adipose tissue in hematoxylin and eosin (H&E) and Massons Trichrome stained images, allowing for determination of the optimal biomaterial formulation. We compared the method, Jointly Optimized Spatial Histogram UNET Architecture (JOSHUA), to the baseline UNET model and an extension of the baseline model, Attention UNET, as well as to versions of the models with a supplemental "attention"-inspired mechanism (JOSHUA+ and UNET+). ResultsThe inclusion of histogram layer(s) in our models shows improved performance through qualitative and quantitative evaluation. ConclusionOur results demonstrate that the proposed methods, JOSHUA and JOSHUA+, are highly beneficial for adipose tissue identification and localization. The new histological dataset and code for our experiments are publicly available.