Connectome quality converges predictably to reveal optimal stopping points during proofreading

Abstract

Volumetric electron microscopy (EM) has become a critical approach to generating high-resolution reconstructions of brain tissue. As the size of EM volumes increase, use of automated image segmentation within the reconstruction pipeline has become essential, although it generates errors that need correction. The proofreading and correcting of these errors has since become the dominant cost driver in the pipeline, but precisely estimating the sufficient number of proofreading edits to enable meaningful scientific analyses of the reconstructed neuronal networks remains a challenge. We present a fast, computationally inexpensive way to estimate the progress of a connectomic proofreading effort without requiring a priori knowledge of ground truth. We show that simple global graph invariants converge predictably to asymptotic limits with increasing numbers of proofreading edits, informing a quantitative "pencils down" criterion for proofreading completeness. We illustrate our method on two datasets in different stages of proofreading progress, a zebrafish spinal cord and the hemibrain Drosophila melanogaster dataset. Our method reduces the uncertainty associated with the planning and prioritization of proofreading activities and enables data owners to accurately predict and budget the amount of proofreading necessary for their scientific questions.