bioRxivBioengineeringPreprint
A Systematic Review and Independent Benchmarking of Automated Nerve Morphometry Methods
Benton ChuteriD, Min Young KimiD, Andrew B. StiemkeiD, Nikhil DaveiD, Harrison R. Cape, Zirui ZhouiD, Jay HerriniD, Matthew C. Miller, William White, TJ HollingsworthiD, Monica M. JablonskiiD
Abstract
Objective: To systematically review automated nerve morphometry tools and independently benchmark their performance on independent optic nerve datasets. Design: Systematic review and comparative benchmarking study. Controls: Benchmarking was performed using paraphenylenediamine-stained mouse (n = 85) and rat (n = 44) optic nerve images with manually annotated axon counts as ground truth. Methods: Published studies describing automated or semi-automated neural tissue morphometry tools were identified through systematic searches of PubMed, Embase, and Scopus through January 2026 following PRISMA guidelines. Data extraction covered 70 fields across tool capabilities, imaging modality, species, automation level, and validation approach. Eighteen eligible tools (8 deep learning [DL], 10 classical computer vision [CV]) were benchmarked on both mouse and rat independent datasets. Main Outcome Measures: Performance was assessed by mean absolute percentage error (MAPE), Pearson correlation, and median predicted-to-ground-truth ratio. Tools were ranked per image and compared using Friedman tests with Nemenyi post-hoc analysis. Results: Seventy-one studies met inclusion criteria, spanning from 1999 to 2026. Deep learning methods represented 38% (27/71) of studies, increasing from 0% before 2017 to over 55% of publications after 2020. Axon counting was the most common output (73%, 52/71), while only 35% (25/71) reported g-ratio. Among benchmarked tools, Marina (CV, 2010) achieved the lowest average MAPE (32.9%). The top five tools (MAPE ranging from 32.9 to 44.8%) included both CV and DL methods and were statistically indistinguishable by Friedman-Nemenyi analysis (p > 0.05). Performance varied substantially across datasets: AxonJ (CV) achieved the second best MAPE on rat images (27.7%) but the worst on mouse images (438.6%). Conclusions: No single tool demonstrated consistently superior performance across both datasets. Classical and deep learning approaches achieved comparable accuracy for axon counting. Tool selection should be guided by target species, tissue preparation protocol, and desired morphometric outputs. This systematic review and independent benchmarking study provide an evidence base for tool selection in optic nerve research.
- organism: mouse
- organism: rat
- assay: imaging
- research focus: cell type annotation
- approach: benchmark study
- Citations
- 0
Reproducibility ledger
Nobody has reported trying to reproduce this paper yet. Did you replicate an experiment or run the code? Your report saves the next lab a week.
Sign in to file a reproducibility report.
Related papers
- A simple and robust method for automating analysis of naïve and regenerating peripheral nerves
Alison L. Wong, Nicholas W. Hricz, … Sami H. TUFFAHA·PLoS ONEPeer-reviewed·Jul 7, 2021
- MONICA: A Web Application for Automated Whole Optic Nerve Contour Extraction and Morphometric Analysis Validated Across Taxonomic Orders and Image Quality Levels
Benton Chuter, William White, … Monica M. Jablonski·bioRxiv·Mar 2, 2026
- Comparison of Deep Learning Tools for Optic Nerve Axon Quantification Finds Limited Generalizability on Independent Validation
Benton Chuter, Noah Emmert, … Monica M. Jablonski·BioengineeringPeer-reviewed·May 30, 2026
- AxonDeep: Automated Optic Nerve Axon Segmentation in Mice with Deep Learning.
W. Deng, A. Hedberg-Buenz, … M. K. Garvin·bioRxiv·May 21, 2021
- Deep Neurite Analysis Tool (DeNAT): A machine-learning framework for precise automated neurite outgrowth measurement
Manojkumar Kumaran, PS Athul Narayan, … Ishwariya Venkatesh·bioRxiv·Sep 18, 2025
- Benchmarking of tools for axon length measurement in individually-labeled projection neurons
Mario Rubio-Teves, Sergio Diez‐Hermano, … José Antonio Villacorta-Atienza·PLoS Computational BiologyPeer-reviewed·Dec 8, 2021