Journal of Experimental BotanyBiophysicsPeer-reviewed journal article
Segment Any Plant (SAP): Foundation-Model Segmentation for Plant Time-Series Phenotyping
Abstract
Quantitative studies of plant growth and environmental responses increasingly rely on time-series imaging, yet automated segmentation remains challenging due to continuous growth, large non-rigid morphological change, and frequent self-occlusion. Traditional image-processing pipelines and task-specific deep learning models often require extensive annotated datasets and retraining, limiting portability across species, developmental stages, and imaging conditions. Here we present SAP (Segment Any Plant), a plant-focused framework that leverages the pretrained Segment Anything Model 2 (SAM2) to enable few-shot, training-free segmentation of plant time-series imagery. SAP integrates interactive prompting, automated temporal mask propagation, and centerline extraction within a web-based interface, allowing users to move from raw images to quantitative descriptors of organ shape and dynamics without programming expertise. Across multiple systems, including Arabidopsis thaliana rosette development, root growth, sunflower gravitropism, and confocal root microscopy, SAP achieves high segmentation accuracy (mean IoU 0.89-0.93) and sub-pixel centerline precision from single-frame prompting. By reducing the need for task-specific retraining, SAP provides a transferable framework for reproducible time-series phenotyping across diverse experimental contexts.
- organism: Arabidopsis
- assay: imaging
- assay: fluorescence / live-cell microscopy
- research focus: cell type annotation
- research focus: clustering
- research focus: trajectory inference
- research focus: spatial domain detection
- approach: deep learning
- approach: transformer / foundation model
- Citations
- 1
- FWCI
- 3.75
- Field percentile
- top 11%
Reproducibility ledger
Nobody has reported trying to reproduce this paper yet. Did you replicate an experiment or run the code? Your report saves the next lab a week.
Sign in to file a reproducibility report.
Related papers
- ARADEEPOPSIS: From images to phenotypic traits using deep transfer learning
P. Huether, N. Schandry, … C. Becker·bioRxiv·Apr 1, 2020
- A Data-Driven Image Extraction and Analysis Pipeline for Plant Phenotyping in Controlled Environments
Fahimeh Orvati Nia, Joshua Peeples, … Uday Santhosh Raju Vysyaraju·bioRxiv·Jul 21, 2026
- Botanic Spectrum Analyser: A Deep Learning GUI for Plant Image Segmentation in Hyperspectral and RGB Phenotyping
Jason Walsh, Levent Görgü, … Sónia Negrão·bioRxiv·Sep 14, 2025
- Samplify: A versatile tool for image-based segmentation and annotation of seed abortion phenotypes
Heinrich Bente, Ronja Lea Jennifer Müller, … Claudia Köhler·New PhytologistPeer-reviewed·Feb 15, 2026
- Vision Transformers Enable Advanced Plant Phenotyping in Controlled Environments
Janou Milligan, Anand Seethepalli, … John H. Lagergren·bioRxiv·Sep 10, 2026
- Accurate And Versatile 3D Segmentation Of Plant Tissues At Cellular Resolution
A. Wolny, L. Cerrone, … A. Kreshuk·bioRxiv·Jan 17, 2020