LizardLens: A Two-Stage Deep Learning Pipeline for Detecting and Classifying Similar Species in Visually Complex Environments
Wen Han Chia, Ilia JahanshahiiD, Le Yang Loh, Anqi Zheng, Niral Verma, Stephen Mussman, Breanna Shi, James T. StroudiD
Abstract
Community science platforms like iNaturalist generate unprecedented volumes of biodiversity data, but their scientific utility depends critically on accurate species identification--a persistent challenge when contributors often lack taxonomic expertise. We developed "LizardLens", a two-stage machine learning pipeline that decouples object detection from species classification to enable fine-grained identification of morphologically similar organisms in visually complex field photographs. Using 10,000 verified iNaturalist images of five Anolis lizard species in Florida, we trained specialized YOLO-based detection and Swin Transformer classification models and compared performance against state-of-the-art single-stage architectures. Our two-stage pipeline achieved 83.0% Top-1 accuracy and a macro-averaged F1-score of 89.0%, indicating strong precision-recall performance across species and outperforming single-stage YOLOv8 and YOLOv12 models across all evaluation metrics for all species, with relative improvements ranging from 10.5% to 13.2%. Gradient-weighted Class Activation Mapping (Grad-CAM) indicated that the models predictions were consistently associated with regions corresponding to diagnostic morphological (e.g., head shape, feet, and limb lengths) and pattern features (e.g., ocular rings and body patterning), providing evidence that LizardLens leverages biologically relevant visual cues consistent with those used by expert taxonomists. Error analysis identified partial occlusion and multiple proximate individuals as primary sources of missed detections, while spurious detections of lizard-like environmental features (e.g., sticks, bark) represented the dominant false positive error mode. We deployed LizardLens as an accessible web application featuring interactive bounding box correction, ranked species predictions with confidence scores, directly supporting the "Lizards on the Loose" middle school community science initiative. By combining technical advances in fine-grained visual classification with user-centered design, LizardLens demonstrates how machine learning can simultaneously enhance data quality for biodiversity monitoring and provide authentic scientific experiences for student participants. Our approach is generalizable to other small-bodied organisms in complex habitats and provides a framework for translating computer vision advances into practical tools for community science and conservation.
02 /Specification & Classification
Click any tag to browse matching papersReproducibility ledger
Nobody has reported trying to reproduce this paper yet. Did you replicate an experiment or run the code? Your report saves the next lab a week.
Sign in to file a reproducibility report.
Related papers
- ClassifyMe: a field-scouting software for the identification of wildlife in camera trap images.
G. Falzon, C. Lawson, … P. D. Meek·bioRxiv·May 24, 2019
- Thinking like a naturalist: enhancing computer vision of citizen science images by harnessing contextual data
J. C. Terry, H. E. Roy, T. A. August·bioRxiv·Aug 9, 2019
- LizardNet: A mobile hybrid deep learning tool for classification of 3D representations of Amazonian lizards
Arthur Gonsales da Silva, Roger Pinho de Oliveira, … Bruno Duarte Gomes·bioRxiv·Jan 15, 2024
- LizardMorph: A generalizable machine learning framework for automated anatomical landmark detection in digital images
Mercedes Quintana, Le Yang Loh, … James T. Stroud·bioRxiv·Jun 12, 2026
- A scalable open-source framework for machine learning based image collection, annotation and classification: a case study for automatic fish species identification
C. N. S. Silva, J. Dainys, … A. Audzijonyte·bioRxiv·Jun 29, 2022
- The DeepFaune initiative: a collaborative effort towards the automatic identification of the French fauna in camera-trap images
N. Rigoudy, G. Dussert, … Siefert·bioRxiv·Mar 15, 2022