BioCluster: Clustering and Zero-Shot Labeling of Ecological Images Using Foundation Models
Shakil AhmediD, Kim BjergeiD, Toke T. HøyeiD, Christian N. S. PederseniD
Abstract
The increasing automation of biodiversity monitoring is generating large volumes of ecological images requiring taxonomic identification, creating a substantial annotation bottleneck. Assigning species-level labels requires considerable time and expert knowledge, limiting scalability. We propose BioCluster, a framework for unsupervised clustering and zero-shot labeling of ecological images using foundation models. The framework extracts image embeddings from pretrained models and groups images into taxonomic clusters without task-specific training. Species labels are assigned through zero-shot text matching against the taxa expected in the dataset. We investigate dimensionality reduction and six clustering algorithms for organizing fine-grained imagery. A per-image uncertainty score combines clustering and labeling information to sort images into three confidence tiers, so experts can focus on uncertain and unlabeled cases. We evaluate it on two moth and two bird datasets, with one annotated camera-trap collection per taxonomic group. For these camera-trap datasets, per-image species-level accuracy reached 84% on DK-Moth and 83% on HUGO-Bench Aves. An interactive report presents clusters and zero-shot labels by confidence tier and prioritizes cases requiring expert review. The framework provides a training-free approach for organizing and labeling ecological image collections, reducing manual annotation while retaining expert oversight and demonstrating the potential of foundation models for scalable, semi-automated annotation.
02 /Specification & Classification
Click any tag to browse matching papersReproducibility ledger
Nobody has reported trying to reproduce this paper yet. Did you replicate an experiment or run the code? Your report saves the next lab a week.
Sign in to file a reproducibility report.
Related papers
- Zero-shot animal behavior classification with vision-language foundation models
Gaspard Dussert, Vincent Miele, … Simon Chamaillé‐Jammes·Methods in Ecology and EvolutionPeer-reviewed·May 20, 2025
- LizardLens: A Two-Stage Deep Learning Pipeline for Detecting and Classifying Similar Species in Visually Complex Environments
Wen Han Chia, Ilia Jahanshahi, … James T. Stroud·bioRxiv·Jun 12, 2026
- Thinking like a naturalist: enhancing computer vision of citizen science images by harnessing contextual data
J. C. Terry, H. E. Roy, T. A. August·bioRxiv·Aug 9, 2019
- A Lightweight, High-Throughput Classifier for North American Insects Using EfficientNet: Elytra 1.0
Nicholas C. Aflitto·bioRxiv·Feb 18, 2026
- Linking automated image analysis to ecological inference: high-throughput monitoring of soil fauna
Hadrien Hendrikx, Emma Belaud, … Mickaël Hedde·bioRxiv·Jun 16, 2026
- Deep Blueprint: A Literature Review and Guide to Automated Image Classification for Ecologists
Chloe A. Game, Nils Piechaud, Kerry L. Howell·Journal of Animal EcologyPeer-reviewed·Jun 1, 2026