henhao
Sign in
EcologybioRxiv
Preprint

BioCluster: Clustering and Zero-Shot Labeling of Ecological Images Using Foundation Models

Shakil AhmediD, Kim BjergeiD, Toke T. HøyeiD, Christian N. S. PederseniD

PDFDOI

Abstract

The increasing automation of biodiversity monitoring is generating large volumes of ecological images requiring taxonomic identification, creating a substantial annotation bottleneck. Assigning species-level labels requires considerable time and expert knowledge, limiting scalability. We propose BioCluster, a framework for unsupervised clustering and zero-shot labeling of ecological images using foundation models. The framework extracts image embeddings from pretrained models and groups images into taxonomic clusters without task-specific training. Species labels are assigned through zero-shot text matching against the taxa expected in the dataset. We investigate dimensionality reduction and six clustering algorithms for organizing fine-grained imagery. A per-image uncertainty score combines clustering and labeling information to sort images into three confidence tiers, so experts can focus on uncertain and unlabeled cases. We evaluate it on two moth and two bird datasets, with one annotated camera-trap collection per taxonomic group. For these camera-trap datasets, per-image species-level accuracy reached 84% on DK-Moth and 83% on HUGO-Bench Aves. An interactive report presents clusters and zero-shot labels by confidence tier and prioritizes cases requiring expert review. The framework provides a training-free approach for organizing and labeling ecological image collections, reducing manual annotation while retaining expert oversight and demonstrating the potential of foundation models for scalable, semi-automated annotation.

02 /Specification & Classification

Click any tag to browse matching papers

Reproducibility ledger

Nobody has reported trying to reproduce this paper yet. Did you replicate an experiment or run the code? Your report saves the next lab a week.

Sign in to file a reproducibility report.