BirdCODE: Detecting bird communication at scale

Abstract

Deep learning-based animal sound identification is regularly applied to large audio datasets for ecological monitoring and citizen science, but existing methods lack the fine temporal resolution required to extract insights into animal communication from these same datasets. Here we introduce Bird Communication Detector (BirdCODE), a deep learning model that detects and classifies the vocalizations of over 9000 bird species with precise temporal boundaries, a several hundredfold increase the number of species over previous bioacoustic sound event detection models. In extensive benchmarking, BirdCODE achieves state-of-the-art performance in detection and classification of bird sounds. Applying BirdCODE to 1.3M citizen-science recordings, we present four case studies of how BirdCODE-computed sound event boundaries can be used to carry out phylogenetic analyses, to describe geographic and temporal variation in acoustic communication, and to characterize cross-species interactions. Together, these demonstrate how BirdCODE can enable large-scale, data-driven studies of bird communication. Model code, weights, and predictions are publicly available.