bioRxivEcologyPreprint
Combining machine learning and a universal acoustic feature-set yields efficient automated monitoring of ecosystems
S. S. Sethi, N. S. Jones, B. D. Fulcher, L. Picinali, D. J. Clink, H. Klinck, C. D. L. Orme, P. H. Wrege, R. M. Ewers
Abstract
Natural habitats are being impacted by human pressures at an alarming rate. Monitoring these ecosystem-level changes often requires labour-intensive surveys that are unable to detect rapid or unanticipated environmental changes. Here we developed a generalisable, data-driven solution to this challenge using eco-acoustic data. We exploited a convolutional neural network to embed ecosystem soundscapes from a wide variety of biomes into a common acoustic space. In both supervised and unsupervised modes, this allowed us to accurately quantify variation in habitat quality across space and in biodiversity through time. On the scale of seconds, we learned a typical soundscape model that allowed automatic identification of anomalous sounds in playback experiments, paving the way for real-time detection of irregular environmental behaviour including illegal activity. Our highly generalisable approach, and the common set of features, will enable scientists to unlock previously hidden insights from eco-acoustic data and offers promise as a backbone technology for global collaborative autonomous ecosystem monitoring efforts.
Reproducibility ledger
Nobody has reported trying to reproduce this paper yet. Did you replicate an experiment or run the code? Your report saves the next lab a week.
Sign in to file a reproducibility report.
Related papers
- Unlocking the soundscape of coral reefs with artificial intelligence: pretrained networks and unsupervised learning win out
Ben Williams, Santiago M. Balvanera, … Kate E. Jones·bioRxiv·Feb 2, 2024
- Automated speech detection in eco-acoustic data enables privacy protection and human disturbance quantification
Benjamin Cretois, Carolyn M. Rosten, Sarab S. Sethi·Methods in Ecology and EvolutionPeer-reviewed·Oct 18, 2022
- SAFE Acoustics: an open-source, real-time eco-acoustic monitoring network in the tropical rainforests of Borneo
S. S. Sethi, R. M. Ewers, … C. D. L. Orme·bioRxiv·Feb 27, 2020
- Is there an accurate and generalisable way to use soundscapes to monitor biodiversity?
S. S. Sethi, A. Bick, … D. A. Coomes·bioRxiv·Dec 19, 2022
- Interpretable and Robust Machine Learning for Exploring and Classifying Soundscape Data
Arpit Omprakash, Rohini Balakrishnan, … Sarab S. Sethi·bioRxiv·Nov 7, 2024
- A Convolutional Neural Network and R-Shiny App for Automated Identification and Classification of Animal Sounds
Zachary J. Ruff, Damon B. Lesmeister, … Christopher M. Sullivan·Ecological IndicatorsPeer-reviewed·Jan 27, 2021