NAPS: Integrating pose estimation and tag-based tracking
S. W. Wolf, D. M. Ruttenberg, D. Y. Knapp, A. E. Webb, I. M. Traniello, G. C. McKenzie-Smith, S. A. Leheny, J. W. Shaevitz, S. D. Kocher
Abstract
O_LISignificant advances in computational ethology have allowed the quantification of behavior in unprecedented detail. Tracking animals in social groups, however, remains challenging as most existing methods can either capture pose or robustly retain individual identity over time but not both. C_LIO_LITo capture finely resolved behaviors while maintaining individual identity, we built NAPS (NAPS is ArUco Plus SLEAP), a hybrid tracking framework that combines state-of-the-art, deep learning-based methods for pose estimation (SLEAP) with unique markers for identity persistence (ArUco). We show that this framework allows the exploration of the social dynamics of the common eastern bumblebee (Bombus impatiens). C_LIO_LIWe provide a stand-alone Python package for implementing this framework along with detailed documentation to allow for easy utilization and expansion. We show that NAPS can scale to long timescale experiments at a high frame rate and that it enables the investigation of detailed behavioral variation within individuals in a group. C_LIO_LIExpanding the toolkit for capturing the constituent behaviors of social groups is essential for understanding the structure and dynamics of social networks. NAPS provides a key tool for capturing these behaviors and can provide critical data for understanding how individual variation influences collective dynamics. C_LI
02 /Specification & Classification
Click any tag to browse matching papersReproducibility ledger
Nobody has reported trying to reproduce this paper yet. Did you replicate an experiment or run the code? Your report saves the next lab a week.
Sign in to file a reproducibility report.
Related papers
- SLEAP: Multi-animal pose tracking
T. D. Pereira, N. Tabris, … M. Murthy·bioRxiv·Aug 31, 2020
- Markerless tracking of an entire insect colony
Katarzyna Bożek, Laetitia Hebert, … Greg J. Stephens·Nature CommunicationsPeer-reviewed·Mar 19, 2021
- idtracker.ai: Tracking all individuals in large collectives of unmarked animals
F. Romero Ferrero, m. g. bergomi, … G. de Polavieja·Nature MethodsPeer-reviewed·Jan 14, 2019
- BEEtag : a low-cost, image-based tracking system for the study of animal behavior and locomotion
James Crall, Nick Gravish, … Stacey A Combes·bioRxiv·Jun 3, 2015
- Accurate detection and tracking of ants in indoor and outdoor environments
- Anipose: a toolkit for robust markerless 3D pose estimation
Pierre Karashchuk, Katie L. Rupp, … John C Tuthill·Cell ReportsPeer-reviewed·Sep 1, 2021