bioRxivAnimal Behavior & Cognition
Deep learning based behavioral analysis enables high precision rodent tracking and is capable of outperforming commercial solutions
O. Sturman, L. M. von Ziegler, C. Schälppi, F. Akyol, B. F. Grewe, J. Bohacek
Abstract
To study brain function, preclinical research relies heavily on animal monitoring and the subsequent analyses of behavior. Commercial platforms have enabled semi high-throughput behavioral analyses by providing accurate tracking of animals, yet they often struggle with the analysis of ethologically relevant behaviors and lack the flexibility to adapt to variable testing environments. In the last couple of years, substantial advances in deep learning and machine vision have given researchers the ability to take behavioral analysis entirely into their own hands. Here, we directly compare the performance of commercially available platforms (Ethovision XT14, Noldus; TSE Multi Conditioning System, TSE Systems) to cross-verified human annotation. To this end, we provide a set of videos - carefully annotated by several human raters - of three widely used behavioral tests (open field, elevated plus maze, forced swim test). Using these data, we show that by combining deep learning-based motion tracking (DeepLabCut) with simple post-analysis, we can track animals in a range of classic behavioral tests at similar or even greater accuracy than commercial behavioral solutions. In addition, we integrate the tracking data from DeepLabCut with post analysis supervised machine learning approaches. This combination allows us to score ethologically relevant behaviors with similar accuracy to humans, the current gold standard, thus outperforming commercial solutions. Moreover, the resulting machine learning approach eliminates variation both within and between human annotators. In summary, our approach helps to improve the quality and accuracy of behavioral data, outperforming commercial systems at a fraction of the cost.
- organism: rat
- assay: imaging
- research focus: cell type annotation
- research focus: clustering
- research focus: benchmarking
- approach: deep learning
Reproducibility ledger
Nobody has reported trying to reproduce this paper yet. Did you replicate an experiment or run the code? Your report saves the next lab a week.
Sign in to file a reproducibility report.
Related papers
- DeepAction: A MATLAB toolbox for automated classification of animal behavior in video
Carl Harris, Kelly R. Finn, … Peter Ulric Tse·Scientific ReportsPeer-reviewed·Feb 15, 2023
- Deep learning-based system for real-time behavior recognition and closed-loop control of behavioral mazes using depth sensing
A. F. Geros, R. Cruz, … P. Aguiar·bioRxiv·Feb 22, 2022
- BehaviorDEPOT: a tool for automated behavior classification and analysis in rodents
Christopher Gabriel, Zachary Zeidler, … Laura A. DeNardo·eLifePeer-reviewed·Aug 8, 2022
- DeepEthogram: a machine learning pipeline for supervised behavior classification from raw pixels
James P. Bohnslav, Nivanthika K. Wimalasena, … Christopher D. Harvey·eLifePeer-reviewed·Sep 2, 2021
- Mouse Academy: high-throughput automated training and trial-by-trial behavioral analysis during learning
M. Qiao, T. Zhang, … M. Meister·bioRxiv·Feb 13, 2019
- B-REAL: A keypoint-less behavior platform for offline classification and real-time detection
Eric A. Yttri, Aden Eagle, … Runcheng Li·bioRxiv·Oct 20, 2026