DiverScan: attention-guided exploratory analysis of animal behaviour across diverse comparative experiments
Momoe SukegawaiD, Hirotsugu AzechiiD, Tatsumi Butsugan, Nadja FreundiD, Shiomi HakatayaiD, Tomohiro IwataiD, Noriko KatsuiD, Koutarou D. KimuraiD, Hiroki KodaiD, Akiko KotoiD, Yuya MakiguchiiD, Hiroshi MatsuiiD, Koji Miyoshi, Annakarina MundorfiD, Hiraku NishimoriiD, Kazuo OkanoyaiD, Masashi ShiraishiiD, SUSUMU Y. TAKAHASHIiD, Ryoya TanakaiD, Genta ToyaiD, Chitose Yamazaki, Shuhei J. YamazakiiD, Takuya MaekawaiD
Abstract
High-throughput tracking yields rich time-series data of animal behaviour, yet extracting biological insight remains a bottleneck, even for simple control--treatment comparisons. Existing analyses struggle to pinpoint the multiple, nonlinearly intertwined differences hidden in the data and fail to generalise across diverse recording set-ups. Here we present DiverScan, a deep-learning framework for attention-guided exploratory analysis of behavioural time series. DiverScan disentangles condition-dependent behavioural differences by pairing a loss function tailored to data exploration with an attention-branch architecture, and highlights condition-specific behavioural features visually and with explanatory text generated by a large language model. DiverScan is validated on a synthetic benchmark and on datasets from seven laboratories spanning multiple species and both single- and multi-animal behaviour. Beyond recovering known phenotypes, we demonstrate that DiverScan helps researchers generate new hypotheses across these diverse datasets. Available as Jupyter notebooks with a graphical user interface and flexible input formats, DiverScan can integrate into existing behavioural-analysis pipelines.
02 /Specification & Classification
Click any tag to browse matching papers- Citations
- 0
- Organism
- Research Focus
- Approach
Reproducibility ledger
Nobody has reported trying to reproduce this paper yet. Did you replicate an experiment or run the code? Your report saves the next lab a week.
Sign in to file a reproducibility report.
Related papers
- Deep learning based behavioral analysis enables high precision rodent tracking and is capable of outperforming commercial solutions
O. Sturman, L. M. von Ziegler, … J. Bohacek·bioRxiv·Jan 21, 2020
- EXPLORE: A novel deep learning-based analysis method for exploration behaviour in object recognition tests
V. Ibanez, L. Bohlen, … A.-S. Wahl·bioRxiv·Jun 24, 2022
- DeepAction: A MATLAB toolbox for automated classification of animal behavior in video
Carl Harris, Kelly R. Finn, … Peter Ulric Tse·Scientific ReportsPeer-reviewed·Feb 15, 2023
- HUB-DT: A tool for unsupervised behavioural discovery and analysis
Adrian A. Lindsay, Jeremy Keith Seamans·bioRxiv·Jan 8, 2024
- Selfee: Self-supervised Features Extraction of animal behaviors
Yinjun Jia, Shuaishuai Li, … Wei Zhang·eLifePeer-reviewed·Jun 16, 2022
- Deep learning-based system for real-time behavior recognition and closed-loop control of behavioral mazes using depth sensing
A. F. Geros, R. Cruz, … P. Aguiar·bioRxiv·Feb 22, 2022