Human Pose and Action Recognition

Modeling Withdrawal States in Opioid-Dependent Mice with Machine Learning

The paper develops a behavioral analysis pipeline using LUPE to quantify opioid withdrawal behaviors in mice, identifying challenges in capturing rapid behaviors and laying groundwork for standardized quantification.

Reconstruction of Postures Using Partial Body Information Through a Self-supervised Transformer in Mice

This paper introduces MATER, a self-supervised framework for reconstructing rodent postures from incomplete data, achieving high-fidelity reconstructions and behavioral classification with minimal supervision.

Mapping the landscape of social behavior

This paper introduces a 3D tracking technique to analyze social behavior in rodents, revealing new insights into autism and amphetamine effects through high-resolution postural data.

Forestwalk: A machine learning workflow brings new insights into posture and balance in rodent beam walking

Forestwalk uses machine learning to analyze rodent beam walking, revealing new insights into posture and balance through automated feature extraction and classification.

YOLO-Behaviour: A simple, flexible framework to automatically quantify animal behaviours from videos

YOLOv8 detection with SORT event grouping and grid-search tuning quantifies visually distinct behaviours from video across 5 case studies, reaching f1-scores of 0.62 to 0.94.

Marker Data Enhancement For Markerless Motion Capture

This paper improves motion capture accuracy by enhancing sparse keypoints with a more generalizable marker enhancer trained on a larger dataset.

refineDLC: an advanced post-processing pipeline for DeepLabCut outputs

RefineDLC improves DeepLabCut outputs by cleaning, filtering, and interpolating data to produce reliable kinematic analyses across species and recording conditions.

PrecisionTrack: A Platform for Automated Long-Term Social Behavior Analysis in Naturalized Environments

PrecisionTrack provides a platform for automated long-term social behavior analysis in naturalized environments, enabling real-time tracking and social interaction inference in large animal groups.

REVEALS: An Open Source Multi Camera GUI For Rodent Behavior Acquisition

REVEALS is an open-source GUI for rodent behavior data acquisition using multiple cameras, validated with DeepLabCut for pose estimation in behavioral assays.

Unsupervised decomposition of natural monkey behavior into a sequence of motion motifs

This paper introduces SMP, an unsupervised algorithm for decomposing primate behavior into motion motifs, outperforming existing methods and visualizing neural manipulation effects.

Video Foundation Models for Animal Behavior Analysis

This paper evaluates frozen video foundation models for animal behavior analysis, showing they achieve competitive performance across diverse datasets and tasks with minimal adaptation.

Lightning Pose: improved animal pose estimation via semi-supervised learning, Bayesian ensembling, and cloud-native open-source tools

SUBTLE: An unsupervised platform with temporal link embedding that maps animal behavior

SUBTLE maps animal behavior from 3D action skeletons using an unsupervised framework, achieving superior performance in capturing behavioral repertoires and identifying inter-group differences through temporal representation.

FABEL: Forecasting Animal Behavioral Events with Deep Learning-Based Computer Vision

FABEL forecasts animal behaviors and locomotion from video using deep learning, showing promise in predicting food interactions and trajectories.

Anti-drift pose tracker (ADPT): A transformer-based network for robust animal pose estimation cross-species

ADPT is a transformer-based pose tracker that reduces tracking drift in animal behavior analysis, achieving high accuracy across species and conditions.

Establishing an AI-based evaluation system that quantifies social/pathophysiological behaviors of common marmosets

This paper develops an AI system to quantify social and pathophysiological behaviors in common marmosets using 3D pose estimation and unsupervised analysis.

Large-scale capture of hidden fluorescent labels for training generalizable markerless motion capture models

The paper introduces GlowTrack, a method to generate large-scale training data for markerless motion capture, enabling generalizable deep learning models for animal behavior analysis.

Keypoint-MoSeq: parsing behavior by linking point tracking to pose dynamics

Keypoint-MoSeq fits a generative model that tells tracking jitter apart from real movement, cutting pose time series into unsupervised sub-second behavioural syllables in mice.

Social Behavior Atlas: A computational framework for tracking and mapping 3D close interactions of free-moving animals

The paper introduces SBeA, a framework for tracking and mapping 3D social interactions in free-moving animals, showing it can detect subtle behavioral abnormalities in mice, birds, and dogs.

DeepAction: A MATLAB toolbox for automated classification of animal behavior in video

DeepAction is a MATLAB toolbox that uses deep learning to automate animal behavior classification in video, achieving high accuracy with minimal training data and reducing annotation time.

A layered, hybrid machine learning analytic workflow for mouse risk assessment behavior

The paper develops a layered hybrid machine learning workflow to improve the analysis of mouse risk assessment behavior by combining random forest and hidden Markov models.

Identifying Behavioral Structure from Deep Variational Embeddings of Animal Motion

The paper introduces VAME, a deep learning framework for identifying hierarchical behavioral structures from animal motion data, demonstrating its ability to detect discrete motifs and community-specific usage patterns in mouse models.

BehaviorDEPOT: a tool for automated behavior classification and analysis in rodents

BehaviorDEPOT automates behavior classification and analysis in rodents, providing tools for tracking, classification, and experimental setup with reduced costs and improved reliability.

Selfee: Self-supervised Features Extraction of animal behaviors

Selfee extracts comprehensive and discriminative features from raw animal behavior videos using self-supervised learning, enabling anomaly detection and temporal analysis.

Video-based automated analysis of MDS-UPDRS III parameters in Parkinson disease

This paper develops a deep learning tool to automatically score bradykinesia using MDS-UPDRS III protocols, showing significant correlation with gold-standard ratings.

Validation of DeepLabCut as a tool for markerless 3D pose estimation

The paper validates DeepLabCut for 3D pose estimation by comparing it to a reference system, showing close agreement in millimeter range.

Anatomically-based skeleton kinetics and pose estimation in freely-moving rodents

This paper develops a videography-based method to estimate skeletal pose and joint kinetics in freely-moving rodents, validated by direct limb placement measurements.

The Mouse Action Recognition System (MARS) software pipeline for automated analysis of social behaviors in mice

The paper introduces MARS, a software pipeline for automated analysis of social behaviors in mice, achieving human-level performance in pose estimation and behavior classification.

Partitioning variability in animal behavioral videos using semi-supervised variational autoencoders

This paper introduces a video analysis tool that combines supervised pose estimation with unsupervised dimensionality reduction to extract interpretable behavioral features from animal videos, improving downstream analyses.

DeepEthogram: a machine learning pipeline for supervised behavior classification from raw pixels

DeepEthogram uses machine learning to automatically classify animal behaviors from video frames with high accuracy, reducing manual effort and increasing reproducibility.