The Development and Evaluation of a Fully Automated Markerless Motion Capture Workflow
L. Needham, M. Evans, L. Wade, D. P. Cosker, M. P. McGuigan, J. L. Bilzon, S. L. Colyer
Abstract
This study presented a fully automated deep learning based markerless motion capture workflow and evaluated its performance against marker-based motion capture during overground running, walking and counter movement jumping. Multi-view high speed (200 Hz) image data were collected concurrently with marker-based motion capture (criterion data), permitting a direct comparison between methods. Lower limb kinematic data for 15 participants were computed using 2D pose estimation, our 3D fusion process and OpenSim based inverse kinematics modelling. Results demonstrated high levels of agreement for lower limb joint angles, with mean differences ranging between 0.1{degrees} - 10.5{degrees} for 6 DoF hip joint rotations, and 0.7{degrees} - 3.9{degrees} for knee and ankle rotations. These differences generally fall within the documented uncertainties of marker-based motion capture, suggesting that our markerless approach could be used for appropriate biomechanics applications. We used an open-source, modular and customisable workflow, allowing for integration with other popular biomechanics tools such as OpenSim. By developing open-source tools, we hope to facilitate the democratisation of markerless motion capture technology and encourage the transparent development of markerless methods. This presents exciting opportunities for biomechanics researchers and practitioners to capture large amounts of high quality, ecologically valid data both in the laboratory and in the wild.
02 /Specification & Classification
Click any tag to browse matching papers- Assay
- Approach
Reproducibility ledger
Nobody has reported trying to reproduce this paper yet. Did you replicate an experiment or run the code? Your report saves the next lab a week.
Sign in to file a reproducibility report.
Related papers
- Concurrent assessment of gait kinematics using marker-based and markerless motion capture
R. M. Kanko, E. K. Laende, … K. J. Deluzio·bioRxiv·Dec 10, 2020
- Moving outside the lab: markerless motion capture accurately quantifies sagittal plane kinematics during the vertical jump
J. F. Drazan, W. T. Phillips, … J. R. Baxter·bioRxiv·Mar 16, 2021
- Markerless motion capture estimates of lower extremity kinematics and kinetics are comparable to marker-based across 8 movements
K. Song, T. J. Hullfish, … J. R. Baxter·bioRxiv·Feb 21, 2023
- Evaluation of 3D markerless motion capture accuracy using OpenPose with multiple video cameras
Nobuyasu Nakano, 哲郎 櫻, … Shinsuke Yoshioka·Frontiers in Sports and Active LivingPeer-reviewed·May 27, 2020
- The Effect of Synthetic Training Data on the Performance of a Deep Learning Based Markerless Biomechanics System
T. N. Templin, T. D. Eliason, … D. P. Nicolella·bioRxiv·Oct 19, 2023
- Human Movement Science in The Wild: Can Current Deep-Learning Based Pose Estimation Free Us from The Lab?
L. Needham, M. Evans, … S. L. Colyer·bioRxiv·Apr 22, 2021