British Journal of PharmacologyNeurosciencePeer-reviewed journal article
A Systematic Assessment of Robustness in CNS Safety Pharmacology
Maria ReiberiD, Helen StirlingiD, Tim P. AhuisiD, Washington Arias, Katharina Aulehner, Ute Dreßler, Martien J. KasiD, Johanna Kela, Kimberly Kerker, Tarja Kuosmanen, Helga Lorenz, Alexander T. Pennington, Eva‐Lotta von RüdeniD, Heike SchauerteiD, Isabel Seiffert, Steven Roger TalbotiD, Christina L Torturo, Sami M. M. Virtanen, Ann‐Marie WaldroniD, Sylvie Ramboz, Heidrun PotschkaiD
- Citations
- 2
- FWCI
- 1.09
- Field percentile
- top 24%
Abstract
Irwin tests are key preclinical study elements for characterizing drug-induced neurological side effects. This multicenter study aimed to assess the robustness of Irwin tests across multinational sites during three stages of protocol harmonization. The projects were part of the EQIPD framework (Enhanced Quality in Preclinical Data, https://quality-preclinical-data.eu/), aiming to increase success rates in transition from preclinical testing to clinical application. Female and male NMRI mice were assigned to one of three groups (vehicle, 0.1 mg/kg MK-801, 0.3 mg/kg MK-801). Irwin scores were assessed at baseline and multiple times following injection of MK-801, a non-competitive NMDA antagonist, using local protocols (stage 1), a shared protocol with harmonized environmental design (stage 2), and fully harmonized Irwin scoring protocols (stage 3). The analysis based on the four functional domains (motor, autonomic, sedation, and excitation) revealed substantial data variability in stages 1 and 2. Although there was still marked overall heterogeneity between sites in stage 3 after complete harmonization of the Irwin scoring scheme, heterogeneity was only moderate within functional domains. When comparing treatment groups vs. vehicle, we found large effect sizes in the motor domain and subtle to moderate effects in the excitation-related and autonomic domain. The pronounced interlaboratory variability in Irwin datasets for the CNS-active compound MK-801 needs to be carefully considered by companies and experimenters when making decisions during drug development. While environmental and general study design had a minor impact, the study suggests that harmonization of parameters and their scoring can limit variability and increase robustness.
Reproducibility ledger
Nobody has reported trying to reproduce this paper yet. Did you replicate an experiment or run the code? Your report saves the next lab a week.
Sign in to file a reproducibility report.
Related papers
- The Importance of Individual Beliefs in Assessing Treatment Efficacy: Insights from Neurostimulation Studies
Luisa Fassi, Shachar Hochman, … Roi Cohen Kadosh·bioRxiv·Dec 6, 2020
- Improved Injury Detection Through Harmonizing Multi-Site Neuroimaging Data after Experimental TBI: A Translational Outcomes Project in NeuroTrauma (TOP-NT) Consortium Study
Gregory Kislik, R. Fox, … the TOP-NT Investigators·Frontiers in NeurologyPeer-reviewed·Aug 20, 2025
- Test-Retest Reliability and repeatability of Behavioral and Electrophysiological Markers in an Eriksen Flanker Task
Mario Bogdanov, Jason N. Scott, … Diego A. Pizzagalli·bioRxiv·Sep 28, 2024
- Motor Evoked Potentials in Preclinical Models of Spinal Cord Injury and Stroke in Rodents: A Systematic Review.
Rubab Shahid, Dylan F. Cooke, Gustavo Catusso Balbinot·bioRxiv·Oct 15, 2026
- Impaired refinement of kinematic variability in Huntington disease mice on an automated home-cage forelimb motor task
Cameron L. Woodard, Marja D. Sepers, Lynn A. Raymond·Journal of NeurosciencePeer-reviewed·Aug 24, 2021
- A multi-center study on factors influencing the reproducibility of in vitro drug-response studies
M. Niepel, M. Hafner, … P. K. Sorger·bioRxiv·Feb 5, 2019