Development and Validation of the Transcranial Magnetic Stimulation Reporting Assessment Tool(TMS-RAT)

HighlightsO_LIWe introduce the TMS-RAT, a reporting (assessment) tool for TMS studies C_LIO_LIDeveloped within a community-informed, iterative process rating 333 TMS studies C_LIO_LIEmpirically evaluated for usability, inter-rater, and test-retest reliability C_LIO_LIA validated subset enables reliable retrospective assessment of reporting C_LIO_LIThe modular structure enables use across a wide range of TMS study designs C_LI BackgroundA standardised tool for comprehensive reporting can improve transparency, support consistent documentation, and enable comparison across transcranial magnetic stimulation (TMS) studies. The most used reporting checklist lacks clear definitions of full reporting and was not initially evaluated for usability or inter-rater reliability. A scoping review of studies using this checklist shows that its items are reported only 50% of the time, suggesting that method descriptions are often incomplete. MethodsWe developed the TMS Reporting Assessment Tool (TMS-RAT), a comprehensive reporting framework that provides clear definitions and examples for its items, covering a wide range of TMS protocols. We tested the usability and reliability of the TMS-RAT by rating all studies published between 1991 and 2025 using afferent conditioning (n = 333), a protocol encompassing many reporting categories identified during tool development. Seventeen independent raters contributed across three development phases, a validation phase, and a retest phase, with naive raters introduced in each phase. Iterative refinements of the tool were informed by inter-rater reliability, qualitative rater feedback, and consultation with external TMS experts. ResultsWe present two versions of the tool: the 72-item TMS-RAT v1.0, designed to guide comprehensive reporting, and the TMS-RAT v1.1, a subset of 50 items with the highest inter-rater (overall AC1 = 0.78, range = [0.60-0.99]) and test-retest reliability (overall AC1 = 0.82, range = [0.65-1.0]), intended for retrospective evaluation of reporting in systematic reviews, meta-analyses. ConclusionThe TMS-RAT is a comprehensive, reliable tool that seeks to improve transparency and reproducibility in TMS research.