Brain CommunicationsNeurosciencePeer-reviewed journal article
Ground-truth validation of uni- and multivariate lesion inference approaches
Melissa ZavagliaiD, Caroline MalherbeiD, Sebastian Schlaadt, Parashkev NacheviD, Claus Christian HilgetagiD
Abstract
Lesion analysis aims to reveal causal contributions of brain regions to brain functions. Various strategies have been used for such lesion inferences. These approaches can be broadly categorized as univariate or multivariate methods. Here we analysed data from 581 patients with acute ischemic injury, parcellated into 41 Brodmann areas, and systematically investigated the inferences made by two univariate and two multivariate lesion analysis methods via ground-truth simulations, in which we defined a priori contributions of brain areas to assumed brain function. Particularly, we analysed single-region models, with only single areas presumed to contribute functionally, and multiple-region models, with two contributing regions that interacted in a synergistic, redundant or mutually inhibitory mode. The functional contributions could vary in proportion to the lesion damage or in a binary way. The analyses showed a considerably better performance of the tested multivariate than univariate methods in terms of accuracy and mis-inference error. Specifically, the univariate approaches of Lesion Symptom Mapping (LSM) as well as Lesion Symptom Correlation (LSC) mis-inferred substantial contributions from several areas even in the single-region models, and also after accounting for lesion size. By contrast, the multivariate approaches of Multi- Area Pattern Prediction (MAPP), which is based on machine learning, and Multi-perturbation Shapley value Analysis (MSA), based on coalitional game theory, delivered consistently higher accuracy and specificity. Our findings suggest that the tested multivariate approaches produce largely reliable lesion inferences, without requiring lesion size consideration, while the application of the univariate methods may yield substantial mis-localizations that limit the reliability of functional attributions.
- organism: human
- research focus: benchmarking
- approach: statistical model
- approach: machine learning (classical)
- Citations
- 12
- FWCI
- 2.92
- Field percentile
- top 9%
Reproducibility ledger
Nobody has reported trying to reproduce this paper yet. Did you replicate an experiment or run the code? Your report saves the next lab a week.
Sign in to file a reproducibility report.
Related papers
- An empirical comparison of univariate versus multivariate methods for the analysis of brain-behavior mapping
Maria V. Ivanova, Timothy J. Herron, … Juliana V. Baldo·Human Brain MappingPeer-reviewed·Nov 20, 2020
- Improved accuracy of lesion to symptom mapping with multivariate sparse canonical correlations
Dorian Pustina, Brian Avants, … H. Branch Coslett·NeuropsychologiaPeer-reviewed·Sep 4, 2017
- Rethinking causality and data complexity in brain lesion-behaviour inference and its implications for lesion-behaviour modelling
Christoph Sperber·CortexPeer-reviewed·Jan 24, 2020
- Methodological choices strongly modulate the sensitivity and specificity of lesion-symptom mapping analyses
Margaret Jane Moore, Chris Rorden, … Nele Demeyere·Human Brain MappingPeer-reviewed·Jul 30, 2026
- An empirical evaluation of multivariate lesion behaviour mapping using support vector regression
Christoph Sperber, Daniel Wiesen, Hans‐Otto Karnath·Human Brain MappingPeer-reviewed·Dec 13, 2018
- Atlas-based classification algorithms for identification of informative brain regions in fMRI data
Juan Eloy Arco, Paloma Díaz-Gutiérrez, … Marı́a Ruz·NeuroinformaticsPeer-reviewed·Aug 11, 2019