Compositional transformations can reasonably introduce phenotype-associated values into sparse features
Abstract
It was recently argued1 that an analysis of tumor-associated microbiome data2 is invalid because features that were originally very sparse (genera with mostly zero read counts) became associated with the phenotype following batch correction1. Here, we examine whether such an observation should necessarily indicate issues with processing or machine learning pipelines. We show counterexamples using the centered log ratio (CLR) transformation, which is often used for analysis of compositional microbiome data3. The CLR transformation has similarities to Voom-SNM4,5, the batch-correction method brought into question1,2, yet is a sample-wise operation that cannot, in itself, "leak" information or invalidate downstream analyses. We show that because the CLR transformation divides each value by the geometric mean of its sample, common imputation strategies for missing or zero values result in transformed features that are associated with the geometric mean. Through analyses of both synthetic and vaginal microbiome datasets we demonstrate that when the geometric mean is associated with a phenotype, sparse and CLR-transformed features will also become associated with it. We re-analyze features highlighted by Gihawi et al.1 and demonstrate that the phenomenon of sparse features becoming phenotype-associated can also be observed after a CLR transformation, which serves as a counterexample to the claim that such an observation necessarily means information leakage. While we do not intend to address other concerns regarding tumor microbiome analyses1,6, validate Poore et al.s2 results, or evaluate batch-correction pipelines, we conclude that because phenotype-associated features that were initially sparse can be created by a sample-wise transformation that cannot artifactually inflate machine learning performance, their detection is not independently sufficient to demonstrate information leakage in machine learning pipelines. Microbiome data is multivariate, and as such, a value of zero carries a different meaning for each sample. Many transformations, including CLR and other batch-correction methods, are likewise multivariate, and, as these issues demonstrate, each individual feature should be interpreted with caution.
02 /Specification & Classification
Click any tag to browse matching papers- Citations
- 11
- FWCI
- 3.01
- Field percentile
- top 8%
- Assay
- Research Focus
- Approach
Reproducibility ledger
Nobody has reported trying to reproduce this paper yet. Did you replicate an experiment or run the code? Your report saves the next lab a week.
Sign in to file a reproducibility report.
Related papers
- Effects of Data Transformation and Model Selection on Feature Importance in Microbiome Classification Data
Zuzanna Karwowska, Oliver Aasmets, … Elin Org·bioRxiv·Sep 19, 2023
- Compositional data analysis of microbiome and any-omics datasets: a revalidation of the additive logratio transformation
Michael John Greenacre, Marina Martínez-Álvaro, A. Blasco·Frontiers in MicrobiologyPeer-reviewed·Oct 11, 2021
- A conceptual framework for revealing minor bacterial signals inmicrobiome data through guided data transformation
David Martin, Pierre Houedry, … Valérie Monbet·Methods in Ecology and EvolutionPeer-reviewed·Dec 8, 2025
- Compositionally aware estimation of cross-correlations for microbiome data
Ib Thorsgaard Jensen, Luc Janss, … Rasmus Plenge Waagepetersen·PLoS ONEPeer-reviewed·Jun 28, 2024
- Correcting for Background Noise Improves Phenotype Prediction from Human Gut Microbiome Data
Leah Briscoe, Brunilda Balliu, … Nandita R. Garud·bioRxiv·Mar 19, 2021
- A phylogenetic transform enhances analysis of compositional microbiota data
Justin D Silverman, Alex Washburne, … Lawrence A David·bioRxiv·Aug 31, 2016