bioRxivMicrobiologyPreprint
MIPMLP - Microbiome Pre-processing Machine Learning Pipeline.
Y. Jasner, A. belogolovski, M. Ben Izhak, O. Koren, Y. Louzoun
Abstract
16S sequencing results are often used for Machine Learning (ML) tasks. 16S gene sequences are represented as feature counts, which are associated with taxonomic representation. Raw feature counts may not be the optimal representation for ML. We checked multiple preprocessing steps and tested the optimal combination for 16S sequencing-based classification tasks. We computed the contribution of each step to the accuracy as measured by the Area Under Curve (AUC) of the classification. We show that the log of the feature counts is much more informative than the relative counts. We further show that merging features associated with the same taxonomy at a given level, through a dimension reduction step for each group of bacteria improves the AUC. Finally, we show that z-scoring has a very limited effect on the results. These preprocessing steps are integrated into the MIPMLP - Microbiome Preprocessing Machine Learning Pipeline, which is available as a stand alone version at https://github.com/louzounlab/microbiome/tree/master/Preprocess or as a service at http://mip-mlp.math.biu.ac.il/Home ImportanceMicrobiome composition has been proposed as a biomarker (mic-marker) for multiple diseases. However, a clear analysis of the optimal way to represent the gene sequence counts is still lacking. We propose a simple and straight forward method that significantly improves the accuracy of mic-marker studies. This method can be of use to merge two of the most important advances in biology in the last decade: Microbiome analysis, and the introduction of machine learning methods to biological studies.
Reproducibility ledger
Nobody has reported trying to reproduce this paper yet. Did you replicate an experiment or run the code? Your report saves the next lab a week.
Sign in to file a reproducibility report.
Related papers
- Effects of Data Transformation and Model Selection on Feature Importance in Microbiome Classification Data
Zuzanna Karwowska, Oliver Aasmets, … Elin Org·bioRxiv·Sep 19, 2023
- TaxaHFE: A machine learning approach to collapse microbiome datasets using taxonomic structure
Andrew S. Oliver, Matthew Kay, Danielle G. Lemay·Bioinformatics AdvancesPeer-reviewed·Jan 1, 2023
- 16S rRNA sequence embeddings: Meaningful numeric feature representations of nucleotide sequences that are convenient for downstream analyses
Stephen Woloszynek, Zhengqiao Zhao, … GAIL L. ROSEN·PLoS Computational BiologyPeer-reviewed·Feb 26, 2019
- SpeciesMLP: Sequence based Multi-layer Perceptron for Amplicon Read Classification Using Real-time Data Augmentation
Ali Kishk, Mohamed S. El-Hadidi·bioRxiv·Sep 18, 2018
- From microbial diversity to function; evaluating dimensionality reduction methods
Emelia J. Chamberlain, William Boulton, … Heather H Kim·bioRxiv·Oct 30, 2025
- Uncertainty Modeling Outperforms Machine Learning for Microbiome Data Analysis
Maxwell A. Konnaris, Manan Saxena, … Justin D. Silverman·bioRxiv·Sep 12, 2025