LAMPP: A benchmark for continuous evaluation of host phenotype prediction from shotgun metagenomic data

Abstract

Predicting host phenotypes from shotgun metagenomic data is essential for translating microbiome research into clinical practice)Despite the development of numerous computational tools for this task, researchers often default to traditional machine learning methods such as Random Forest)This hesitancy to adopt newer methods stems from their complexity as well as the lack of standardized evaluations, as most tools are assessed on different datasets and compared against a limited set of methods)Here, we introduce LAMPP, a standardized benchmark for evaluating methods for predicting host phenotypes from gut metagenomic data)LAMPP features a diverse range of prediction tasks and enables consistent, comparative assessments across prediction tools)Our systematic evaluation of existing tools shows that classic machine learning methods (e.g., Random Forest) perform competitively, offering both ease of use and state-of-the-art results)At the same time, it demonstrates that microbiome-based phenotype prediction remains a challenging problem)By providing a consistent platform for ongoing evaluation and access to raw sequencing data, LAMPP motivates the development of novel prediction pipelines from raw sequencing data to phenotype prediction, including novel sample representation and data augmentation strategies)LAMPP is publicly available for ongoing benchmarking at https://lampp.yassourlab.com/.