Prediction of Systemic Lupus Erythematosus from Genotype and Gene-Expression Data: Batch Correction and Leakage Free Evaluation
Vasudha KannaniD, Karthik RiD, Aldis DanieliD, Hitesh Kandarpa
Abstract
Systemic Lupus Erythematosus (SLE) is a complex autoimmune disease with a strong genetic component and highly variable clinical features. Because of this heterogeneity, predicting disease status remains challenging using any single marker alone. In this study, we explore two complementary data sources: (1) genotypes at 30 candidate SNPs in a South Indian case-control cohort (n = 425) and (2) bulk expression of 13 genes from the same pathways, curated from six GEO series (n = 642 SLE or control samples from 483 individuals), to investigate whether they can distinguish SLE cases from healthy controls. The expression data were placed on a common log2 scale and corrected for batch effects using mean-only ComBat. To avoid data leakage, ComBat, gene filtering, scaling, and model fitting were re-estimated within every training fold, and all samples from the same individual were kept in the same fold. Performance was summarised using ROC-AUC, precision-recall AUC (PR-AUC), and the Matthews correlation coefficient (MCC) over 10 x 5-fold cross-validation. Models were interpreted using out-of-fold SHAP values, and the entire pipeline was evaluated using label permutations. For the SNP data, dominant encoding with age and sex gave ROC-AUC 0.699 {+/-} 0.052, PR-AUC 0.668 {+/-} 0.063, and MCC 0.309 {+/-} 0.101. However, this performance depended on four SNPs that deviated from Hardy-Weinberg equilibrium in controls. Without these SNPs, the SNPs added little predictive value beyond age and sex (ROC-AUC 0.656). The strongest single association, at MTRR A66G, resulted from an excess of heterozygotes among controls, a pattern typical of genotyping error. In contrast, homozygous CYP1A1 M2 and COMT genotypes, as well as CYP1A1 M4 carriers, were enriched in cases, pointing to a possible role for xenobiotic metabolism. The leakage-free expression classifiers achieved ROC-AUC values of 0.837 {+/-} 0.033 for L1-penalised logistic regression and 0.915 {+/-} 0.021 for XGBoost. Shuffled labels produced chance-level results, supporting the absence of label leakage in the pipeline. However, a model using only the study label achieved an ROC-AUC of 0.857, indicating strong confounding between disease status and study identity. Within individual studies, ROC-AUC was 0.743 for L1-penalised logistic regression and 0.835 for XGBoost. Performance fell to 0.46-0.74 when entire studies were held out. Lower MTR expression was the most important and consistent expression feature, whereas two other highly ranked genes, CYP1A1 and GSTT1, carried little predictive signal within individual studies. These findings show that, in pooled multi-study expression data, leakage-free cross-validation alone does not guarantee reliable performance estimates. Batch-label confounding and genotype quality must also be assessed directly.
02 /Specification & Classification
Click any tag to browse matching papers- Citations
- 0
- Organism
- Assay
- Research Focus
- Approach
Reproducibility ledger
Nobody has reported trying to reproduce this paper yet. Did you replicate an experiment or run the code? Your report saves the next lab a week.
Sign in to file a reproducibility report.
Related papers
- Genomic dissection of Systemic Lupus Erythematosus: Distinct Susceptibility, Activity and Severity Signatures
Nikolaos I. Panousis, George K Bertsias, … Dimitrios T. Boumpas·bioRxiv·Jan 27, 2018
- Ethnicity-specific transcriptomic variation in immune cells and correlation with disease activity in systemic lupus erythematosus
Gaia Andreoletti, Cristina M. Lanata, … Marina Sirota·bioRxiv·Oct 30, 2020
- Genetic load in incomplete lupus erythematosus
M. Slief, J. Kheir, … J. M. Guthridge·bioRxiv·Feb 14, 2022
- Genome-wide genetic risk for SLE and disease severity
Lingyan Chen, Yongfei Wang, … David Lester Morris·Human Molecular GeneticsPeer-reviewed·Feb 17, 2020
- Machine learning applied to whole-blood RNA-sequencing data uncovers distinct subsets of patients with systemic lupus erythematosus
William A. Figgett, Katherine Monaghan, … Fabienne Mackay·Clinical & Translational ImmunologyPeer-reviewed·Jan 1, 2019
- Genome-wide Association Clustering Meta-analysis in European and Chinese Datasets for Systemic Lupus Erythematosus identifies new genes
Mohammad Saeed·medRxiv·Jul 7, 2023