eLifeGenetic & Genomic MedicinePeer-reviewed journal article
Risk factors affecting polygenic score performance across diverse cohorts
Daniel HuiiD, SCOTT M. DUDEKiD, Krzysztof KirylukiD, Theresa L. WalunasiD, Iftikhar J. KulloiD, Wei‐Qi WeiiD, Hemant K. TiwariiD, Josh F. PetersoniD, Wendy K. ChungiD, Brittney H. DavisiD, Atlas KhaniD, Leah Claire KottyaniD, Nita A. LimdiiD, QiPing FengiD, Megan J. PuckelwartziD, Chunhua WengiD, Johanna L. SmithiD, Elizabeth W. KarlsoniD, Penn Medicine BioBank, Gail P Jarvik, Marylyn DeRiggi RitchieiD
Abstract
Apart from ancestry, personal or environmental covariates may contribute to differences in polygenic score (PGS) performance. We analyzed effects of covariate stratification and interaction on body mass index (BMI) PGS (PGSBMI) across four cohorts of European (N=491,111) and African (N=21,612) ancestry. Stratifying on binary covariates and quintiles for continuous covariates, 18/62 covariates had significant and replicable R2 differences among strata. Covariates with the largest differences included age, sex, blood lipids, physical activity, and alcohol consumption, with R2 being nearly double between best and worst performing quintiles for certain covariates. 28 covariates had significant PGSBMI-covariate interaction effects, modifying PGSBMI effects by nearly 20% per standard deviation change. We observed overlap between covariates that had significant R2 differences among strata and interaction effects - across all covariates, their main effects on BMI were correlated with their maximum R2 differences and interaction effects (0.56 and 0.58, respectively), suggesting high-PGSBMI individuals have highest R2 and increase in PGS effect. Using quantile regression, we show the effect of PGSBMI increases as BMI itself increases, and that these differences in effects are directly related to differences in R2 when stratifying by different covariates. Given significant and replicable evidence for context-specific PGSBMI performance and effects, we investigated ways to increase model performance taking into account non-linear effects. Machine learning models (neural networks) increased relative model R2 (mean 23%) across datasets. Finally, creating PGSBMI directly from GxAge GWAS effects increased relative R2 by 7.8%. These results demonstrate that certain covariates, especially those most associated with BMI, significantly affect both PGSBMI performance and effects across diverse cohorts and ancestries, and we provide avenues to improve model performance that consider these effects.
- organism: human
- assay: GWAS summary statistics
- research focus: benchmarking
- research focus: gene regulatory network inference
- research focus: variant effect prediction
- approach: statistical model
- approach: machine learning (classical)
- Citations
- 2
- FWCI
- 0.58
- Field percentile
- top 43%
Reproducibility ledger
Nobody has reported trying to reproduce this paper yet. Did you replicate an experiment or run the code? Your report saves the next lab a week.
Sign in to file a reproducibility report.
Related papers
- Quantifying factors that affect polygenic risk score performance across diverse ancestries and age groups for body mass index
Daniel J. Hui, Brenda Xiao, … Marylyn DeRiggi Ritchie·Pacific Symposium on Biocomputing (PSB)Peer-reviewed·Nov 1, 2022
- Optimal strategies for learning multi-ancestry polygenic scores vary across traits
Brieuc Lehmann, Maxine E. Mackintosh, … Chris C. Holmes·Nature CommunicationsPeer-reviewed·Jul 7, 2023
- Polygenic scores capture genetic modification of the adiposity-cardiometabolic risk factor relationship
Kenneth E. Westerman, Julie E Gervis, … Alisa Knodle Manning·Cell GenomicsPeer-reviewed·Nov 25, 2025
- Highly parameterized polygenic scores tend to overfit to population stratification via random effects
Alan J. Aw, Jeremy F. McRae, … Yun S. Song·bioRxiv·Jan 27, 2024
- Putting Polygenic Scores in Context: How Intersectional Factors Affect Relative and Absolute Genetic Risk
Mihael Cudic, Justin D. Tubbs, … Jordan W. Smoller·The American Journal of Human GeneticsPeer-reviewed·Apr 13, 2026
- Locus-specific gene-context interactions improve polygenic prediction
Renée Fonseca, Christa Caggiano, … Andy Dahl·bioRxiv·Aug 28, 2026