A Taxonomy-Informed Sparse DNA Foundation Model for Microbial Genomics
Athan Z. Li, Shiyuan Wang, Shupeng Cheng…·Ruishan Liu
A sparse mixture-of-experts DNA model conditioned on hyperbolic taxonomy embeddings learns better microbial representations than its taxonomy-free twin and comes close to Evo2-7B in probing and fine-tuning at lower compute.