Life as a Function: Why Transformer Architectures Struggle to Gain Genome-Level Foundational Capabilities
Hassan Hassan, Kyle R. Puhger, Ali Saadat, Johannes U. Mayer, Maximilian Sprang
This study shows that transformer models struggle to capture DNA's functional complexity, suggesting inherent limitations that scale cannot overcome.
bioRxiv · Jan 13, 2025 · PreprintSynthetic Biology