Yingtao Luo

scLong is a billion-parameter foundation model that captures long-range gene context in scRNA-seq by modeling all genes and integrating gene knowledge, outperforming existing models in various tasks.

This paper introduces a VQ-VAE-based protein structure tokenizer that balances reconstruction and retrieval, improving alignment with sequence models for better structure prediction.