BioinformaticsbioRxivPreprint
From Mechanistic Interpretability to Mechanistic Biology: Training, Evaluating, and Interpreting Sparse Autoencoders on Protein Language Models
Etowah Adams, Liam Bai, Minji Lee…·Mohammed AlQuraishi
The paper trains sparse autoencoders on a protein language model to identify features that represent protein sequences, revealing both generic and family-specific patterns and their potential biological roles.
23 citations