A geometric atlas of how ESM3 organizes modalities across depth
The paper analyzes how ESM3, a multimodal protein language model, organizes different modalities across its depth, finding that physical modalities fuse into a shared subspace while functional annotations remain orthogonal.