BioinformaticsbioRxivPreprint
Self-Supervised Contrastive Learning of Protein Representations By Mutual Information Maximization
Amy X. Lu, Haoran Zhang, Marzyeh Ghassemi, Alan M Moses
CPCProt pretrains protein embeddings by telling a protein's own next fragment from fragments of random proteins, reportedly matching benchmarked self-supervised models with 2-10% of their parameters.