Author

Jesse Vig

Salesforce (United States)ORCID 0009-0004-4863-4165Unclaimed ORCID profile · follow to get notified of new preprints

Biology Disciplines

Click to filter author papers

Signature Assays, Organisms & Methods

Click to filter · or open tag

Approach:deep learning· 1 Assay:protein sequence· 1 Assay:protein structure· 1 Research Focus:protein structure prediction· 1 Approach:transformer / foundation model· 1

Frequent Co-Authors

Ali MadaniiD· 1 shared Caiming XiongiD· 1 shared Lav R. VarshneyiD· 1 shared Nazneen Fatema RajaniiD· 1 shared Richard SocheriD· 1 shared

Activity by Year

2020-2020 · peak 1/yr

Co-Author Collaboration Network

5 top collaborators · 10 mutual co-author links

Click any collaborator node to inspect or filter shared papers

Focal author (center)Selected co-authorORCID co-authorUnlinked name

Curved chords = mutual co-authorship

1 shared paperBioinformatics

Ali MadaniORCID

Mutual co-authors in cluster

Author profile →

1 paper

Recent·Most cited

BERTology Meets Biology: Interpreting Attention in Protein Language Models

Jesse Vig, Ali Madani, Lav R. Varshney, Caiming Xiong, Richard Socher, Nazneen Fatema Rajani

One attention head of a protein BERT model tracks 3D contacts (28% vs 1.3% background); other heads target binding sites, and deeper layers attend to higher-level properties.

bioRxiv · Jun 26, 2020 · PreprintBioinformatics✦ In-depth digest