Author

Nazneen Fatema Rajani

University of Illinois Urbana-ChampaignORCID 0000-0001-6301-1960Unclaimed ORCID profile · follow to get notified of new preprints

Biology Disciplines

Click to filter author papers

Bioinformatics· 1

Signature Assays, Organisms & Methods

Click to filter · or open tag

Approach:deep learning· 1 Assay:protein sequence· 1 Assay:protein structure· 1 Research Focus:protein structure prediction· 1 Approach:transformer / foundation model· 1

Frequent Co-Authors

Ali MadaniiD· 1 shared Caiming XiongiD· 1 shared Jesse VigiD· 1 shared Lav R. VarshneyiD· 1 shared Richard SocheriD· 1 shared

Activity by Year

2020-2020 · peak 1/yr

Co-Author Collaboration Network

5 top collaborators · 10 mutual co-author links

Click any collaborator node to inspect or filter shared papers

Focal author (center)Selected co-authorORCID co-authorUnlinked name

Curved chords = mutual co-authorship

1 shared paperBioinformatics

Ali MadaniORCID

Mutual co-authors in cluster

Author profile →

1 paper

Recent·Most cited

BioinformaticsbioRxivPreprintJun 26, 2020

✦ In-depth digest

BERTology Meets Biology: Interpreting Attention in Protein Language Models

Jesse Vig, Ali Madani, Lav R. Varshney…·Nazneen Fatema Rajani

One attention head of a protein BERT model tracks 3D contacts (28% vs 1.3% background); other heads target binding sites, and deeper layers attend to higher-level properties.

338 citations

protein sequenceprotein structure

𝕏 PostBluesky