bioRxivBioinformaticsPreprint
GlycanGT: A Foundation Model for Glycan Graphs with Pretrained Representation and Generative Learning
Akihiro KitaniiD, Bingyuan ZhangiD, Koichi HimoriiD, Yusuke MatsuiiD
Abstract
MotivationGlycans are highly diverse biological sequences, but their functional understanding has lagged behind that of proteins and nucleic acids. Many glycans remain incompletely characterized or ambiguously annotated, limiting computational analyses. Existing computational approaches are primarily graph-based, capturing local structural features but struggling to model global patterns and incomplete sequences. ResultsWe present GlycanGT, a foundation model for glycans built on a graph transformer architecture. Glycans were represented as graphs with monosaccharides as nodes and glycosidic bonds as edges, and the model was pretrained using a masked language modeling objective. GlycanGT demonstrated higher performance than existing methods across 8 benchmark classification tasks (e.g., 0.734 Macro-F1 in domain prediction and 0.844 AUPRC for immunogenicity classification), and its embeddings formed biologically meaningful clusters that recovered known N- and O-glycan categories. Moreover, GlycanGT accurately proposed candidates for ambiguous sequences, maintaining >80% top-5 accuracy for both monosaccharide and glycosidic bond predictions under high masking levels. Availability and implementationThe pretrained GlycanGT model weights and usage scripts are available on Hugging Face: https://huggingface.co/Akikitani295/GlycanGT. Additional scripts used for analyses in the paper are publicly available on GitHub: https://github.com/matsui-lab/GlycanGT. Contact: matsui.yusuke.d4@f.mail.nagoya-u.ac.jp
- research focus: benchmarking
- research focus: gene regulatory network inference
- approach: transformer / foundation model
- Citations
- 1
Reproducibility ledger
Nobody has reported trying to reproduce this paper yet. Did you replicate an experiment or run the code? Your report saves the next lab a week.
Sign in to file a reproducibility report.
Related papers
- Using Graph Convolutional Neural Networks to Learn a Representation for Glycans
Rebekka Burkholz, John F Quackenbush, Daniel Bojar·Cell ReportsPeer-reviewed·Jun 1, 2021
- Using Natural Language Processing to Learn the Grammar of Glycans
Daniel Bojar, Diogo M. Camacho, James J. Collins·bioRxiv·Jan 10, 2020
- Chemical foundation models reveal molecular principles underlying glycobiology
Manuel Sokolov Ravasqueira, Joao H. Bettencourt‐Silva, … Gavin P. Davey·bioRxiv·Oct 14, 2026
- Attention please: modeling global and local context in glycan structure-function relationships
Bowen Dai, Daniel E. Mattox, Chris Bailey‐Kellogg·bioRxiv·Oct 15, 2021
- StackGlyEmbed: Prediction of N-linked Glycosylation sites using protein language models
Md Muhaiminul Islam Nafi, Mohammad Saifur Rahman·Bioinformatics AdvancesPeer-reviewed·Dec 26, 2024
- Glycowork: A Python package for glycan data science and machine learning
Luc Thomès, Rebekka Burkholz, Daniel Bojar·GlycobiologyPeer-reviewed·Jun 25, 2021