Distinguishing word identity and sequence context in DNA language models
Melissa Sanabria, Jonas Hirsch, Anna R. Poetsch
The paper evaluates DNA language models by assessing their ability to distinguish sequence context from token identity, finding that overlapping k-mer tokenization limits context learning.
BMC Bioinformatics · Sep 13, 2024Peer-reviewedBioinformatics