BioinformaticsBioinformaticsPeer-reviewed
Effect of Tokenization on Transformers for Biological Sequences
Edo Dotan, Gal Jaschek, Tal Pupko, Yonatan Belinkov
This study evaluates how different tokenization methods affect transformer models' performance on various biological sequence tasks, showing improved accuracy and efficiency with optimized tokenizers.
50 citationstop 2%