Relation is an option for processing context information
Kazunori D. Yamada, Mohammad Samy Baladram, Fangzhou Lin
This paper introduces a new mechanism called 'relation' that processes context information efficiently, achieving similar performance to attention mechanisms with lower time complexity.
Frontiers in Artificial Intelligence · Oct 11, 2022Peer-reviewedNeuroscience