NeuroscienceFrontiers in Artificial IntelligencePeer-reviewed
Relation is an option for processing context information
Kazunori D. Yamada, Mohammad Samy Baladram, Fangzhou Lin
This paper introduces a new mechanism called 'relation' that processes context information efficiently, achieving similar performance to attention mechanisms with lower time complexity.