首页>
外国专利>
ATTENTION NEURAL NETWORKS WITH TALKING HEADS ATTENTION
ATTENTION NEURAL NETWORKS WITH TALKING HEADS ATTENTION
展开▼
机译：注意神经网络与谈话头部关注
展开▼
页面导航
摘要
著录项
相似文献
摘要
Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for performing a machine learning task on a network input to generate a network output. In one aspect, one of the systems includes an attention neural network configured to perform the machine learning task, the attention neural network including one or more attention layers, each attention layer comprising an attention sub-layer and, optionally, a feed-forward sub-layer. At least one of the attention layers includes an attention sub-layer that applies talking heads attention instead of conventional multi-head attention.
展开▼
