)V. (2) MSA is constructed based on Attention by split the channels ofQ,K and V into h groups with each group apart ofqueries, keys,and valuesQi,Ki RN