Материалы по теме:
FT Edit: Access on iOS and web
。关于这个话题，91视频提供了深入分析
Self-attention is required. The model must contain at least one self-attention layer. This is the defining feature of a transformer — without it, you have an MLP or RNN, not a transformer.
Lilly-Mae Messenger,West of England