iafarhan / causal-synthesizer-multihead-attention Goto Github PK
View Code? Open in Web Editor NEWSynthesizer Self-Attention is a very recent alternative to causal self-attention that has potential benefits by removing this dot product.
License: MIT License