Pytorch implementation of Self-Attention Generative Adversarial Networks (SAGAN)
Implementation of various self-attention mechanisms focused on computer vision. Ongoing repository.
Attention mechanism for processing sequential data that considers the context for each timestamp.
Simple Tensorflow implementation of "Self-Attention Generative Adversarial Networks" (SAGAN)
A Structured Self-attentive Sentence Embedding
Implementing Stand-Alone Self-Attention in Vision Models using Pytorch
Exploring Self-attention for Image Recognition, CVPR2020.
Learning Lightweight Lane Detection CNNs by Self Attention Distillation (ICCV 2019)
自注意力与文本分类
document classification using LSTM + self attention
Awesome Transformers (self-attention) in Computer Vision
A variant of the Self Attention GAN named: FAGAN (Full Attention GAN)
Self-attention、Non-local、SE、SK、CBAM、DANet
Representation learning on dynamic graphs using self-attention networks
Implementation of Nyström Self-attention, from the paper Nyströmformer
Source code for "On the Relationship between Self-Attention and Convolutional Layers"
翻译 - “关于自我注意和卷积层之间的关系”的源代码
Visualize BERT's self-attention layers on text classification tasks
Universal Graph Transformer Self-Attention Networks (TheWebConf WWW 2022) (Pytorch and Tensorflow)
自多头注意力机制简单代码实现