self-attention · GitHub Topics | GitHub 中文社区

#计算机科学#《李宏毅深度学习教程》（李宏毅老师推荐👍，苹果书🍎），PDF下载地址：https://github.com/datawhalechina/leedl-tutorial/releases

机器学习深度学习 leedl-tutorial cnn reinforcement-learning transformer rnn Generative Adversarial Network pruning self-attention

Jupyter Notebook14.08 k

4 天前

Informer2020

@zhouhaoyi

#计算机科学#The GitHub repository for the paper "Informer" accepted by AAAI 2021.

翻译 - AAAI 2021（最佳论文奖）接受了论文“ Informer”的GitHub存储库。

深度学习 self-attention time-series PyTorch forecasting transformer

Python5.56 k

7 个月前

pytorch-GAT

@gordicaleksa

#计算机科学#My implementation of the original GAT paper (Veličković et al.). I've additionally included the playground.py file for visualizing the Cora dataset, GAT embeddings, an attention mechanism, and entropy...

翻译 - 我对原始GAT论文的执行（Veličković等）。Jupyter Notebook即将面世，也是一个归纳示例。另外，我还包括了用来查看Cora数据集，GAT嵌入和注意力机制的Playground.py文件。

gat graph-attention-networks attention-mechanism self-attention PyTorch Python attention pytorch-gat gat-tutorial 深度学习

Jupyter Notebook2.46 k

2 年前

DeBERTa

Microsoft@microsoft

The implementation of DeBERTa

翻译 - DeBERTa的实施

bert 深度学习 representation-learning roberta language-model natural-language-understanding self-attention transformer-encoder

Python1.98 k

1 年前

CCNet

Zilong Huang@speedinghzl

CCNet: Criss-Cross Attention for Semantic Segmentation (TPAMI 2020 & ICCV 2019).

翻译 - CCNet：语义分割的跨界关注（ICCV 2019）。

cityscape self-attention

Python1.43 k

4 年前🇨🇳

awesome-fast-attention存档

@Separius

list of efficient attention modules

翻译 - 有效关注模块列表

transformer attention Awesome Lists reformer longformer linformer multihead-attention self-attention attention-is-all-you-need transformer-network

Python990

3 年前

GCVit

NVIDIA Research Projects@NVlabs

#计算机科学#[ICML 2023] Official PyTorch implementation of Global Context Vision Transformers

vision-transformer ade20k coco 深度学习 imagenet imagenet-classification object-detection pre-train pre-trained-model self-attention

Python426

1 年前