self-attention · GitHub Topics | GitHub 中文社区

leedl-tutorial

Datawhale@datawhalechina

#计算机科学# 《李宏毅深度学习教程》（李宏毅老师推荐👍，苹果书🍎），PDF下载地址：https://github.com/datawhalechina/leedl-tutorial/releases

machine-learning deep-learning leedl-tutorial cnn reinforcement-learning transformer rnn gan pruning self-attention

Jupyter Notebook13.86 k

11 天前

Informer2020

@zhouhaoyi

#计算机科学# The GitHub repository for the paper "Informer" accepted by AAAI 2021.

翻译 - AAAI 2021（最佳论文奖）接受了论文“ Informer”的GitHub存储库。

deep-learning self-attention time-series pytorch forecasting transformer

Python5.45 k

6 个月前

pytorch-GAT

@gordicaleksa

#计算机科学# My implementation of the original GAT paper (Veličković et al.). I've additionally included the playground.py file for visualizing the Cora dataset, GAT embeddings, an attention mechanism, and entropy...

翻译 - 我对原始GAT论文的执行（Veličković等）。Jupyter Notebook即将面世，也是一个归纳示例。另外，我还包括了用来查看Cora数据集，GAT嵌入和注意力机制的Playground.py文件。

gat graph-attention-networks attention-mechanism self-attention pytorch python attention pytorch-gat gat-tutorial deep-learning

Jupyter Notebook2.45 k

2 年前

DeBERTa

Microsoft@microsoft

The implementation of DeBERTa

翻译 - DeBERTa的实施

bert deeplearning representation-learning roberta language-model natural-language-understanding self-attention transformer-encoder

Python1.98 k

1 年前

CCNet

Zilong Huang@speedinghzl

CCNet: Criss-Cross Attention for Semantic Segmentation (TPAMI 2020 & ICCV 2019).

翻译 - CCNet：语义分割的跨界关注（ICCV 2019）。

cityscape self-attention

Python1.43 k

4 年前🇨🇳

awesome-fast-attention

@Separius

list of efficient attention modules

翻译 - 有效关注模块列表

transformer attention awesome reformer longformer linformer multihead-attention self-attention attention-is-all-you-need transformer-network

Python989

3 年前

GCVit

NVIDIA Research Projects@NVlabs

#计算机科学# [ICML 2023] Official PyTorch implementation of Global Context Vision Transformers

vision-transformer ade20k coco deep-learning imagenet imagenet-classification object-detection pre-train pre-trained-model self-attention

Python382

1 年前