attention-is-all-you-need · GitHub Topics

attention-is-all-you-need-pytorch

@jadore801120

#自然语言处理#A PyTorch implementation of the Transformer model in "Attention is All You Need".

翻译 - “注意就是您所需要的一切”中Transformer模型的PyTorch实现。

attention 深度学习 attention-is-all-you-need PyTorch 自然语言处理

Python8.94 k

8 个月前

transformer

Kyubyong Park@Kyubyong

A TensorFlow Implementation of the Transformer: Attention Is All You Need

翻译 - 变压器的TensorFlow实现：注意就是您所需要的

attention-mechanism translation attention-is-all-you-need implementation transformer

Python4.31 k

2 年前

awesome-fast-attention存档

@Separius

list of efficient attention modules

翻译 - 有效关注模块列表

transformer attention Awesome Lists reformer longformer linformer multihead-attention self-attention attention-is-all-you-need transformer-network

Python990

3 年前

pytorch-original-transformer

@gordicaleksa

My implementation of the original transformer model (Vaswani et al.). I've additionally included the playground.py file for visualizing otherwise seemingly hard concepts. Currently included IWSLT pret...

翻译 - 我对原始变压器模型的实现（Vaswani等）。另外，我还包括了parker.py文件，用于可视化本来似乎很难的概念。当前包括IWSLT预训练模型。

transformer transformers pytorch-transformer pytorch-transformers attention attention-mechanism attention-is-all-you-need PyTorch Python Jupyter Notebook

Jupyter Notebook990

4 年前

LongNet

@kyegomez

#大语言模型#Implementation of plug in and play Attention from "LongNet: Scaling Transformers to 1,000,000,000 Tokens"

artificial-intelligence attention attention-is-all-you-need attention-mechanisms ChatGPT gpt3 gpt4 机器学习 transformer context-length

Python680

1 年前