attention-is-all-you-need · GitHub Topics

jadore801120 / attention-is-all-you-need-pytorch

#自然语言处理#A PyTorch implementation of the Transformer model in "Attention is All You Need".

翻译 - “注意就是您所需要的一切”中Transformer模型的PyTorch实现。

attention 深度学习 attention-is-all-you-need PyTorch 自然语言处理

Python 9.07 k

1 年前

Kyubyong / transformer

A TensorFlow Implementation of the Transformer: Attention Is All You Need

翻译 - 变压器的TensorFlow实现：注意就是您所需要的

attention-mechanism translation attention-is-all-you-need implementation transformer

Python 4.34 k

2 年前

linto-ai / whisper-timestamped

#计算机科学#Multilingual Automatic Speech Recognition with word-level timestamps and confidence

深度学习 speech speech-recognition speech-to-text asr 机器学习 Python PyTorch attention-is-all-you-need attention-mechanism attention-model speaker-diarization speech-processing transformers Whisper

Python 2.28 k

1 个月前

awslabs / sockeye

#计算机科学#Sequence-to-sequence framework with a focus on Neural Machine Translation based on PyTorch

深度学习深度神经网络机器学习 machine-translation neural-machine-translation encoder-decoder attention-mechanism sequence-to-sequence attention-is-all-you-need attention-model seq2seq translation transformer-architecture transformer transformer-network PyTorch

Python 1.21 k

5 个月前

gordicaleksa / pytorch-original-transformer

#计算机科学#My implementation of the original transformer model (Vaswani et al.). I've additionally included the playground.py file for visualizing otherwise seemingly hard concepts. Currently included IWSLT pret...

翻译 - 我对原始变压器模型的实现（Vaswani等）。另外，我还包括了parker.py文件，用于可视化本来似乎很难的概念。当前包括IWSLT预训练模型。

transformer transformers pytorch-transformer pytorch-transformers attention attention-mechanism attention-is-all-you-need PyTorch Python Jupyter Notebook 深度学习

Jupyter Notebook 1.02 k

4 年前

Separius / awesome-fast-attention

list of efficient attention modules

翻译 - 有效关注模块列表

transformer attention Awesome Lists reformer longformer linformer multihead-attention self-attention attention-is-all-you-need transformer-network

Python 995

4 年前

brightmart / bert_language_understanding

#自然语言处理#Pre-training of Deep Bidirectional Transformers for Language Understanding: pre-train TextCNN

bert-model language-model attention-is-all-you-need transformer-encoder pre-training language-understanding text-classification document-classification self-attention transfer-learning 自然语言处理 question-answering textcnn fasttext

Python 962

6 年前

hkproj / pytorch-transformer

Attention is all you need implementation

attention-is-all-you-need paper-implementations PyTorch transformer

Jupyter Notebook 822

9 个月前

kaituoxu / Speech-Transformer

A PyTorch implementation of Speech Transformer, an End-to-End ASR with Transformer network on Mandarin Chinese.

asr transformer end-to-end attention self-attention attention-is-all-you-need PyTorch

Python 781

2 年前

lsdefine / attention-is-all-you-need-keras

#计算机科学#A Keras+TensorFlow Implementation of the Transformer: Attention Is All You Need

深度学习 attention-is-all-you-need keras-tensorflow Keras

Python 713

3 年前

kyegomez / LongNet

#大语言模型#Implementation of plug in and play Attention from "LongNet: Scaling Transformers to 1,000,000,000 Tokens"

人工智能 attention attention-is-all-you-need attention-mechanisms ChatGPT gpt3 gpt4 机器学习 transformer context-length

Python 700

1 年前

sooftware / kospeech

Open-Source Toolkit for End-to-End Korean Automatic Speech Recognition leveraging PyTorch and Hydra.

speech-recognition asr end-to-end PyTorch seq2seq transformer attention-is-all-you-need conformer

Python 614

2 年前

FreedomIntelligence / TextClassificationBenchmark

A Benchmark of Text Classification in PyTorch

text-classification benchmark lstm PyTorch cnn cnn-classification attention-is-all-you-need rcnn crnn Quantum Computing

Python 602

1 年前

jayparks / transformer

A Pytorch Implementation of "Attention is All You Need" and "Weighted Transformer Network for Machine Translation"

self-attention attention-mechanism attention-is-all-you-need machine-translation

Python 552

4 年前

lvapeab / nmt-keras

#计算机科学#Neural Machine Translation with Keras

neural-machine-translation Keras 深度学习 sequence-to-sequence theano 机器学习 nmt machine-translation gru Tensorflow attention-mechanism transformer attention-is-all-you-need attention-model

Python 532

4 年前

feifeibear / long-context-attention

USP: Unified (a.k.a. Hybrid, 2D) Sequence Parallel Attention for Long Context Transformers Model Training and Inference

attention-is-all-you-need llm-inference llm-training PyTorch

Python 445

22 天前

kyegomez / CM3Leon

An open source implementation of "Scaling Autoregressive Multi-Modal Models: Pretraining and Instruction Tuning", an all-new multi modal AI that uses just a decoder to generate both text and images

attention attention-is-all-you-need dalle multimodal multimodal-learning multimodality

Python 361

1 年前

kyegomez / ScreenAI

#计算机科学#Implementation of the ScreenAI model from the paper: "A Vision-Language Model for UI and Infographics Understanding"

人工智能 attention attention-is-all-you-need gpt-4 机器学习 PyTorch Tensorflow

Python 321

1 个月前