attention-mechanism · GitHub Topics

Implementation of Vision Transformer, a simple way to achieve SOTA in vision classification with only a single transformer encoder, in Pytorch

翻译 - 在Pytorch中实现视觉变压器，这是仅使用一个变压器编码器即可在视觉分类中实现SOTA的简单方法

人工智能 attention-mechanism transformers 机器视觉 image-classification

Python21.16 k

2 天前

RWKV-LM

@BlinkDL

#计算机科学#RWKV is an RNN with transformer-level LLM performance. It can be directly trained like a GPT (parallelizable). So it's combining the best of RNN and transformer - great performance, fast inference, sa...

attention-mechanism 深度学习 gpt gpt-2 gpt-3 language-model linear-attention lstm PyTorch rnn

Python12.79 k

6 天前

text_classification

brightmart@brightmart

#自然语言处理#all kinds of text classification models and more with deep learning

翻译 - 各种文本分类模型以及更多深度学习

classification 自然语言处理 fasttext textcnn textrnn Tensorflow multi-label multi-class attention-mechanism text-classification

Python7.88 k

1 年前🇨🇳

DALLE-pytorch

Phil Wang@lucidrains

#计算机科学#Implementation / replication of DALL-E, OpenAI's Text to Image Transformer, in Pytorch

翻译 - 在Pytorch中实现/复制OpenAI，OpenAI的文本到图像转换器

人工智能深度学习 attention-mechanism text-to-image transformers multi-modal

Python5.59 k

10 个月前

x-transformers

Phil Wang@lucidrains

#计算机科学#A concise but complete full-attention transformer with a set of promising experimental features from various papers

翻译 - 来自各种论文的简单但完整的全关注变压器，具有一系列令人鼓舞的实验功能

人工智能深度学习 attention-mechanism transformers

Python4.91 k

13 天前

Awesome-Transformer-Attention

@cmhungsteve

#Awesome#An ultimately comprehensive paper list of Vision Transformer/Attention, including papers, codes, and related websites

transformer attention-mechanism vision-transformer 深度学习 Awesome Lists transformer-cv transformer-architecture transformer-awesome transformer-with-cv transformer-models

4.68 k

5 个月前

transformer

Kyubyong Park@Kyubyong

A TensorFlow Implementation of the Transformer: Attention Is All You Need

翻译 - 变压器的TensorFlow实现：注意就是您所需要的

attention-mechanism translation attention-is-all-you-need implementation transformer

Python4.31 k

2 年前

a-PyTorch-Tutorial-to-Image-Captioning

@sgrvinod

Show, Attend, and Tell | a PyTorch Tutorial to Image Captioning

翻译 - 显示，参加和讲述|PyTorch图像字幕教程

PyTorch pytorch-tutorial show-attend-and-tell image-captioning encoder-decoder attention-mechanism 机器视觉 mscoco

Python2.8 k

2 年前

pytorch-GAT

@gordicaleksa

#计算机科学#My implementation of the original GAT paper (Veličković et al.). I've additionally included the playground.py file for visualizing the Cora dataset, GAT embeddings, an attention mechanism, and entropy...

翻译 - 我对原始GAT论文的执行（Veličković等）。Jupyter Notebook即将面世，也是一个归纳示例。另外，我还包括了用来查看Cora数据集，GAT嵌入和注意力机制的Playground.py文件。

gat graph-attention-networks attention-mechanism self-attention PyTorch Python attention pytorch-gat gat-tutorial 深度学习

Jupyter Notebook2.46 k

2 年前

reformer-pytorch

Phil Wang@lucidrains

#计算机科学#Reformer, the efficient Transformer, in Pytorch

翻译 - 重整器，高效的变压器，在火炬

人工智能 transformers attention-mechanism 机器学习 PyTorch

Python2.13 k

2 年前

swarms

@kyegomez

#大语言模型#The Enterprise-Grade Production-Ready Multi-Agent Orchestration Framework Join our Community: https://discord.com/servers/agora-999382051935506503

人工智能 attention-mechanism gpt4 langchain 机器学习 multi-modal-imaging multi-modality multimodal swarms transformer-models agents prompt-engineering prompt-toolkit prompting tree-of-thoughts ChatGPT gpt4all huggingface langchain-python

Python2.06 k

1 天前

alphafold2

Phil Wang@lucidrains

#计算机科学#To eventually become an unofficial Pytorch implementation / replication of Alphafold2, as details of the architecture get released

翻译 - To eventually become a Pytorch implementation of Alphafold2, as details of the architecture get released

人工智能深度学习 protein-folding attention-mechanism

Python1.58 k

2 年前

lambda-networks

Phil Wang@lucidrains

#计算机科学#Implementation of LambdaNetworks, a new approach to image recognition that reaches SOTA with less compute

翻译 - LambdaNetworks的实现，这是一种新的图像识别方法，可以用更少的计算量达到SOTA

人工智能深度学习机器视觉 attention-mechanism attention

Python1.53 k

4 年前

flamingo-pytorch

Phil Wang@lucidrains

#计算机科学#Implementation of 🦩 Flamingo, state-of-the-art few-shot visual question answering attention net out of Deepmind, in Pytorch

人工智能 attention-mechanism 深度学习 transformers visual-question-answering

Python1.22 k

2 年前

performer-pytorch

Phil Wang@lucidrains

#计算机科学#An implementation of Performer, a linear attention-based transformer, in Pytorch

翻译 - Pytorch中Performer（基于线性注意的转换器）的实现

人工智能深度学习 attention-mechanism attention transformers

Python1.1 k

3 年前

pytorch-original-transformer

@gordicaleksa

My implementation of the original transformer model (Vaswani et al.). I've additionally included the playground.py file for visualizing otherwise seemingly hard concepts. Currently included IWSLT pret...

翻译 - 我对原始变压器模型的实现（Vaswani等）。另外，我还包括了parker.py文件，用于可视化本来似乎很难的概念。当前包括IWSLT预训练模型。

transformer transformers pytorch-transformer pytorch-transformers attention attention-mechanism attention-is-all-you-need PyTorch Python Jupyter Notebook

Jupyter Notebook990

4 年前

PaLM-pytorch

Phil Wang@lucidrains

#计算机科学#Implementation of the specific Transformer architecture from PaLM - Scaling Language Modeling with Pathways

深度学习 transformers attention-mechanism artificial-general-intelligence

Python821

2 年前

soundstorm-pytorch

Phil Wang@lucidrains