attention-mechanism · GitHub Topics

Implementation of Vision Transformer, a simple way to achieve SOTA in vision classification with only a single transformer encoder, in Pytorch

翻译 - 在Pytorch中实现视觉变压器，这是仅使用一个变压器编码器即可在视觉分类中实现SOTA的简单方法

artificial-intelligence attention-mechanism transformers computer-vision image-classification

Python20.72 k

2 天前

RWKV-LM

@BlinkDL

#计算机科学# RWKV is an RNN with transformer-level LLM performance. It can be directly trained like a GPT (parallelizable). So it's combining the best of RNN and transformer - great performance, fast inference, sa...

attention-mechanism deep-learning gpt gpt-2 gpt-3 language-model linear-attention lstm pytorch rnn

Python12.68 k

2 天前

text_classification

brightmart@brightmart

#自然语言处理# all kinds of text classification models and more with deep learning

翻译 - 各种文本分类模型以及更多深度学习

classification nlp fasttext textcnn textrnn tensorflow multi-label multi-class attention-mechanism text-classification

Python7.86 k

1 年前🇨🇳

DALLE-pytorch

Phil Wang@lucidrains

#计算机科学# Implementation / replication of DALL-E, OpenAI's Text to Image Transformer, in Pytorch

翻译 - 在Pytorch中实现/复制OpenAI，OpenAI的文本到图像转换器

artificial-intelligence deep-learning attention-mechanism text-to-image transformers multi-modal

Python5.57 k

9 个月前

x-transformers

Phil Wang@lucidrains

#计算机科学# A concise but complete full-attention transformer with a set of promising experimental features from various papers

翻译 - 来自各种论文的简单但完整的全关注变压器，具有一系列令人鼓舞的实验功能

artificial-intelligence deep-learning attention-mechanism transformers

Python4.8 k

3 天前

Awesome-Transformer-Attention

@cmhungsteve

#Awesome# An ultimately comprehensive paper list of Vision Transformer/Attention, including papers, codes, and related websites

transformer attention-mechanism vision-transformer deep-learning awesome-list transformer-cv transformer-architecture transformer-awesome transformer-with-cv transformer-models

4.65 k

4 个月前

transformer

Kyubyong Park@Kyubyong

A TensorFlow Implementation of the Transformer: Attention Is All You Need

翻译 - 变压器的TensorFlow实现：注意就是您所需要的

attention-mechanism translation attention-is-all-you-need implementation transformer

Python4.29 k

2 年前

a-PyTorch-Tutorial-to-Image-Captioning

@sgrvinod

Show, Attend, and Tell | a PyTorch Tutorial to Image Captioning

翻译 - 显示，参加和讲述|PyTorch图像字幕教程

pytorch pytorch-tutorial show-attend-and-tell image-captioning encoder-decoder attention-mechanism computer-vision mscoco

Python2.77 k

2 年前

pytorch-GAT

@gordicaleksa

#计算机科学# My implementation of the original GAT paper (Veličković et al.). I've additionally included the playground.py file for visualizing the Cora dataset, GAT embeddings, an attention mechanism, and entropy...

翻译 - 我对原始GAT论文的执行（Veličković等）。Jupyter Notebook即将面世，也是一个归纳示例。另外，我还包括了用来查看Cora数据集，GAT嵌入和注意力机制的Playground.py文件。

gat graph-attention-networks attention-mechanism self-attention pytorch python attention pytorch-gat gat-tutorial deep-learning

Jupyter Notebook2.45 k

2 年前

reformer-pytorch

Phil Wang@lucidrains

#计算机科学# Reformer, the efficient Transformer, in Pytorch

翻译 - 重整器，高效的变压器，在火炬

artificial-intelligence transformers attention-mechanism machine-learning pytorch

Python2.12 k

1 年前

swarms

@kyegomez

#计算机科学# The Enterprise-Grade Production-Ready Multi-Agent Orchestration Framework Join our Community: https://discord.com/servers/agora-999382051935506503

artificial-intelligence attention-mechanism gpt4 langchain machine-learning multi-modal-imaging multi-modality multimodal swarms transformer-models

Python1.77 k

3 天前

alphafold2

Phil Wang@lucidrains

#计算机科学# To eventually become an unofficial Pytorch implementation / replication of Alphafold2, as details of the architecture get released

翻译 - To eventually become a Pytorch implementation of Alphafold2, as details of the architecture get released

artificial-intelligence deep-learning protein-folding attention-mechanism

Python1.58 k

2 年前

lambda-networks

Phil Wang@lucidrains

#计算机科学# Implementation of LambdaNetworks, a new approach to image recognition that reaches SOTA with less compute

翻译 - LambdaNetworks的实现，这是一种新的图像识别方法，可以用更少的计算量达到SOTA

artificial-intelligence deep-learning computer-vision attention-mechanism attention

Python1.53 k

4 年前

flamingo-pytorch

Phil Wang@lucidrains

#计算机科学# Implementation of 🦩 Flamingo, state-of-the-art few-shot visual question answering attention net out of Deepmind, in Pytorch

artificial-intelligence attention-mechanism deep-learning transformers visual-question-answering

Python1.22 k

2 年前

performer-pytorch

Phil Wang@lucidrains

#计算机科学# An implementation of Performer, a linear attention-based transformer, in Pytorch

翻译 - Pytorch中Performer（基于线性注意的转换器）的实现

artificial-intelligence deep-learning attention-mechanism attention transformers

Python1.1 k

3 年前

pytorch-original-transformer

@gordicaleksa

My implementation of the original transformer model (Vaswani et al.). I've additionally included the playground.py file for visualizing otherwise seemingly hard concepts. Currently included IWSLT pret...

翻译 - 我对原始变压器模型的实现（Vaswani等）。另外，我还包括了parker.py文件，用于可视化本来似乎很难的概念。当前包括IWSLT预训练模型。

transformer transformers pytorch-transformer pytorch-transformers attention attention-mechanism attention-is-all-you-need pytorch python jupyter

Jupyter Notebook990

4 年前

PaLM-pytorch

Phil Wang@lucidrains

#计算机科学# Implementation of the specific Transformer architecture from PaLM - Scaling Language Modeling with Pathways

deep-learning transformers attention-mechanism artificial-general-intelligence

Python821

2 年前

soundstorm-pytorch

Phil Wang@lucidrains