attention-mechanism · GitHub Topics

Implementation of Vision Transformer, a simple way to achieve SOTA in vision classification with only a single transformer encoder, in Pytorch

翻译 - 在Pytorch中实现视觉变压器，这是仅使用一个变压器编码器即可在视觉分类中实现SOTA的简单方法

人工智能 attention-mechanism transformers 机器视觉 image-classification

Python 22.02 k

7 天前

BlinkDL / RWKV-LM

#大语言模型#RWKV (pronounced RwaKuv) is an RNN with great LLM performance, which can also be directly trained like a GPT transformer (parallelizable). We are at RWKV-7 "Goose". So it's combining the best of RNN a...

attention-mechanism 深度学习 gpt gpt-2 gpt-3 language-model linear-attention lstm PyTorch rnn transformer transformers rwkv ChatGPT

Python 13.34 k

14 天前

brightmart / text_classification

#自然语言处理#all kinds of text classification models and more with deep learning

翻译 - 各种文本分类模型以及更多深度学习

classification 自然语言处理 fasttext textcnn textrnn Tensorflow multi-label multi-class attention-mechanism text-classification convolutional-neural-networks sentence-classification

Python 7.9 k

1 年前

lucidrains / DALLE-pytorch

#计算机科学#Implementation / replication of DALL-E, OpenAI's Text to Image Transformer, in Pytorch

翻译 - 在Pytorch中实现/复制OpenAI，OpenAI的文本到图像转换器

人工智能深度学习 attention-mechanism text-to-image transformers multi-modal

Python 5.61 k

1 年前

lucidrains / x-transformers

#计算机科学#A concise but complete full-attention transformer with a set of promising experimental features from various papers

翻译 - 来自各种论文的简单但完整的全关注变压器，具有一系列令人鼓舞的实验功能

人工智能深度学习 attention-mechanism transformers

Python 5.13 k

4 天前

cmhungsteve / Awesome-Transformer-Attention

#Awesome#An ultimately comprehensive paper list of Vision Transformer/Attention, including papers, codes, and related websites

transformer attention-mechanism vision-transformer 深度学习 Awesome Lists transformer-cv transformer-architecture transformer-awesome transformer-with-cv transformer-models visual-transformer 机器视觉 papers attention-mechanisms self-attention vit detr transformers

4.79 k

7 个月前

benedekrozemberczki / awesome-graph-classification

A collection of important graph embedding, classification and representation learning papers with implementations.

翻译 - 一系列重要的图形嵌入，分类和表示学习论文以及实现。

graph2vec classification-algorithm graph-kernels weisfeiler-lehman kernel-methods deep-graph-kernels netlsd graph-attention-model graph-attention-networks structural-attention attention-mechanism node2vec graph-embedding network-embedding node-embedding graph-representation-learning deepwalk graph-convolutional-networks

Python 4.78 k

2 年前

kyegomez / swarms

#大语言模型#The Enterprise-Grade Production-Ready Multi-Agent Orchestration Framework. Website: https://swarms.ai

人工智能 attention-mechanism gpt4 langchain 机器学习 multi-modal-imaging multi-modality multimodal swarms transformer-models agents prompt-engineering prompt-toolkit prompting tree-of-thoughts ChatGPT gpt4all huggingface langchain-python

Python 4.69 k

2 天前

Kyubyong / transformer

A TensorFlow Implementation of the Transformer: Attention Is All You Need

翻译 - 变压器的TensorFlow实现：注意就是您所需要的

attention-mechanism translation attention-is-all-you-need implementation transformer

Python 4.34 k

2 年前

PetarV- / GAT

Graph Attention Networks (https://arxiv.org/abs/1710.10903)

graph-attention-networks attention-mechanism self-attention Tensorflow neural-networks Python

Python 3.31 k

3 年前

zzw922cn / awesome-speech-recognition-speech-synthesis-papers

#新手入门#Automatic Speech Recognition (ASR), Speaker Verification, Speech Synthesis, Text-to-Speech (TTS), Language Modelling, Singing Voice Synthesis (SVS), Voice Conversion (VC)

automatic-speech-recognition papers 路线图 rnn cnn dnn attention-mechanism seq2seq timit-dataset tts language-model speaker-verification speech-recognition speech-synthesis 神经网络 diffusion-models singing-voice-synthesis voice-conversion

3.02 k

1 年前

Diego999 / pyGAT

Pytorch implementation of the Graph Attention Network model by Veličković et. al (2017, https://arxiv.org/abs/1710.10903)

graph-attention-networks attention-mechanism self-attention PyTorch neural-networks Python

Python 2.99 k

2 年前

sgrvinod / a-PyTorch-Tutorial-to-Image-Captioning

Show, Attend, and Tell | a PyTorch Tutorial to Image Captioning

翻译 - 显示，参加和讲述|PyTorch图像字幕教程

PyTorch pytorch-tutorial show-attend-and-tell image-captioning encoder-decoder attention-mechanism 机器视觉 mscoco

Python 2.82 k

3 年前

philipperemy / keras-attention

#计算机科学#Keras Attention Layer (Luong and Bahdanau scores).

Keras keras-neural-networks attention-mechanism attention-model 深度学习

Python 2.81 k

1 年前

gordicaleksa / pytorch-GAT

#计算机科学#My implementation of the original GAT paper (Veličković et al.). I've additionally included the playground.py file for visualizing the Cora dataset, GAT embeddings, an attention mechanism, and entropy...

翻译 - 我对原始GAT论文的执行（Veličković等）。Jupyter Notebook即将面世，也是一个归纳示例。另外，我还包括了用来查看Cora数据集，GAT嵌入和注意力机制的Playground.py文件。

gat graph-attention-networks attention-mechanism self-attention PyTorch Python attention pytorch-gat gat-tutorial 深度学习 pytorch-implementation Jupyter Notebook

Jupyter Notebook 2.51 k

2 年前