attention-mechanisms

#计算机科学#Implementation of RLHF (Reinforcement Learning with Human Feedback) on top of the PaLM architecture. Basically ChatGPT but with PaLM

#Awesome#An ultimately comprehensive paper list of Vision Transformer/Attention, including papers, codes, and related websites

#计算机科学#Implementation of MusicLM, Google's new SOTA model for music generation using attention networks, in Pytorch

#计算机科学#Implementation of AudioLM, a SOTA Language Modeling Approach to Audio Generation out of Google Research, in Pytorch

#计算机科学#Implementation of Toolformer, Language Models That Can Use Tools, by MetaAI

#计算机科学#Implementation of Make-A-Video, new SOTA text to video generator from Meta AI, in Pytorch

#计算机科学#Implementation of Alphafold 3 from Google Deepmind in Pytorch

Awesome List of Attention Modules and Plug&Play Modules in Computer Vision

#计算机科学#Implementation of Muse: Text-to-Image Generation via Masked Generative Transformers, in Pytorch

#计算机科学#Implementation of MeshGPT, SOTA Mesh generation using Attention, in Pytorch

#计算机科学#Implementation of Phenaki Video, which uses Mask GIT to produce text guided videos of up to 2 minutes in length, in Pytorch

#大语言模型#Implementation of plug in and play Attention from "LongNet: Scaling Transformers to 1,000,000,000 Tokens"

#时序数据库#PyTorch Dual-Attention LSTM-Autoencoder For Multivariate Time Series

#计算机科学#Implementation of MEGABYTE, Predicting Million-byte Sequences with Multiscale Transformers, in Pytorch

#计算机科学#Implementation of MagViT2 Tokenizer in Pytorch

#计算机科学#Implementation of Band Split Roformer, SOTA Attention network for music source separation out of ByteDance AI Labs

#计算机科学#Unofficial implementation of iTransformer - SOTA Time Series Forecasting using Attention networks, out of Tsinghua / Ant group

🦖Pytorch implementation of popular Attention Mechanisms, Vision Transformers, MLP-Like models and CNNs.🔥🔥🔥

#计算机科学#An implementation of local windowed attention for language modeling

#计算机科学#Official PyTorch Implementation for "Rotate to Attend: Convolutional Triplet Attention Module." [WACV 2021]