Ongoing research training transformer models at scale
翻译 - 正在进行的大规模研究转换语言模型的研究，包括：BERT＆GPT-2
Train transformer language models with reinforcement learning.
Semantic segmentation models with 500+ pretrained convolutional and transformer-based backbones.
翻译 - 具有预训练骨干的细分模型。 PyTorch。
Fast inference engine for Transformer models
#大语言模型#Transformer Explained Visually: Learn How LLM Transformer Models Work with Interactive Visualization
Official PyTorch Implementation of "Scalable Diffusion Models with Transformers"
Model parallel transformers in JAX and Haiku
翻译 - 在 JAX 和 Haiku 中模拟并行转换器
Deep Learning Transformer models in MATLAB
Fast Diffusion Models with Transformers
#自然语言处理#A PyTorch implementation of the Transformer model in "Attention is All You Need".
翻译 - “注意就是您所需要的一切”中Transformer模型的PyTorch实现。
Efficient Inference of Transformer models
FastFormers - highly efficient transformer models for NLU
A curated list of awesome transformer models.
Repository of Transformer based PyTorch Time Series Models
The largest collection of PyTorch image encoders / backbones. Including train, eval, inference, export scripts, and pretrained weights -- ResNet, ResNeXT, EfficientNet, NFNet, Vision Transformer (ViT)...
翻译 - PyTorch图像模型，脚本，预训练权重-（SE）ResNet / ResNeXT，DPN，EfficientNet，MixNet，MobileNet-V3 / V2，MNASNet，单路径NAS，FBNet等
Ongoing research training transformer language models at scale, including: BERT & GPT-2
Code for the ALiBi method for transformer language models (ICLR 2022)
PyTorch implementation of Transformer model used in "Deep Transformer Models for Time Series Forecasting: The Influenza Prevalence Case"
#大语言模型#Python bindings for the Transformer models implemented in C/C++ using GGML library.
The implementation of "Learning Deep Transformer Models for Machine Translation"
Rust native ready-to-use NLP pipelines and transformer-based models (BERT, DistilBERT, GPT2,...)
An implementation of "Retentive Network: A Successor to Transformer for Large Language Models"
Punctuation Restoration using Transformer Models for High-and Low-Resource Languages
🧬 Nucleotide Transformer: Building and Evaluating Robust Foundation Models for Human Genomics
The repository collects many various multi-modal transformer architectures, including image transformer, video transformer, image-language transformer, video-language transformer and self-supervised l...