transformers · GitHub Topics | GitHub 中文社区

annotated_deep_learning_paper_implementations

#计算机科学# 59 篇深度学习论文的实现，并带有详细注释。包括 transformers (original, xl, switch, feedback, vit, ...), optimizers (adam, adabelief, ...), gans(cyclegan, stylegan2, ...), 🎮 强化学习 (ppo, dqn), capsnet, distillation, ... 🧠

deep-learning deep-learning-tutorial pytorch gan transformers reinforcement-learning optimizers neural-networks transformer machine-learning

Python56.45 k

3 个月前

LLaMA-Factory

@hiyouga

#大语言模型# Unified Efficient Fine-Tuning of 100+ LLMs (ACL 2024)

fine-tuning language-model llama llm peft transformers rlhf qlora quantization chatglm

Python34.73 k

1 天前

vit-pytorch

Phil Wang@lucidrains

Implementation of Vision Transformer, a simple way to achieve SOTA in vision classification with only a single transformer encoder, in Pytorch

翻译 - 在Pytorch中实现视觉变压器，这是仅使用一个变压器编码器即可在视觉分类中实现SOTA的简单方法

artificial-intelligence attention-mechanism transformers computer-vision image-classification

Python20.72 k

2 天前

haystack

@deepset-ai

#自然语言处理# Haystack 是一个开源 NLP 框架，利用预训练的 Transformer 模型。帮组开发者能快速实现一个生产级的语义搜索、问答、摘要和文档排名的NLP应用

nlp question-answering bert language-model pytorch semantic-search squad information-retrieval summarization transformers

Python17.81 k

19 小时前

peft

Hugging Face@huggingface

#大语言模型# 🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.

adapter diffusion llm parameter-efficient-learning python pytorch transformers lora

Python16.51 k

9 小时前

PaddleNLP

@PaddlePaddle • 百度

#搜索# PaddleNLP 2.0是飞桨生态的文本领域核心库，具备易用的文本领域API，多场景的应用示例、和高性能分布式训练三大特点，旨在提升开发者文本领域的开发效率，并提供基于飞桨2.0核心框架的NLP任务最佳实践。

nlp embedding bert ernie paddlenlp pretrained-models transformers information-extraction question-answering search-engine

Python12.16 k

6 小时前🇨🇳

transformers.js

Hugging Face@huggingface

State-of-the-art Machine Learning for the web. Run 🤗 Transformers directly in your browser, with no need for a server!

browser javascript transformers webml

JavaScript12.14 k

9 小时前

ml-engineering

@stas00

#大语言模型# Machine Learning Engineering Open Book

pytorch slurm large-language-models llm machine-learning scalability transformers machine-learning-engineering mlops ai

Python11.66 k

11 天前

Megatron-LM

NVIDIA Corporation@NVIDIA

Ongoing research training transformer models at scale

翻译 - 正在进行的大规模研究转换语言模型的研究，包括：BERT＆GPT-2

large-language-models model-para transformers

Python10.62 k

21 小时前

Transformers-Tutorials

@NielsRogge

This repository contains demos I made with the Transformers library by HuggingFace.

翻译 - 这个存储库包含我用 HuggingFace 的 Transformers 库制作的演示。

transformers pytorch bert vision-transformer layoutlm gpt-2

Jupyter Notebook9.52 k

1 个月前

tokenizers

Hugging Face@huggingface

#自然语言处理# 💥 Fast State-of-the-Art Tokenizers optimized for Research and Production

翻译 - optimized针对研究和生产进行了优化的快速最先进的分词器

nlp natural-language-processing natural-language-understanding language-model transformers bert gpt

Rust9.06 k

1 天前

gpt-neo

@EleutherAI

An implementation of model parallel GPT-2 and GPT-3-style models using the mesh-tensorflow library.

翻译 - 使用Mesh-tensorflow库，可并行执行模型GPT2和类似GPT3的模型，并能够扩展到完整的GPT3尺寸（甚至可能更多！）。

language-model transformers gpt gpt-2 gpt-3

Python8.23 k

3 年前

PaLM-rlhf-pytorch

Phil Wang@lucidrains

#计算机科学# Implementation of RLHF (Reinforcement Learning with Human Feedback) on top of the PaLM architecture. Basically ChatGPT but with PaLM

artificial-intelligence attention-mechanisms deep-learning reinforcement-learning transformers human-feedback

Python7.71 k

10 个月前

gpt-neox

@EleutherAI

An implementation of model parallel autoregressive transformers on GPUs, based on the Megatron and DeepSpeed libraries

翻译 - 基于DeepSpeed库的GPU上类似于GPT-3的模型并行模型的实现。设计为能够训练成千上亿个参数或更大参数的模型。

deepspeed-library gpt-3 transformers language-model

Python6.95 k

4 天前

ipex-llm

intel-analytics@intel-analytics

#大语言模型# Accelerate local LLM inference and finetuning (LLaMA, Mistral, ChatGLM, Qwen, Mixtral, Gemma, Phi, MiniCPM, Qwen-VL, MiniCPM-V, etc.) on Intel XPU (e.g., local PC with iGPU and NPU, discrete GPU such ...

pytorch llm transformers gpu

Python6.72 k

4 天前