transformers · GitHub Topics | GitHub 中文社区

annotated_deep_learning_paper_implementations

#计算机科学#59 篇深度学习论文的实现，并带有详细注释。包括 transformers (original, xl, switch, feedback, vit, ...), optimizers (adam, adabelief, ...), gans(cyclegan, stylegan2, ...), 🎮 强化学习 (ppo, dqn), capsnet, distillation, ... 🧠

深度学习 PyTorch Generative Adversarial Network transformers reinforcement-learning optimizers neural-networks transformer 机器学习

Python57.33 k

4 个月前

LLaMA-Factory

@hiyouga

#大语言模型#Unified Efficient Fine-Tuning of 100+ LLMs (ACL 2024)

fine-tuning language-model llama llm peft transformers rlhf qlora quantization chatglm qwen instruction-tuning mistral gpt lora large-language-models agent 人工智能 moe llama3

Python36.6 k

4 小时前

vit-pytorch

Phil Wang@lucidrains

Implementation of Vision Transformer, a simple way to achieve SOTA in vision classification with only a single transformer encoder, in Pytorch

翻译 - 在Pytorch中实现视觉变压器，这是仅使用一个变压器编码器即可在视觉分类中实现SOTA的简单方法

人工智能 attention-mechanism transformers 机器视觉 image-classification

Python21.16 k

2 天前

haystack

@deepset-ai

#自然语言处理#Haystack 是一个开源 NLP 框架，利用预训练的 Transformer 模型。帮组开发者能快速实现一个生产级的语义搜索、问答、摘要和文档排名的NLP应用

自然语言处理 question-answering bert language-model PyTorch semantic-search squad information-retrieval summarization transformers

Python18.21 k

2 天前

peft

Hugging Face@huggingface

#大语言模型#🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.

adapter diffusion llm parameter-efficient-learning Python PyTorch transformers lora

Python16.76 k

4 天前

DocsGPT

@arc53

#自然语言处理#DocsGPT 是一个用于“文档”的基于GPT聊天助手，能快速检索项目文档，帮助开发人员轻松地提出与项目相关的问题，并获得准确的答案

人工智能 Python 自然语言处理 React Web app ChatGPT docsgpt information-retrieval language-model llm 机器学习 PyTorch rag semantic-search transformers Hacktoberfest

Python15.19 k

5 天前

transformers.js

Hugging Face@huggingface

State-of-the-art Machine Learning for the web. Run 🤗 Transformers directly in your browser, with no need for a server!

browser JavaScript transformers webml

JavaScript12.42 k

4 天前

PaddleNLP

@PaddlePaddle • 百度

#搜索#PaddleNLP 2.0是飞桨生态的文本领域核心库，具备易用的文本领域API，多场景的应用示例、和高性能分布式训练三大特点，旨在提升开发者文本领域的开发效率，并提供基于飞桨2.0核心框架的NLP任务最佳实践。

自然语言处理 embedding bert ernie paddlenlp pretrained-models transformers information-extraction question-answering search-engine

Python12.24 k

7 小时前🇨🇳

ml-engineering

@stas00

#大语言模型#Machine Learning Engineering Open Book

PyTorch slurm large-language-models llm 机器学习 scalability transformers machine-learning-engineering mlops 人工智能

Python12 k

20 天前

Megatron-LM

NVIDIA Corporation@NVIDIA

Ongoing research training transformer models at scale

翻译 - 正在进行的大规模研究转换语言模型的研究，包括：BERT＆GPT-2

large-language-models model-para transformers

Python10.87 k

3 天前

Transformers-Tutorials

@NielsRogge

This repository contains demos I made with the Transformers library by HuggingFace.

翻译 - 这个存储库包含我用 HuggingFace 的 Transformers 库制作的演示。

transformers PyTorch bert vision-transformer layoutlm gpt-2

Jupyter Notebook9.69 k

2 个月前

tokenizers

Hugging Face@huggingface

#自然语言处理#💥 Fast State-of-the-Art Tokenizers optimized for Research and Production

翻译 - optimized针对研究和生产进行了优化的快速最先进的分词器

自然语言处理 natural-language-understanding language-model transformers bert gpt

Rust9.17 k

1 个月前

gpt-neo存档

@EleutherAI

An implementation of model parallel GPT-2 and GPT-3-style models using the mesh-tensorflow library.

翻译 - 使用Mesh-tensorflow库，可并行执行模型GPT2和类似GPT3的模型，并能够扩展到完整的GPT3尺寸（甚至可能更多！）。

language-model transformers gpt gpt-2 gpt-3

Python8.25 k

3 年前

PaLM-rlhf-pytorch

Phil Wang@lucidrains

#计算机科学#Implementation of RLHF (Reinforcement Learning with Human Feedback) on top of the PaLM architecture. Basically ChatGPT but with PaLM

人工智能 attention-mechanisms 深度学习 reinforcement-learning transformers human-feedback

Python7.73 k

1 年前

openvino

OpenVINO Toolkit@openvinotoolkit

#自然语言处理#OpenVINO™ is an open-source toolkit for optimizing and deploying AI inference

翻译 - OpenVINO™工具包存储库

inference 深度学习 openvino 人工智能机器视觉 diffusion-models generative-ai llm-inference 自然语言处理 performance-boost speech-recognition stable-diffusion deploy-ai optimize-ai transformers yolo recommendation-system good-first-issue

C++7.49 k

2 天前

gpt-neox

@EleutherAI

An implementation of model parallel autoregressive transformers on GPUs, based on the Megatron and DeepSpeed libraries

翻译 - 基于DeepSpeed库的GPU上类似于GPT-3的模型并行模型的实现。设计为能够训练成千上亿个参数或更大参数的模型。

deepspeed-library gpt-3 transformers language-model

Python7 k

4 天前

RTranslator

@niedev

#安卓#Open source real-time translation app for Android that runs locally

translator bluetooth-le realtime-translator Android onnx onnxruntime sentencepiece transformers translation nllb Whisper mobile-app offline

C++6.96 k

1 个月前

ipex-llm

intel-analytics@intel-analytics

#大语言模型#Accelerate local LLM inference and finetuning (LLaMA, Mistral, ChatGLM, Qwen, Mixtral, Gemma, Phi, MiniCPM, Qwen-VL, MiniCPM-V, etc.) on Intel XPU (e.g., local PC with iGPU and NPU, discrete GPU such ...

PyTorch llm transformers gpu

Python6.83 k

3 天前

VAR

@FoundationVision

[NeurIPS 2024 Oral][GPT beats diffusion🔥] [scaling laws in visual generation📈] Official impl. of "Visual Autoregressive Modeling: Scalable Image Generation via Next-Scale Prediction". An *ultra-simp...

auto-regressive-model diffusion-models image-generation transformers autoregressive-models generative-ai generative-model gpt gpt-2 large-language-models vision-transformer neurips

Jupyter Notebook6.38 k

21 小时前