quantization · GitHub Topics

#大语言模型#Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

fine-tuning language-model llama 大语言模型 peft transformers rlhf qlora quantization chatglm qwen instruction-tuning mistral gpt lora large-language-models agent 人工智能 moe llama3

Python 43.9 k

2 小时前

ymcui / Chinese-LLaMA-Alpaca

#自然语言处理#中文LLaMA&Alpaca大语言模型+本地CPU/GPU训练部署 (Chinese LLaMA & Alpaca LLMs)

大语言模型 plm pre-trained-language-models alpaca llama 自然语言处理 quantization large-language-models lora alpaca-2 llama-2

Python 18.74 k

10 个月前

SYSTRAN / faster-whisper

#计算机科学#Faster Whisper transcription with CTranslate2

深度学习 inference quantization speech-recognition speech-to-text transformer Whisper openai

Python 14.71 k

2 个月前

UFund-Me / Qbot

#区块链#[🔥updating ...] AI 自动量化交易机器人(完全本地部署) AI-powered Quantitative Investment Research Platform. 📃 online docs: https://ufund-me.github.io/Qbot ✨ :news: qbot-mini: https://github.com/Charmve/iQuant

funds 机器学习 pytrade quantitative-finance quantitative-trading quantization strategies trademarks quant-trader 比特币区块链深度学习 fintech

Jupyter Notebook 10.41 k

4 个月前

bitsandbytes-foundation / bitsandbytes

#大语言模型#Accessible large language models via k-bit quantization for PyTorch.

大语言模型机器学习 PyTorch qlora quantization

Python 6.79 k

2 天前

kornelski / pngquant

Lossy PNG compressor — pngquant command based on libimagequant library

翻译 - 有损PNG压缩器—基于libimagequant库的pngquant命令

pngquant Code quality png png-compression quantization stdin palette conversion image-optimization C

C 5.33 k

2 个月前

AutoGPTQ / AutoGPTQ

#自然语言处理#An easy-to-use LLMs quantization package with user-friendly apis, based on GPTQ algorithm.

transformers 深度学习 inference large-language-models llms 自然语言处理 PyTorch quantization transformer

Python 4.75 k

2 个月前

IntelLabs / distiller

Neural Network Distiller by Intel AI Lab: a Python package for neural network compression research. https://intellabs.github.io/distiller

PyTorch pruning quantization Jupyter Notebook 深度神经网络 regularization distillation onnx

Jupyter Notebook 4.37 k

2 年前

OpenNMT / CTranslate2

#计算机科学#Fast inference engine for Transformer models

neural-machine-translation C++mkl quantization CUDA thrust opennmt 深度神经网络 openmp onednn intrinsics avx2 avx parallel-computing gemm neon transformer-models machine-translation 深度学习 inference

C++ 3.66 k

15 天前

neuralmagic / deepsparse

#自然语言处理#Sparsity-aware deep learning inference runtime for CPUs

机器学习 onnx inference 机器视觉 object-detection pruning quantization pretrained-models 自然语言处理 cpus sparsification llm-inference performance

Python 3.11 k

8 个月前

huawei-noah / Pretrained-Language-Model

Pretrained language model and its related optimization techniques developed by Huawei Noah's Ark Lab.

翻译 - 华为诺亚方舟实验室开发的预训练语言模型及其相关优化技术。

knowledge-distillation model-compression quantization pretrained-models

Python 3.07 k

1 年前

IntelLabs / nlp-architect

#自然语言处理#A model library for exploring state-of-the-art deep learning topologies and techniques for optimizing Natural Language Processing neural networks

翻译 - 一个模型库，用于探索最新的深度学习拓扑和优化自然语言处理神经网络的技术

深度学习自然语言处理 nlu Tensorflow dynet PyTorch bert transformers quantization

Python 2.94 k

2 年前

huggingface / optimum

🚀 Accelerate inference and training of 🤗 Transformers, Diffusers, TIMM and Sentence Transformers with easy to use hardware optimization tools

onnx PyTorch inference training intel graphcore onnxruntime transformers quantization habana optimization tflite

Python 2.81 k

5 天前

aaron-xichen / pytorch-playground

Base pretrained models and datasets in pytorch (MNIST, SVHN, CIFAR10, CIFAR100, STL10, AlexNet, VGG16, VGG19, ResNet, Inception, SqueezeNet)

pytorch-tutorial pytorch-tutorials PyTorch quantization

Python 2.66 k

2 年前

stochasticai / xTuring

#大语言模型#Build, customize and control you own LLMs. From data pre-processing to fine-tuning, xTuring provides an easy way to personalize open-source LLMs. Join our discord community: https://discord.gg/TgHXuSJ...

深度学习 fine-tuning gpt-2 gpt-j llama 大语言模型 lora language-model alpaca finetuning adapter gen-ai generative-ai mistral peft quantization

Python 2.64 k

6 个月前

intel / neural-compressor

SOTA low-bit LLM quantization (INT8/FP8/INT4/FP4/NF4) & sparsity; leading model compression techniques on TensorFlow, PyTorch, and ONNX Runtime

low-precision pruning sparsity auto-tuning knowledge-distillation quantization quantization-aware-training post-training-quantization smoothquant large-language-models gptq int8

Python 2.35 k

1 天前

dvmazur / mixtral-offloading

#大语言模型#Run Mixtral-8x7B models in Colab or consumer desktops

colab-notebook 深度学习 google-colab language-model 大语言模型 mixture-of-experts offloading PyTorch quantization

Python 2.3 k

1 年前

quic / aimet

#计算机科学#AIMET is a library that provides advanced quantization and compression techniques for trained neural network models.

翻译 - AIMET是一个为经过训练的神经网络模型提供高级量化和压缩技术的库。

quantization 深度学习 compression Open Source 机器学习 pruning auto-ml 深度神经网络

Python 2.24 k

20 小时前

666DZY666 / micronet

micronet, a model compression and deploy lib. compression: 1、quantization: quantization-aware-training(QAT), High-Bit(>2b)(DoReFa/Quantization and Training of Neural Networks for Efficient Integer-Ari...

翻译 - 基于pytorch的模型压缩（1，量化：8/4 / 2bits（dorefa），三进制/二进制值（twn / bnn / xnornet）； 2，修剪：常规，常规和组卷积通道修剪； 3，组卷积结构； 4，特征（A）的二进制值的分批归一化折叠）

quantization pruning dorefa twn bnn xnor-net PyTorch model-compression group-convolution convolutional-networks quantization-aware-training post-training-quantization tensorrt onnx

Python 2.23 k

3 年前

Efficient-ML / Awesome-Model-Quantization

#计算机科学#A list of papers, docs, codes about model quantization. This repo is aimed to provide the info for model quantization research, we are continuously improving the project. Welcome to PR the works (pape...

深度学习 quantization Awesome Lists model-compression efficient-deep-learning model-quantization

2.02 k

9 天前