pruning · GitHub Topics

#大语言模型#《李宏毅深度学习教程》（李宏毅老师推荐👍，苹果书🍎），PDF下载地址：https://github.com/datawhalechina/leedl-tutorial/releases

机器学习深度学习 leedl-tutorial cnn reinforcement-learning transformer rnn Generative Adversarial Network pruning self-attention ChatGPT 教程 diffusion transfer-learning bert

Jupyter Notebook 14.7 k

1 个月前

IntelLabs / distiller

Neural Network Distiller by Intel AI Lab: a Python package for neural network compression research. https://intellabs.github.io/distiller

PyTorch pruning quantization Jupyter Notebook 深度神经网络 regularization distillation onnx

Jupyter Notebook 4.37 k

2 年前

neuralmagic / deepsparse

#自然语言处理#Sparsity-aware deep learning inference runtime for CPUs

机器学习 onnx inference 机器视觉 object-detection pruning quantization pretrained-models 自然语言处理 cpus sparsification llm-inference performance

Python 3.11 k

8 个月前

VainF / Torch-Pruning

[CVPR 2023] DepGraph: Towards Any Structural Pruning

pruning model-compression network-pruning channel-pruning efficient-deep-learning cvpr2023

Python 2.9 k

8 天前

he-y / Awesome-Pruning

#Awesome#A curated list of neural network pruning resources.

pruning model-compression Awesome Lists

2.42 k

1 年前

intel / neural-compressor

SOTA low-bit LLM quantization (INT8/FP8/INT4/FP4/NF4) & sparsity; leading model compression techniques on TensorFlow, PyTorch, and ONNX Runtime

low-precision pruning sparsity auto-tuning knowledge-distillation quantization quantization-aware-training post-training-quantization smoothquant large-language-models gptq int8

Python 2.35 k

1 天前

quic / aimet

#计算机科学#AIMET is a library that provides advanced quantization and compression techniques for trained neural network models.

翻译 - AIMET是一个为经过训练的神经网络模型提供高级量化和压缩技术的库。

quantization 深度学习 compression Open Source 机器学习 pruning auto-ml 深度神经网络

Python 2.24 k

20 小时前

666DZY666 / micronet

micronet, a model compression and deploy lib. compression: 1、quantization: quantization-aware-training(QAT), High-Bit(>2b)(DoReFa/Quantization and Training of Neural Networks for Efficient Integer-Ari...

翻译 - 基于pytorch的模型压缩（1，量化：8/4 / 2bits（dorefa），三进制/二进制值（twn / bnn / xnornet）； 2，修剪：常规，常规和组卷积通道修剪； 3，组卷积结构； 4，特征（A）的二进制值的分批归一化折叠）

quantization pruning dorefa twn bnn xnor-net PyTorch model-compression group-convolution convolutional-networks quantization-aware-training post-training-quantization tensorrt onnx

Python 2.23 k

3 年前

neuralmagic / sparseml

#自然语言处理#Libraries for applying sparsification recipes to neural networks with a few lines of code, enabling faster and smaller models

翻译 - 使用几行代码将稀疏化配方应用于神经网络的库，实现更快和更小的模型

PyTorch Keras sparsification-recipes Tensorflow smaller-models deep-learning-library 深度学习 deep-learning-models automl sparsity sparsification pruning computer-vision-algorithms object-detection image-classification 自然语言处理 onnx transfer-learning

Python 2.12 k

7 个月前

PaddlePaddle / PaddleSlim

PaddleSlim is an open-source library for deep model compression and architecture search.

翻译 - PaddleSlim是一个用于深度模型压缩和体系结构搜索的开源库。

pruning quantization nas bert compression detection distillation ernie segmentation sparsity tensorrt transformer yolov6 yolov5 yolov7

Python 1.58 k

3 个月前

open-mmlab / mmrazor

OpenMMLab Model Compression Toolbox and Benchmark.

翻译 - OpenMMLab 模型压缩工具箱和基准。

nas pruning knowledge-distillation spos darts autoslim detection segmentation classification PyTorch quantization

Python 1.55 k

9 个月前

tensorflow / model-optimization

#计算机科学#A toolkit to optimize ML models for deployment for Keras and TensorFlow, including quantization and pruning.

翻译 - 新手和高级用户都可以使用一套工具来优化机器学习模型以进行部署和执行。

Tensorflow 机器学习深度学习 optimization Keras model-compression compression pruning sparsity quantization

Python 1.52 k

1 个月前

cupcakearmy / autorestic

Config driven, easy backup cli for restic.

restic backup 命令行界面 configuration pruning incremental Entity resolution

Go 1.47 k

15 天前

huawei-noah / Efficient-Computing

Efficient computing methods developed by Huawei Noah's Ark Lab

knowledge-distillation model-compression binary-neural-networks pruning quantization self-supervised

Jupyter Notebook 1.25 k

4 个月前

openvinotoolkit / nncf

#自然语言处理#Neural Network Compression Framework for enhanced OpenVINO™ inference

quantization pruning sparsity quantization-aware-training compression semantic-segmentation object-detection classification 自然语言处理 bert transformers PyTorch Tensorflow onnx openvino 深度学习 genai 大语言模型

Python 982

2 天前

horseee / LLM-Pruner

#大语言模型#[NeurIPS 2023] LLM-Pruner: On the Structural Pruning of Large Language Models. Support Llama-3/3.1, Llama-2, LLaMA, BLOOM, Vicuna, Baichuan, TinyLlama, etc.

compression language-model 大语言模型 pruning baichuan chatglm llama vicuna llama-2 bloom llama3

Python 962

5 个月前