quantization-aware-training

SOTA low-bit LLM quantization (INT8/FP8/INT4/FP4/NF4) & sparsity; leading model compression techniques on TensorFlow, PyTorch, and ONNX Runtime

micronet, a model compression and deploy lib. compression: 1、quantization: quantization-aware-training(QAT), High-Bit(>2b)(DoReFa/Quantization and Training of Neural Networks for Efficient Integer-Ari...

翻译 - 基于pytorch的模型压缩（1，量化：8/4 / 2bits（dorefa），三进制/二进制值（twn / bnn / xnornet）； 2，修剪：常规，常规和组卷积通道修剪； 3，组卷积结构； 4，特征（A）的二进制值的分批归一化折叠）

#自然语言处理#Neural Network Compression Framework for enhanced OpenVINO™ inference

#计算机科学#TinyNeuralNetwork is an efficient and easy-to-use deep learning model compression framework.

YOLO ModelCompression MultidatasetTraining

#计算机科学#A model compression and acceleration toolbox based on pytorch.

#计算机科学#Tutorial notebooks for hls4ml

#大语言模型#0️⃣1️⃣🤗 BitNet-Transformers: Huggingface Transformers Implementation of "BitNet: Scaling 1-bit Transformers for Large Language Models" in pytorch with Llama(2) Architecture

针对pytorch模型的自动化模型结构分析和修改工具集，包含自动分析模型结构的模型压缩算法库

This repository contains notebooks that show the usage of TensorFlow Lite for quantizing deep neural networks.

#计算机科学#FrostNet: Towards Quantization-Aware Network Architecture Search

#计算机科学#Notes on quantization in neural networks

Quantization Aware Training

Train neural networks with joint quantization and pruning on both weights and activations using any pytorch modules

#计算机科学#Quantization-aware training with spiking neural networks

3rd place solution for NeurIPS 2019 MicroNet challenge

FakeQuantize with Learned Step Size(LSQ+) as Observer in PyTorch

Code for paper 'Multi-Component Optimization and Efficient Deployment of Neural-Networks on Resource-Constrained IoT Hardware'

QT-DOG: QUANTIZATION-AWARE TRAINING FOR DOMAIN GENERALIZATION

#计算机科学#A tutorial of model quantization using TensorFlow