distillation · GitHub Topics

Neural Network Distiller by Intel AI Lab: a Python package for neural network compression research. https://intellabs.github.io/distiller

PyTorch pruning quantization Jupyter Notebook 深度神经网络 regularization distillation onnx

Jupyter Notebook 4.37 k

2 年前

dkozlov / awesome-knowledge-distillation

#计算机科学#Awesome Knowledge Distillation

knowledge-distillation teacher-student distillation model-compression 深度学习

3.61 k

1 天前

FLHonker / Awesome-Knowledge-Distillation

#计算机科学#Awesome Knowledge-Distillation. 分类整理的知识蒸馏paper(2014-2021)。

distillation 深度学习 transfer-learning model-compression

2.56 k

2 年前

AberHu / Knowledge-Distillation-Zoo

Pytorch implementation of various Knowledge Distillation (KD) methods.

knowledge-distillation teacher-student model-compression distillation

Python 1.67 k

3 年前

GMvandeVen / continual-learning

#计算机科学#PyTorch implementation of various methods for continual learning (XdG, EWC, SI, LwF, FROMP, DGR, BI-R, ER, A-GEM, iCaRL, Generative Classifier) in three different scenarios.

深度学习 artificial-neural-networks continual-learning incremental-learning replay distillation generative-models variational-autoencoder

Jupyter Notebook 1.67 k

2 天前

airaria / TextBrewer

#自然语言处理#A PyTorch-based knowledge distillation toolkit for natural language processing

bert PyTorch 自然语言处理 knowledge distillation

Python 1.64 k

2 年前

tangxyw / RecSysPapers

推荐/广告/搜索领域工业界经典以及最前沿论文集合。A collection of industry classics and cutting-edge papers in the field of recommendation/advertising/search.

calibration causal-inference cold-start contrastive-learning distillation fairness match papers recommendation-system reinforcement-learning multi-modal

Python 1.6 k

1 个月前

PaddlePaddle / PaddleSlim

PaddleSlim is an open-source library for deep model compression and architecture search.

翻译 - PaddleSlim是一个用于深度模型压缩和体系结构搜索的开源库。

pruning quantization nas bert compression detection distillation ernie segmentation sparsity tensorrt transformer yolov6 yolov5 yolov7

Python 1.58 k

3 个月前

ViTAE-Transformer / ViTPose

#计算机科学#The official repo for [NeurIPS'22] "ViTPose: Simple Vision Transformer Baselines for Human Pose Estimation" and [TPAMI'23] "ViTPose++: Vision Transformer for Generic Body Pose Estimation"

深度学习 distillation pose-estimation PyTorch self-supervised-learning vision-transformer

Python 1.53 k

8 个月前