knowledge-distillation · GitHub Topics

PaddleClas 是一个为工业界和学术界所准备的图像识别任务工具集

image-classification knowledge-distillation autoaugment randaugment gridmask cutmix deit repvgg swin-transformer pretrained-models image-recognition

Python 5.59 k

7 天前

dkozlov / awesome-knowledge-distillation

#计算机科学#Awesome Knowledge Distillation

knowledge-distillation teacher-student distillation model-compression 深度学习

3.61 k

1 天前

huawei-noah / Pretrained-Language-Model

Pretrained language model and its related optimization techniques developed by Huawei Noah's Ark Lab.

翻译 - 华为诺亚方舟实验室开发的预训练语言模型及其相关优化技术。

knowledge-distillation model-compression quantization pretrained-models

Python 3.07 k

1 年前

jingyi0000 / VLM_survey

#计算机科学#Collection of AWESOME vision-language models for vision tasks

机器视觉深度学习 knowledge-distillation survey transfer-learning vision-language-model clip

2.56 k

3 个月前

IDEA-Research / DWPose

"Effective Whole-body Pose Estimation with Two-stages Distillation" (ICCV 2023, CV4Metaverse Workshop)

controlnet knowledge-distillation pose-estimation stable-diffusion-webui

Python 2.38 k

1 年前

intel / neural-compressor

SOTA low-bit LLM quantization (INT8/FP8/INT4/FP4/NF4) & sparsity; leading model compression techniques on TensorFlow, PyTorch, and ONNX Runtime

low-precision pruning sparsity auto-tuning knowledge-distillation quantization quantization-aware-training post-training-quantization smoothquant large-language-models gptq int8

Python 2.35 k

1 天前

alibaba / EasyNLP

#自然语言处理#EasyNLP: A Comprehensive and Easy-to-use NLP Toolkit

transformers bert 自然语言处理 pretrained-models 深度学习 PyTorch fewshot-learning knowledge-distillation knowledge-pretraining text-image-retrieval text-to-image-synthesis 机器学习 text-classification transfer-learning

Python 2.1 k

3 个月前

haitongli / knowledge-distillation-pytorch

A PyTorch implementation for exploring deep and shallow knowledge distillation (KD) experiments with flexibility

PyTorch knowledge-distillation 深度神经网络 cifar10 model-compression 机器视觉

Python 1.92 k

2 年前

microsoft / Cream

This is a collection of our NAS and Vision Transformer work.

翻译 - [NeurIPS'20]作物的精华：为一击式神经结构搜索提炼优先路径

nas automl vision-transformer rpe vit-compression efficiency knowledge-distillation

Python 1.73 k

8 个月前

AberHu / Knowledge-Distillation-Zoo

Pytorch implementation of various Knowledge Distillation (KD) methods.

knowledge-distillation teacher-student model-compression distillation

Python 1.67 k

3 年前

open-mmlab / mmrazor

OpenMMLab Model Compression Toolbox and Benchmark.

翻译 - OpenMMLab 模型压缩工具箱和基准。

nas pruning knowledge-distillation spos darts autoslim detection segmentation classification PyTorch quantization

Python 1.55 k

9 个月前

horseee / Awesome-Efficient-LLM

#大语言模型#A curated list for Efficient Large Language Models

compression knowledge-distillation language-model 大语言模型 model-quantization efficient-llm

Python 1.5 k

6 天前

yoshitomo-matsubara / torchdistill

#自然语言处理#A coding-free framework built on PyTorch for reproducible deep learning studies. PyTorch Ecosystem. 🏆25 knowledge distillation methods presented at CVPR, ICLR, ECCV, NeurIPS, ICCV, etc are implemente...

knowledge-distillation PyTorch image-classification imagenet object-detection coco semantic-segmentation cifar10 cifar100 colab-notebook google-colab pascal-voc 自然语言处理 transformer glue

Python 1.46 k

13 天前

microsoft / NeuronBlocks

#自然语言处理#NLP DNN Toolkit - Building Your NLP DNN Models Like Playing Lego

翻译 - NLP DNN工具包-像玩乐高游戏一样建立NLP DNN模型

question-answering 深度学习 PyTorch 自然语言处理 text-classification 人工智能 dnn qna text-matching knowledge-distillation model-compression sequence-labeling

Python 1.46 k

2 年前

szagoruyko / attention-transfer

#计算机科学#Improving Convolutional Networks via Attention Transfer (ICLR 2017)

PyTorch knowledge-distillation attention 深度学习

Jupyter Notebook 1.45 k

7 年前

lxztju / pytorch_classification

利用pytorch实现图像分类的一个完整的代码，训练，预测，TTA，模型融合，模型部署，cnn提取特征，svm或者随机森林等进行分类，模型蒸馏，一个完整的代码

PyTorch image-classification 部署 svm knn cnn densenet resnext resnet Flask random-forest knowledge-distillation

Jupyter Notebook 1.4 k

2 年前

huawei-noah / Efficient-Computing

Efficient computing methods developed by Huawei Noah's Ark Lab

knowledge-distillation model-compression binary-neural-networks pruning quantization self-supervised

Jupyter Notebook 1.25 k

4 个月前

MingSun-Tse / Efficient-Deep-Learning

#计算机科学#Collection of recent methods on (deep) neural network compression and acceleration.

model-compression network-pruning knowledge-distillation 深度学习深度神经网络 efficient-deep-learning

937

3 个月前

Tebmer / Awesome-Knowledge-Distillation-of-LLMs

#大语言模型#This repository collects papers for "A Survey on Knowledge Distillation of Large Language Models". We break down KD into Knowledge Elicitation and Distillation Algorithms, and explore the Skill & Vert...

data-augmentation instruction-following knowledge-distillation large-language-model 大语言模型 survey compression feedback multi-modal alignment

911

3 天前

alibaba / EasyTransfer

EasyTransfer is designed to make the development of transfer learning in NLP applications easier.

翻译 - EasyTransfer旨在简化NLP应用程序中的迁移学习的开发。

bert nlp-applications knowledge-distillation transfer-learning

Python 861

3 年前