Efficient AI Backbones including GhostNet, TNT and MLP, developed by Huawei Noah's Ark Lab.
翻译 - [CVPR2020]超越MobileNetV3:“ GhostNet:廉价运营带来的更多功能”
Pretrained language model and its related optimization techniques developed by Huawei Noah's Ark Lab.
翻译 - 华为诺亚方舟实验室开发的预训练语言模型及其相关优化技术。
An Automatic Model Compression (AutoMC) framework for developing smaller and faster AI applications.
翻译 - 自动模型压缩(AutoMC)框架,用于开发更小,更快的AI应用程序。
micronet, a model compression and deploy lib. compression: 1、quantization: quantization-aware-training(QAT), High-Bit(>2b)(DoReFa/Quantization and Training of Neural Networks for Efficient Integer-Ari...
翻译 - 基于pytorch的模型压缩(1,量化:8/4 / 2bits(dorefa),三进制/二进制值(twn / bnn / xnornet); 2,修剪:常规,常规和组卷积通道修剪; 3,组卷积结构; 4,特征(A)的二进制值的分批归一化折叠)
Efficient computing methods developed by Huawei Noah's Ark Lab
#自然语言处理# [ICML 2024] SqueezeLLM: Dense-and-Sparse Quantization
[CVPR2020] GhostNet: More Features from Cheap Operations
翻译 - [CVPR2020]超越MobileNetV3:“ GhostNet:廉价运营带来的更多功能”
#大语言模型# The Truth Is In There: Improving Reasoning in Language Models with Layer-Selective Rank Reduction