Efficient AI Backbones including GhostNet, TNT and MLP, developed by Huawei Noah's Ark Lab.
翻译 - [CVPR2020]超越MobileNetV3：“ GhostNet：廉价运营带来的更多功能”
Pretrained language model and its related optimization techniques developed by Huawei Noah's Ark Lab.
翻译 - 华为诺亚方舟实验室开发的预训练语言模型及其相关优化技术。
An Automatic Model Compression (AutoMC) framework for developing smaller and faster AI applications.
翻译 - 自动模型压缩（AutoMC）框架，用于开发更小，更快的AI应用程序。
micronet, a model compression and deploy lib. compression: 1、quantization: quantization-aware-training(QAT), High-Bit(>2b)(DoReFa/Quantization and Training of Neural Networks for Efficient Integer-Ari...
翻译 - 基于pytorch的模型压缩（1，量化：8/4 / 2bits（dorefa），三进制/二进制值（twn / bnn / xnornet）； 2，修剪：常规，常规和组卷积通道修剪； 3，组卷积结构； 4，特征（A）的二进制值的分批归一化折叠）
Efficient computing methods developed by Huawei Noah's Ark Lab
#自然语言处理#[ICML 2024] SqueezeLLM: Dense-and-Sparse Quantization
[CVPR2020] GhostNet: More Features from Cheap Operations
翻译 - [CVPR2020]超越MobileNetV3：“ GhostNet：廉价运营带来的更多功能”
#大语言模型#The Truth Is In There: Improving Reasoning in Language Models with Layer-Selective Rank Reduction