normalization-free-training

The largest collection of PyTorch image encoders / backbones. Including train, eval, inference, export scripts, and pretrained weights -- ResNet, ResNeXT, EfficientNet, NFNet, Vision Transformer (ViT)...

翻译 - PyTorch图像模型，脚本，预训练权重-（SE）ResNet / ResNeXT，DPN，EfficientNet，MixNet，MobileNet-V3 / V2，MNASNet，单路径NAS，FBNet等

Python 33.47 k

18 天前

sayakpaul / Adaptive-Gradient-Clipping

Minimal implementation of adaptive gradient clipping (https://arxiv.org/abs/2102.06171) in TensorFlow 2.

tensorflow2 机器视觉深度神经网络 normalization-free-training colab-notebook

Jupyter Notebook 83

4 年前

VITA-Group / BNN_NoBN

[CVPRW 21] "BNN - BN = ? Training Binary Neural Networks without Batch Normalization", Tianlong Chen, Zhenyu Zhang, Xu Ouyang, Zechun Liu, Zhiqiang Shen, Zhangyang Wang

binary-neural-networks normalization-free-training

Python 57

3 年前

Nandan91 / relu-revival-normfree

PyTorch implementation of normalization-free LLMs investigating entropic behavior to find desirable activation functions

gpt-2 llm-evaluation llm-inference normalization-free-training privacy-preserving-machine-learning pythia pytorch-implementation relu

Python 0

4 个月前