#自然语言处理#LightLLM is a Python-based LLM (Large Language Model) inference and serving framework, notable for its lightweight design, easy scalability, and high-speed performance.
Python 3 k
3 天前
Best inference performance optimization framework for HuggingFace Diffusers on NVIDIA GPUs.
Python 1.23 k
3 个月前
#计算机科学#A subset of PyTorch's neural network modules, written in Python using OpenAI's Triton.
Python 515
21 天前
Training-free Post-training Efficient Sub-quadratic Complexity Attention. Implemented with OpenAI Triton.
Python 118
15 天前
Learn and experiment with new techniques and programming languages with a focus on ML
Jupyter Notebook 5
6 个月前