triton-inference-server

#大语言模型#Generative AI reference workflows optimized for accelerated infrastructure and microservice architecture.

Efficient, scalable and enterprise-grade CPU/GPU inference server for 🤗 Hugging Face transformer models 🚀

翻译 - 在 Nvidia Triton 服务器上部署优化的基于变压器的模型