Kubernetes-based, scale-to-zero, request-driven compute
翻译 - 基于Kubernetes,从零扩展到请求驱动的计算
Yahoo! Cloud Serving Benchmark
翻译 - 雅虎!云服务基准
A flexible, high-performance carrier for machine learning models(『飞桨』服务化部署框架)
Serving Web Content with Spring MVC :: Learn how to create a web page with Spring MVC and Thymeleaf.
부스트캠프 AI Tech - Product Serving 자료
Generic and easy-to-use serving service for machine learning models
Controller for ModelMesh
favicon serving middleware
Serving TensorFlow models with TensorFlow Serving 📙
faiss serving :)
A framework for serving GraphQL from Laravel
翻译 - Laravel提供的GraphQL服务框架
A low-latency prediction-serving system
翻译 - 低延迟预测服务系统
A Docker image for serving fast.ai models, mimicking the API of Tensorflow Serving
A prebuilt tensorflow serving client from the tensorflow serving proto files
TensorFlow Serving benchmark
basic web site serving framework
TensorFlow Serving ARM - A project for cross-compiling TensorFlow Serving targeting popular ARM cores
FlashInfer: Kernel Library for LLM Serving