serving · GitHub Topics

#计算机科学#Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.

翻译 - 一个快速简单的框架，用于构建和运行分布式应用程序。 Ray与RLlib（可扩展的强化学习库）和Tune（可扩展的超参数调整库）打包在一起。

Python 35.92 k

19 小时前

tensorflow / serving

#计算机科学#A flexible, high-performance serving system for machine learning models

翻译 - 用于机器学习模型的灵活，高性能的服务系统

机器学习深度学习深度神经网络 Python C++神经网络 serving Tensorflow

C++ 6.24 k

7 天前

vespa-engine / vespa

#搜索#AI + Data, online. https://vespa.ai

翻译 - Vespa是用于对大数据集进行低延迟计算的引擎。

vespa 搜索引擎 big-data 人工智能 serving serving-recommendation 机器学习 Server Tensorflow Java C++vector-search

Java 6.03 k

1 天前

SeldonIO / seldon-core

#计算机科学#An MLOps framework to package, deploy, monitor and manage thousands of production machine learning models

翻译 - 用于将生产机器学习部署，管理和扩展到数千个模型的框架

Kubernetes 机器学习部署 serving mlops aiops machine-learning-operations production-machine-learning

HTML 4.47 k

2 天前

ahkarami / Deep-Learning-in-Production

#计算机科学#In this repository, I will share some useful notes and references about deploying deep learning-based models in production.

深度学习深度神经网络 Python PyTorch tesnorflow Keras mxnet caffe2 production serving C++model-serving 教程 Flask REST API React Angular Tensorflow

4.32 k

4 个月前

pytorch / serve

#计算机科学#TorchServe是一个高性能、灵活且易于使用的工具，用于在生产级环境中提供PyTorch模型的服务。

PyTorch 机器学习 mlops serving Docker Kubernetes optimization cpu gpu 监控深度学习

Java 4.3 k

9 天前

PaddlePaddle / FastDeploy

#安卓#⚡️An Easy-to-use and Fast Deep Learning Model Deployment Toolkit for ☁️Cloud 📱Mobile and 📹Edge. Including Image, Video, Text and Audio 20+ main stream scenarios and 150+ SOTA models with end-to-end ...

Android jetson tensorrt onnxruntime object-detection yolov5 openvino picodet uie graphcore intel kunlun rockchip serving onnx stable-diffusion yolov8

C++ 3.12 k

17 天前

Lightning-AI / LitServe

#计算机科学#Lightning-fast serving engine for any AI model of any size. Flexible. Easy. Enterprise-scale.

人工智能 API serving 深度学习 developer-tools FastAPI REST API Web

Python 2.9 k

2 天前

georgia-tech-db / evadb

#大语言模型#Database system for AI-powered apps

eva video-analytics serving 数据库 labeling object-detection 数据分析人工智能 ChatGPT langchain auto-gpt gpt4all huggingface 大语言模型 gpt-4 agent Hacktoberfest

Python 2.66 k

10 个月前

tobegit3hub / tensorflow_template_application

#计算机科学#TensorFlow template application for deep learning

翻译 - TensorFlow模板应用程序用于深度学习

Tensorflow tfrecords libsvm CSV 深度学习机器学习 mlp cnn lstm inference tensorboard serving

Python 1.88 k

2 年前

ray-project / llm-applications

#计算机科学#A comprehensive guide to building RAG-based LLM applications for production.

llms 机器学习 ray anyscale fine-tuning llama2 openai serving

Jupyter Notebook 1.78 k

7 个月前

Delta-ML / delta

#前端开发#DELTA is a deep learning based natural language and speech processing platform. LF AI & DATA Projects: https://lfaidata.foundation/projects/delta/

翻译 - DELTA是基于深度学习的自然语言和语音处理平台。

自然语言处理深度学习 Tensorflow speech sequence-to-sequence seq2seq speech-recognition text-classification speaker-verification nlu text-generation emotion-recognition tensorflow-lite inference asr serving front-end ops

Python 1.59 k

16 天前

dingodb / dingo

A multi-modal vector database that supports upserts and vector queries using unified SQL (MySQL-Compatible) on structured and unstructured data, while meeting the requirements of high concurrency and ...

serving embedding-store vector-database mysql-compatibility embedding-search key-value-distributed-store vector-ocean unified-sql structured-data unstructured-data

Java 1.31 k

9 小时前

ray-project / ray-llm

#大语言模型#RayLLM - LLMs on Ray

distributed-systems large-language-models ray serving transformers 大语言模型 llm-inference llm-serving llmops

Python 1.26 k

9 个月前

PaddlePaddle / Serving

#计算机科学#A flexible, high-performance carrier for machine learning models（『飞桨』服务化部署框架）

rpc-service gpu Python Docker serving pipeline paddle 深度学习 prediction predictor dag micro-service

C++ 902