inference-engine · GitHub Topics

#区块链#FEDML - The unified and scalable ML library for large-scale distributed training, model serving, and federated learning. FEDML Launch, a cross-cloud scheduler, further enables running any AI jobs on a...

federated-learning 深度学习 distributed-training 区块链 edge-ai 机器学习 on-device-training inference-engine marketplace mlops

Python4.21 k

3 天前

KuiperInfer

@zjhellofss

#计算机科学#校招、秋招、春招、实习好项目！带你从零实现一个高性能的深度学习推理库，支持大模型 llama2 、Unet、Yolov5、Resnet等模型的推理。Implement a high-performance deep learning inference library step by step

inference inference-engine 深度学习深度神经网络 convolution relu sigmoid graph-algorithms maxpooling caffe pnnx PyTorch ncnn diy resnet yolo yolov5

C++2.61 k

2 个月前🇨🇳

grule-rule-engine

@hyperjumptech

Rule engine implementation in Golang

翻译 - Golang中的规则引擎实现

Go rule-engine rule inference-engine rule-based rule-based-engine

Go2.24 k

5 个月前

cortex.cpp

@janhq

Local AI API Platform

gguf llama2 llamacpp tensorrt-llm accelerated 人工智能 inference-engine openai-api stable-diffusion CUDA

C++2.21 k

11 小时前

OpenMLDB

@4paradigm

#计算机科学#OpenMLDB is an open-source machine learning database that provides a feature platform computing consistent features for training and inference.

翻译 - OpenMLDB 是一个开源数据库，其设计和优化旨在为机器学习驱动的应用程序提供数据完整性和效率。除了 10 倍的 ML 应用落地体验，OpenMLDB 还提供了统一的计算和存储引擎，以降低开发和运维的复杂度和成本。

feature-engineering inference-engine newsql 机器学习 featurestore in-memory-database distributed-sql-database arm pmem Open Source

C++1.55 k

8 个月前