model-inference · GitHub Topics

#大语言模型#Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.

大语言模型 llmops model-inference fine-tuning llm-serving llama vicuna bentoml llama2 llm-inference llm-ops mistral mlops llama3-1

Python 11.12 k

2 天前

wangxb96 / Awesome-EdgeAI

#Awesome#Resources of our survey paper "Optimizing Edge AI: A Comprehensive Survey on Data, Model, and System Strategies"

data-preprocessing edge-ai edge-computing 机器学习 model-compression model-inference Awesome Lists 深度学习 model-deployment

3 个月前

bentoml / CLIP-API-service

CLIP as a service - Embed image and sentences, object recognition, visual reasoning, image classification and reverse image search

ai-applications clip cloud-native mlops model-inference model-serving

Jupyter Notebook 60

1 年前

wangxb96 / Awesome-EdgeAI

#Awesome#Resources of our survey paper "Optimizing Edge AI: A Comprehensive Survey on Data, Model, and System Strategies"

data-preprocessing edge-ai edge-computing 机器学习 model-compression model-inference Awesome Lists 深度学习 model-deployment

3 个月前

array2d / deepx

Large-scale Auto-Distributed Training/Inference Unified Framework | Memory-Compute-Control Decoupled Architecture | Multi-language SDK & Heterogeneous Hardware Support

distributed-training high-performance-computing model-inference model-serving

C++ 38

3 天前

EmbeddedLLM / embeddedllm

#大语言模型#EmbeddedLLM: API server for Embedded Device Deployment. Currently support CUDA/OpenVINO/IpexLLM/DirectML/CPU

大语言模型 llm-inference directml directx-12 gemma llama mistral llm-serving model-inference npu Windows cpu openvino

Python 35

6 个月前

DAVIDNYARKO123 / edge-tpu-silva

#计算机科学#Streamlining the process for seamless execution of PyCoral in running TensorFlow Lite models on an Edge TPU USB.

edge-computing first-person-shooter 机器学习 model-inference object-detection 树莓派

Python 29

1 年前

kdeps / kdeps

#大语言模型#Build self-hosted RAG AI Agents powered by open-source LLMs, use LLM models from Ollama and Huggingface, add external API calls, python and shell scripts for context-aware LLM interactions, add valida...

API 人工智能 dockerized huggingface 大语言模型 multimodal Open Source Nvidia CUDA Docker llama mistral fine-tuning mlops model-inference llmops agents ai-agents llm-agent Software as a service

Go 19

1 个月前

Koldim2001 / Image_captioning

#自然语言处理#Генерация описаний к изображениям с помощью различных архитектур нейронных сетей

attention-mechanism 机器视觉 image-captioning lstm model-deployment model-inference 自然语言处理 Streamlit Website word-embeddings

Jupyter Notebook 17

2 年前

hegongshan / Storage-for-AI-Paper

#计算机科学#Accelerating AI Training and Inference from Storage Perspective (Must-read Papers on Storage for AI)

深度学习 mlsys PyTorch Tensorflow checkpoint data-preprocessing data-loading data-preparation dataloader model-inference model-training

11 天前

brian-kipkoech-tanui / sagemaker-ML-workflow

Image Classifiers are used in the field of computer vision to identify the content of an image and it is used across a broad variety of industries, from advanced technologies like autonomous vehicles ...

Amazon Web Services aws-ec2 aws-lambda aws-s3 endpoint image-classification JSON model-inference Python sagemaker

HTML 4

2 年前

ChaitanyaC22 / Udacity-AWS-MLE-ND-Project2-Build-a-ML-Workflow-For-Scones-Unlimited-On-Amazon-SageMaker

The primary objective of this project was to build and deploy an image classification model for Scones Unlimited, a scone-delivery-focused logistic company, using AWS SageMaker.

Amazon Web Services aws-ec2 aws-iam aws-lambda aws-s3 aws-sagemaker 部署 endpoint image-classification lambda-functions model-inference Python JSON

HTML 4

2 年前

SayamAlt / Cyberbullying-Classification-using-fine-tuned-DistilBERT

#自然语言处理#Successfully fine-tuned a pretrained DistilBERT transformer model that can classify social media text data into one of 4 cyberbullying labels i.e. ethnicity/race, gender/sexual, religion and not cyber...

data-exploration exploratory-data-analysis 大语言模型 model-inference 自然语言处理 text-classification text-preprocessing

Jupyter Notebook 1

10 个月前

SayamAlt / Financial-News-Sentiment-Analysis

#自然语言处理#Successfully developed a fine-tuned DistilBERT transformer model which can accurately predict the overall sentiment of a piece of financial news up to an accuracy of nearly 81.5%.

model-inference 自然语言处理 sentiment-analysis text-preprocessing

Jupyter Notebook 1

1 年前

AlvinHon / distributed-model-inference

Example distributed system for ML model inference by using Kafka, including spring boot REST+JPA server with Java consumer program

jpa kafka model-inference Spring Boot

Java 1

7 个月前

itancio / churn

#计算机科学#

机器学习 model-inference Python Streamlit

Python 1

5 个月前

thehrsr / CAR-DAMAGE-DETECTION

#计算机科学#This project is a web-based application that uses a pre-trained Mask R-CNN model to detect and classify car damage types (scratch, dent, shatter, dislocation) from images. Users can upload an image of...

人工智能机器视觉深度学习 Flask 图像处理 image-segmentation 机器学习 mask-rcnn model-inference object-detection Python Tensorflow Web app

Jupyter Notebook 1

7 个月前

GauravG-20 / Udacity-AWS-MLE-ND-Project2-Build-a-ML-Workflow-For-Scones-Unlimited-On-Amazon-SageMaker

The primary objective of this project was to build and deploy an image classification model for Scones Unlimited, a scone-delivery-focused logistic company, using AWS SageMaker.

Amazon Web Services aws-lambda aws-s3 aws-sagemaker JSON Jupyter Notebook model-inference Python udacity-nanodegree

HTML 0

2 年前

SayamAlt / Natural-Scenes-Image-Classification-using-CNNs

#计算机科学#Successfully established an image classification model using PyTorch to classify the images of several distinct natural sceneries such as mountains, glaciers, forests, seas, streets and buildings with...

convolutional-neural-networks 深度学习 image-classification image-transformations model-inference PyTorch

Jupyter Notebook 0

4 个月前

SayamAlt / Grapevine-Leaves-Image-Classification-Using-CNNs

#计算机科学#Successfully developed an image classification model using PyTorch to classify the species of grapevine leaves based on their corresponding images.

convolutional-neural-networks data-loader 深度学习 image-classification model-inference resnet50 vgg19

Jupyter Notebook 0

4 个月前