model-monitoring · GitHub Topics

DataTalksClub / mlops-zoomcamp

#计算机科学#Free MLOps course from DataTalks.Club

机器学习 mlops model-deployment model-monitoring workflow-orchestration

Jupyter Notebook 11.56 k

1 个月前

evidentlyai / evidently

#大语言模型#Evidently is an open-source ML and LLM observability framework. Evaluate, test, and monitor any AI-powered system or data pipeline. From tabular data to Gen AI. 100+ metrics.

data-drift Jupyter Notebook pandas-dataframe 机器学习 model-monitoring html-report mlops 数据科学 Hacktoberfest data-quality data-validation generative-ai 大语言模型 llmops

Jupyter Notebook 5.82 k

11 小时前

traceloop / openllmetry

#大语言模型#Open-source observability for your LLM application, based on OpenTelemetry

llmops observability OpenTelemetry 监控 datascience 机器学习 model-monitoring opentelemetry-python Python good-first-issue help-wanted artifical-intelligence generative-ai 大语言模型 Open Source

Python 5.51 k

1 天前

deepchecks / deepchecks

#计算机科学#Deepchecks: Tests for Continuous Validation of ML Models & Data. Deepchecks is a holistic open-source solution for all of your AI & ML validation needs, enabling to thoroughly test your data and model...

翻译 - 用于验证 ML 模型和数据的测试套件。 Deepchecks 是一个 Python 包，用于以最小的努力全面验证您的机器学习模型和数据。

机器学习 model-validation data-validation mlops 数据科学 Python Jupyter Notebook model-monitoring data-drift html-report 深度学习 PyTorch pandas-dataframe

Python 3.73 k

7 天前

NannyML / nannyml

#计算机科学#nannyml: post-deployment data science in python

机器学习 mlops performance-monitoring 数据科学监控 Python data-drift model-monitoring 数据分析可视化深度学习 Jupyter Notebook

Python 2.04 k

2 个月前

traceloop / openllmetry-js

Sister project to OpenLLMetry, but in Typescript. Open-source observability for your LLM application, based on OpenTelemetry

datascience llmops 监控机器学习 model-monitoring observability OpenTelemetry opentelemetry-javascript TypeScript JavaScript generative-ai Next Open Source

TypeScript 297

16 天前

MAIF / eurybia

#计算机科学#⚓ Eurybia monitors model drift over time and securizes model deployment with data validation

Python data-validation drift html-report 机器学习 data-drift model-monitoring production-machine-learning

Jupyter Notebook 206

5 个月前

squaredev-io / whitebox

#计算机科学#[Not Actively Maintained] Whitebox is an open source E2E ML monitoring platform with edge capabilities that plays nicely with kubernetes

机器学习监控 observability Python explainability explainable-ai ml-monitoring mlflow mlops accuracy confusion-matrix recall model-monitoring Kubernetes xai

Python 183

2 年前

aws-samples / amazon-sagemaker-mlops-workshop

#计算机科学#MLOps workshop with Amazon SageMaker

sagemaker tensorflow2 机器学习 model-monitoring amazon-sagemaker

Jupyter Notebook 97

6 个月前

NimbleBoxAI / nbox

#计算机科学#The official python package for NimbleBox. Exposes all APIs as CLIs and contains modules to make ML 🌸

数据科学机器学习 ml-infrastructure ml-platform mlops model-deployment model-management model-monitoring model-serving

Python 87

1 年前

VectorInstitute / cyclops

#计算机科学#A toolkit for evaluating and monitoring AI models in clinical settings

clinical-data healthcare model-monitoring data-drift 机器学习深度学习 evaluation clinical-research electronic-health-record electronic-medical-record

Python 81

9 天前

aporia-ai / inferencedb

#计算机科学#🚀 Stream inferences of real-time ML models in production to any data lake (Experimental)

机器学习 model-serving kafka s3 model-monitoring mlops

Python 79

3 年前

evidentlyai / ml_observability_course

Free Open-source ML observability course for data scientists and ML engineers. Learn how to monitor and debug your ML models in production.

data-drift data-quality data-quality-checks llmops machine-learning-operations ml-monitoring ml-observability ml-pipelines mlops model-monitoring production-machine-learning

Jupyter Notebook 77

1 年前

awesome-mlops / awesome-ml-monitoring

#计算机科学#A curated list of awesome open source tools and commercial products for monitoring data quality, monitoring model performance, and profiling data 🚀

mlops aiops DataOps datascience 机器学习 concept-drift data-cleaning data-drift data-management data-monitoring data-quality 数据科学深度学习 model-explainability model-management model-monitoring

10 个月前

rstudio / vetiver-python

Version, share, deploy, and monitor models.

mlops model-monitoring model-versioning Python

Python 64

2 个月前

traceloop / hub

#大语言模型#High-scale LLM gateway, written in Rust. OpenTelemetry-based observability included

人工智能 datascience generative-ai 大语言模型 llmops 机器学习 model-monitoring observability Open Source OpenTelemetry Rust

Rust 56

8 天前

Arize-ai / client_python

A python library to send data to Arize AI!

ml-monitoring model-monitoring ai-monitoring performance-monitoring data-quality-monitoring ml-observability ai-observability model-explainability ai-roi

Python 50

6 天前

jomariya23156 / full-stack-on-prem-cv-mlops

#计算机科学#"1 config, 1 command from Jupyter Notebook to serve Millions of users", Full-stack On-Premises MLOps system for Computer Vision from Data versioning to Model monitoring and drift detection.