Example project for the course "Testing & Monitoring Machine Learning Model Deployments"
A demo of Prometheus+Grafana for monitoring an ML model served with FastAPI.
Monitoring Foot Traffic over IP Webcams with ML
#时序数据库#Luminaire is a python package that provides ML driven solutions for monitoring time series data.
翻译 - Luminaire是一个python软件包,提供ML驱动的解决方案来监视时间序列数据。
Learn how to monitor ML systems to identify and mitigate sources of drift before model performance decay.
A Python package for sending model inference data, data metrics, and model metrics
Scala Aggregators used for ML Model metrics monitoring
#计算机科学#Evidently is an open-source ML and LLM observability framework. Evaluate, test, and monitor any AI-powered system or data pipeline. From tabular data to Gen AI. 100+ metrics.
This repo presents a demo application for realtime livestream video quality monitoring using AWS serverless and AI/ML services.
#计算机科学#UpTrain is an open-source unified platform to evaluate and improve Generative AI applications. We provide grades for 20+ preconfigured checks (covering language, code, embedding use-cases), perform ro...
#计算机科学#🐢 Open-Source Evaluation & Testing for ML & LLM systems
Minimalist ML framework for Rust
Unified monitoring wallboard — Light, ergonomic and reliable monitoring for anything.
翻译 - 统一监控墙板–轻便,符合人体工程学且可靠的监控功能。
Uptime Kuma 是一个网络状态监控工具,支持 HTTP/HTTPS/TCP/PING/DNS 监控,告警可以通过 Telegram、Emial、Discord、Slack 等通知
SkyWalking 是一款应用性能监控系统,包括指标监控,分布式追踪,分布式系统性能诊断。
#效率工具集合#🦉 Data Versioning and ML Experiments
翻译 - 🦉数据版本控制|用于数据和模型的Git
Concrete ML: Privacy Preserving ML framework using Fully Homomorphic Encryption (FHE), built on top of Concrete, with bindings to traditional ML frameworks.
#计算机科学#Core ML tools contain supporting tools for Core ML model conversion, editing, and validation.
翻译 - Core ML工具包含用于Core ML模型转换,编辑和验证的支持工具。
Explanation to key concepts in ML
https://huyenchip.com/ml-interviews-book/
System monitoring dashboard for terminal
翻译 - 终端的系统监控仪表板