ai-observability · GitHub Topics

#数据仓库#AI Observability & Evaluation

llmops ai-monitoring ai-observability llm-eval 数据集 agents llms prompt-engineering anthropic evals llm-evaluation openai langchain llamaindex

Jupyter Notebook 5.35 k

1 天前

lmnr-ai / lmnr

Laminar - open-source all-in-one platform for engineering AI products. Crate data flywheel for you AI app. Traces, Evals, Datasets, Labels. YC S24.

aiops developer-tools observability agents 人工智能 rag Rust analytics llm-evaluation llm-observability 监控 Open Source 自托管 ai-observability llmops evals evaluation

TypeScript 1.83 k

16 小时前

openlit / openlit

Open source platform for AI Engineering: OpenTelemetry-native LLM Observability, GPU Monitoring, Guardrails, Evaluations, Prompt Management, Vault, Playground. 🚀💻 Integrates with 50+ LLM Providers, ...

observability llmops ai-observability openai 监控 clickhouse genai Grafana langchain llms monitoring-tool OpenTelemetry otlp Python tracing distributed-tracing Open Source gpu-monitoring amd-gpu

Python 1.41 k

6 天前

fiddler-labs / fiddler-auditor

#自然语言处理#Fiddler Auditor is a tool to evaluate language models.

ai-observability generative-ai langchain llms 自然语言处理 robustness evaluation

Python 179

1 年前

radicalbit / radicalbit-ai-monitoring

#计算机科学#A comprehensive solution for monitoring your AI models in production

人工智能 ai-monitoring data-drift 数据科学机器学习 machine-learning-engineering 监控 observability ai-observability ml-observability llm-observability

Python 81

2 个月前

Arize-ai / client_python

A python library to send data to Arize AI!

ml-monitoring model-monitoring ai-monitoring performance-monitoring data-quality-monitoring ml-observability ai-observability model-explainability ai-roi

Python 50

4 天前

fiddler-labs / fiddler-examples

explainable-ai model-monitoring ai-observability

Jupyter Notebook 13

25 天前

fiddler-labs / fiddler-report-generator

A report generator library for the ML models deployed on the Fiddler AI Observability platform

ai-observability Python report-generator

Python 10

1 年前

Arize-ai / client_java

Java client to interact with Arize API

ml-monitoring model-monitoring ai-monitoring performance-monitoring data-quality-monitoring ml-observability model-observability ai-observability model-explainability ai-roi

Java 7

7 个月前

Dynatrace / obslab-llm-observability

#大语言模型#Search for a holiday and get destination advice from an LLM. Observability by Dynatrace.

Demo 大语言模型 ollama pinecone ai-observability genai openai

HTML 6

2 个月前

okahu / okahu-demo

This repo hosts a chatbot that runs in a docker container to demo Okahu AI Observability Cloud

ai-observability generative-ai llms observability

Python 5

1 年前

okahu / okahu-demo-openai

This repo hosts a chatbot that runs in Github Codespaces to demo Okahu AI Observability Cloud with OpenAI

ai-observability generative-ai llms observability openai

Python 5

5 个月前

arthur-ai / arthur-sandbox

Example projects for Arthur Model Monitoring Platform

ai-monitoring ai-observability ml-monitoring ml-observability model-explainability model-monitoring

Jupyter Notebook 4

2 年前

openlit / dokumetry-python

#大语言模型#Official Python Library to monitor your LLM Application with Doku

ai-observability anthropic ChatGPT cohere gpt-3 大语言模型 llmops 监控 observability openai SDK Python 可视化 Open Source

Python 3

1 年前

openlit / .github

#大语言模型#

Open Source 大语言模型 openai 监控 observability cohere llmops ai-observability prisma generative-ai developer-tools gpt-3 Go TypeScript anthropic mistral analytics

5 个月前

Shard-AI / Shard

Open Source Video Understanding API and Large Vision Model Observability Platform.

人工智能 ai-observability analytics developer-tools evals evaluation 监控 observability Open Source pika sora

Python 2

3 个月前

modelmetry / modelmetry-sdk-js

#大语言模型#The Modelmetry JS/TS SDK allows developers to easily integrate Modelmetry’s advanced guardrails and monitoring capabilities into their LLM-powered applications.

ai-observability evals guardrails large-language-models 大语言模型 llm-observability 监控 observability tracing

TypeScript 1

2 个月前

modelmetry / modelmetry-sdk-python

#大语言模型#The Modelmetry Python SDK allows developers to easily integrate Modelmetry’s advanced guardrails and monitoring capabilities into their LLM-powered applications.

ai-observability evals large-language-models 大语言模型 llm-evaluation llmops 监控 observability guardrails openai

Python 1

4 个月前

openlit / dokumetry-node

#大语言模型#Official NodeJS library for monitoring LLM Applications with Doku

人工智能 ai-observability anthropic ChatGPT cohere generative-ai gpt-3 large-language-models 大语言模型 llmops 监控 observability openai 可视化 Node.js Library SDK Open Source

JavaScript 1

1 年前