llm-observability · GitHub Topics

#大语言模型#🪢 Open source LLM engineering platform: LLM Observability, metrics, evals, prompt management, playground, datasets. Integrates with OpenTelemetry, Langchain, OpenAI SDK, LiteLLM, and more. 🍊YC W23

analytics 大语言模型 llmops large-language-models openai 自托管 ycombinator 监控 observability Open Source langchain llama-index evaluation prompt-engineering prompt-management playground llm-evaluation llm-observability

TypeScript 9.3 k

7 小时前

comet-ml / opik

#大语言模型#Debug, evaluate, and monitor your LLM applications, RAG systems, and agentic workflows with comprehensive tracing, automated evaluations, and production-ready dashboards.

Open Source langchain openai playground prompt-engineering llama-index 大语言模型 llm-evaluation llm-observability llmops

Python 5.38 k

2 小时前

Helicone / helicone

#大语言模型#🧊 Open source LLM observability platform. One line of code to monitor, evaluate, and experiment. YC W23 🍓

large-language-models prompt-engineering agent-monitoring analytics evaluation gpt langchain llama-index 大语言模型 llm-cost llm-evaluation llm-observability llmops 监控 Open Source openai playground prompt-management ycombinator

TypeScript 3.4 k

16 小时前

Agenta-AI / agenta

The open-source LLMOps platform: prompt playground, prompt management, LLM evaluation, and LLM Observability all in one place.

llm-tools prompt-engineering prompt-management llm-evaluation llm-framework rag-evaluation llm-observability llm-as-a-judge llm-monitoring llm-platform llm-playground llmops-platform

Python 2.19 k

1 天前

lmnr-ai / lmnr

Laminar - open-source all-in-one platform for engineering AI products. Crate data flywheel for you AI app. Traces, Evals, Datasets, Labels. YC S24.

aiops developer-tools observability agents 人工智能 rag Rust analytics llm-evaluation llm-observability 监控 Open Source 自托管 ai-observability llmops evals evaluation

TypeScript 1.67 k

10 天前

palico-ai / palico-ai

#大语言模型#Build, Improve Performance, and Productionize your LLM Application with an Integrated Framework

langchain langchain-js llamaindex 大语言模型 llm-agent llm-evaluation llm-framework rag JavaScript TypeScript llm-observability autogen anthropic openai 人工智能 Node.js full-stack Docker

TypeScript 339

4 个月前

langfuse / oss-llmops-stack

#大语言模型#Modular, open source LLMOps stack that separates concerns: LiteLLM unifies LLM APIs, manages routing and cost controls, and ensures high-availability, while Langfuse focuses on detailed observability,...

ai-gateway gateway 大语言模型 llm-evaluation llm-gateway llm-observability llmops 监控 openai-proxy prompt-management 自托管 ycombinator Open Source

25 天前

radicalbit / radicalbit-ai-monitoring

#计算机科学#A comprehensive solution for monitoring your AI models in production

人工智能 ai-monitoring data-drift 数据科学机器学习 machine-learning-engineering 监控 observability ai-observability ml-observability llm-observability

Python 80

1 个月前

myscale / myscale-telemetry

Open-source observability for your LLM application.

callback langchain llm-observability 监控 Python

Python 48

2 个月前

teilomillet / hapax

#大语言模型#The reliability layer between your code and LLM providers.

anthropic infrastructure Infrastructure as code 大语言模型监控 observability openai llm-observability llmops Open Source llm-gateway

Go 15

2 个月前

AndrMoura / streamlit-chatbot-analytics

#大语言模型#Streamlit-based chatbot leveraging Ollama via LangChain and PostHog-LLM for advanced logging and monitoring

analytics 聊天机器人 chatbot-application chatbots langchain llama3 大语言模型 llm-ops ollama Streamlit llm-observability

Python 6

10 个月前

modelmetry / modelmetry-sdk-js

#大语言模型#The Modelmetry JS/TS SDK allows developers to easily integrate Modelmetry’s advanced guardrails and monitoring capabilities into their LLM-powered applications.

ai-observability evals guardrails large-language-models 大语言模型 llm-observability 监控 observability tracing

TypeScript 1

1 个月前