llmops · GitHub Topics

#大语言模型#Dify 是一个易用的 LLMOps 平台，旨在让更多人可以创建可持续运营的原生 AI 应用。Dify 提供多种类型应用的可视化编排，应用可开箱即用，也能以“后端即服务”的 API 提供服务。

人工智能 backend-as-a-service gpt 大语言模型 openai Python rag orchestration gpt-4 agent Next workflow 聊天机器人 genai anthropic gemini llama3 llmops workflows

TypeScript 81.33 k

3 小时前

vllm-project / vllm

#大语言模型#A high-throughput and memory-efficient inference and serving engine for LLMs

gpt 大语言模型 PyTorch llmops mlops model-serving transformer llm-serving inference llama amd rocm CUDA inferentia trainium tpu xpu hpu deepseek qwen

Python 41.24 k

1 小时前

ComposioHQ / composio

#大语言模型#Composio equip's your AI agents & LLMs with 100+ high-quality integrations via function calling

人工智能 Python agents aiagents function-calling developer-tools gpt-4 gpt-4o 大语言模型 llmops TypeScript JavaScript ai-agents Hacktoberfest hacktoberfest2024

Python 24.12 k

4 小时前

pathwaycom / llm-app

#大语言模型#Ready-to-run cloud templates for RAG, AI pipelines, and enterprise search with live data. 🐳Docker-friendly.⚡Always in sync with Sharepoint, Google Drive, S3, Kafka, PostgreSQL, real-time data APIs, a...

聊天机器人 hugging-face 大语言模型 llm-local llm-prompting llm-security llmops pathway real-time vector-index open-ai vector-database retrieval-augmented-generation 机器学习 rag

Jupyter Notebook 22.55 k

1 天前

jina-ai / serve

#计算机科学#Jina 是一个基于深度学习的搜索框架，支持各种类型如图片，视频，长文本，PDF等。

neural-search cloud-native 深度学习机器学习框架 gRPC Kubernetes multimodal mlops pipeline FastAPI generative-ai Docker jaeger llmops OpenTelemetry cncf 微服务 orchestration prometheus

Python 21.4 k

13 天前

BerriAI / litellm

#大语言模型#Python SDK, Proxy Server (LLM Gateway) to call 100+ LLM APIs in OpenAI format - [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, Replicate, Groq]

anthropic langchain 大语言模型 llmops openai ai-gateway azure-openai bedrock gateway openai-proxy vertex-ai llm-gateway

Python 18.74 k

1 小时前

TransformerOptimus / SuperAGI

#大语言模型#<⚡️> SuperAGI - A dev-first open source autonomous AI agent framework. Enabling developers to build, manage & run useful autonomous agents quickly and reliably.

agi 人工智能 autonomous-agents Python agents gpt-4 openai artificial-general-intelligence superagi 大语言模型 llmops Next pinecone Hacktoberfest

Python 16.02 k

2 个月前

raga-ai-hub / RagaAI-Catalyst

Python SDK for Agent AI Observability, Monitoring and Evaluation Framework. Includes features like agent, llm and tools tracing, debugging multi-agentic system, self-hosted dashboard and advanced anal...

agents llmops agentic-ai

Python 15.67 k

1 天前

liguodongiot / llm-action

#大语言模型#本项目旨在分享大模型相关技术原理以及实战经验（大模型工程化、大模型应用落地）

大语言模型 llm-inference llm-serving llm-training llmops

HTML 15.13 k

11 天前

bentoml / OpenLLM

#大语言模型#Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.

大语言模型 llmops model-inference fine-tuning llm-serving llama vicuna bentoml llama2 llm-inference llm-ops mistral mlops llama3-1

Python 10.94 k

2 天前

langfuse / langfuse

#大语言模型#🪢 Open source LLM engineering platform: LLM Observability, metrics, evals, prompt management, playground, datasets. Integrates with OpenTelemetry, Langchain, OpenAI SDK, LiteLLM, and more. 🍊YC W23

analytics 大语言模型 llmops large-language-models openai 自托管 ycombinator 监控 observability Open Source langchain llama-index evaluation prompt-engineering prompt-management playground llm-evaluation llm-observability

TypeScript 9.3 k

3 小时前

Netflix / metaflow

#大语言模型#Build, Deploy and Manage AI/ML Systems

翻译 - 轻松构建和管理现实生活中的数据科学项目。

机器学习数据科学 productivity model-management 人工智能 ml-platform ml-infrastructure Python R r-package mlops datascience high-performance-computing Kubernetes Amazon Web Services Azure Google 云大语言模型 llmops

Python 8.62 k

18 小时前

explodinggradients / ragas

#大语言模型#Supercharge Your LLM Application Evaluations 🚀

大语言模型 llmops evaluation

Python 8.44 k

2 天前

dataelement / bisheng

#大语言模型#一个大模型应用开发平台，赋能和加速大模型应用开发落地，帮助用户以最佳体验进入下一代应用开发模式。

agent 人工智能聊天机器人 rag workflow enterprise genai gpt langchian llama 大语言模型 llmdevops llmops OCR openai orchestration Python React finetune sft

Python 7.82 k

6 小时前

bentoml / BentoML

#大语言模型#The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!

翻译 - 轻松进行模型服务

model-serving mlops llmops generative-ai llm-inference 深度学习 llm-serving 机器学习 Python multimodal ml-engineering 大语言模型

Python 7.47 k

17 小时前

Portkey-AI / gateway

A blazing fast AI Gateway with integrated guardrails. Route to 200+ LLMs, 50+ AI Guardrails with 1 fast & friendly API.

gateway generative-ai llmops llms prompt-engineering ai-gateway langchain llama-index openai router Hacktoberfest

TypeScript 7.27 k

1 天前

evidentlyai / evidently

#大语言模型#Evidently is an open-source ML and LLM observability framework. Evaluate, test, and monitor any AI-powered system or data pipeline. From tabular data to Gen AI. 100+ metrics.

data-drift Jupyter Notebook pandas-dataframe 机器学习 model-monitoring html-report mlops 数据科学 Hacktoberfest data-quality data-validation generative-ai 大语言模型 llmops

Jupyter Notebook 5.82 k

1 天前

promptfoo / promptfoo

#大语言模型#Test your prompts, agents, and RAGs. Red teaming, pentesting, and vulnerability scanning for LLMs. Compare performance of GPT, Claude, Gemini, Llama, and more. Simple declarative configs with command ...

大语言模型 prompt-engineering prompts llmops prompt-testing Testing rag evaluation evaluation-framework llm-eval llm-evaluation llm-evaluation-framework 持续集成 CI/CD pentesting red-teaming vulnerability-scanners

TypeScript 5.8 k

14 小时前

traceloop / openllmetry

#大语言模型#Open-source observability for your LLM application, based on OpenTelemetry

llmops observability OpenTelemetry 监控 datascience 机器学习 model-monitoring opentelemetry-python Python good-first-issue help-wanted artifical-intelligence generative-ai 大语言模型 Open Source

Python 5.51 k

1 天前

comet-ml / opik

#大语言模型#Debug, evaluate, and monitor your LLM applications, RAG systems, and agentic workflows with comprehensive tracing, automated evaluations, and production-ready dashboards.

Open Source langchain openai playground prompt-engineering llama-index 大语言模型 llm-evaluation llm-observability llmops

Python 5.37 k

2 小时前