llmops · GitHub Topics | GitHub 中文社区

#大语言模型#Dify 是一个易用的 LLMOps 平台，旨在让更多人可以创建可持续运营的原生 AI 应用。Dify 提供多种类型应用的可视化编排，应用可开箱即用，也能以“后端即服务”的 API 提供服务。

人工智能 backend-as-a-service gpt llm openai Python rag orchestration gpt-4 agent Next workflow Chat Bot genai anthropic gemini llama3 llmops workflows

TypeScript55.74 k

1 小时前

autogen

Microsoft@microsoft

#大语言模型#A programming framework for agentic AI 🤖 PyPi: autogen-agentchat Discord: https://aka.ms/autogen-discord Office Hour: https://aka.ms/autogen-officehour

agent-based-framework agent-oriented-programming chat chat-application Chat Bot ChatGPT gpt gpt-35-turbo gpt-4 llm-agent llm-framework llm-inference llmops agentic agentic-agi

Jupyter Notebook36.16 k

1 天前

vllm

@vllm-project

#大语言模型#A high-throughput and memory-efficient inference and serving engine for LLMs

gpt llm PyTorch llmops mlops model-serving transformer llm-serving inference llama amd rocm CUDA inferentia trainium tpu xpu hpu

Python32.35 k

4 小时前

litellm

@BerriAI

#大语言模型#Python SDK, Proxy Server (LLM Gateway) to call 100+ LLM APIs in OpenAI format - [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, Replicate, Groq]

anthropic langchain llm llmops openai ai-gateway azure-openai bedrock gateway openai-proxy vertex-ai llm-gateway

Python15.34 k

21 小时前

composio

@ComposioHQ

#大语言模型#Composio equip's your AI agents & LLMs with 100+ high-quality integrations via function calling

人工智能 Python agents aiagents function-calling developer-tools gpt-4 gpt-4o llm llmops TypeScript JavaScript ai-agents Hacktoberfest hacktoberfest2024

Python13.62 k

19 小时前

llm-action

@liguodongiot

#大语言模型#本项目旨在分享大模型相关技术原理以及实战经验（大模型工程化、大模型应用落地）

llm llm-inference llm-serving llm-training llmops

HTML12.07 k

6 天前

OpenLLM

@bentoml

#大语言模型#Run any open-source LLMs, such as Llama, Mistral, as OpenAI compatible API endpoint in the cloud.

llm llmops model-inference falcon fine-tuning stablelm llm-serving llama mpt vicuna

Python10.21 k

13 天前

ragas

@explodinggradients

#大语言模型#Supercharge Your LLM Application Evaluations 🚀

llm llmops evaluation

Python7.65 k

3 天前

langfuse

@langfuse

#大语言模型#🪢 Open source LLM engineering platform: LLM Observability, metrics, evals, prompt management, playground, datasets. Integrates with LlamaIndex, Langchain, OpenAI SDK, LiteLLM, and more. 🍊YC W23

TypeScript7.43 k

2 天前

gateway

@Portkey-AI

A blazing fast AI Gateway with integrated guardrails. Route to 200+ LLMs, 50+ AI Guardrails with 1 fast & friendly API.

gateway generative-ai llmops llms prompt-engineering ai-gateway langchain llama-index openai router Hacktoberfest

TypeScript6.61 k

4 天前

openllmetry

@traceloop

Open-source observability for your LLM application, based on OpenTelemetry

llmops observability OpenTelemetry 监控 datascience 机器学习 model-monitoring opentelemetry-python

Python5.19 k

7 天前

promptfoo

@promptfoo

#大语言模型#Test your prompts, agents, and RAGs. Red teaming, pentesting, and vulnerability scanning for LLMs. Compare performance of GPT, Claude, Gemini, Llama, and more. Simple declarative configs with command ...

llm prompt-engineering prompts llmops prompt-testing Testing rag evaluation evaluation-framework llm-eval llm-evaluation llm-evaluation-framework 持续集成 CI/CD pentesting red-teaming vulnerability-scanners

TypeScript5.01 k

1 天前

phoenix

@Arize-ai

AI Observability & Evaluation

ml-observability model-observability ai-roi llmops mlops ai-monitoring ai-observability ml-monitoring model-monitoring umap

Jupyter Notebook4.3 k

6 天前

zenml

@zenml-io

#大语言模型#ZenML 🙏: The bridge between ML and Ops. https://zenml.io.

翻译 - ZenML：通过可重现的管道将Zen带入您的ML

mlops 机器学习数据科学 production-ready devops-tools zenml pipelines metadata-tracking 深度学习 PyTorch Tensorflow 人工智能 automl Hacktoberfest workflow llm llmops

Python4.25 k

11 天前

llm-app

@pathwaycom

#大语言模型#Dynamic RAG for enterprise. Ready to run with Docker,⚡in sync with Sharepoint, Google Drive, S3, Kafka, PostgreSQL, real-time data APIs, and more.

Chat Bot hugging-face llm llm-local llm-prompting llm-security llmops pathway real-time vector-index

Python3.93 k

3 个月前

opik

@comet-ml

#大语言模型#From RAG chatbots to code assistants to complex agentic pipelines and beyond, build LLM systems that run better, faster, and cheaper with tracing, evaluations, and dashboards.

Open Source langchain openai playground prompt-engineering llama-index llm llm-evaluation llm-observability llmops

Python3.62 k

38 分钟前