#大语言模型# A high-throughput and memory-efficient inference and serving engine for LLMs
#大语言模型# Python SDK, Proxy Server (LLM Gateway) to call 100+ LLM APIs in OpenAI format - [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, Replicate, Groq]
#大语言模型# Composio equip's your AI agents & LLMs with 100+ high-quality integrations via function calling
#大语言模型# 本项目旨在分享大模型相关技术原理以及实战经验(大模型工程化、大模型应用落地)
#大语言模型# Run any open-source LLMs, such as Llama, Gemma, as OpenAI compatible API endpoint in the cloud.
#大语言模型# 🪢 Open source LLM engineering platform: LLM Observability, metrics, evals, prompt management, playground, datasets. Integrates with LlamaIndex, Langchain, OpenAI SDK, LiteLLM, and more. 🍊YC W23
A Blazing Fast AI Gateway with integrated Guardrails. Route to 200+ LLMs, 50+ AI Guardrails with 1 fast & friendly API.
#大语言模型# Test your prompts, agents, and RAGs. Red teaming, pentesting, and vulnerability scanning for LLMs. Compare performance of GPT, Claude, Gemini, Llama, and more. Simple declarative configs with command ...
#大语言模型# Dynamic RAG for enterprise. Ready to run with Docker,⚡in sync with Sharepoint, Google Drive, S3, Kafka, PostgreSQL, real-time data APIs, and more.
Open-source observability for your LLM application, based on OpenTelemetry
#计算机科学# RAG (Retrieval Augmented Generation) Framework for building modular, open source applications for production by TrueFoundry
An open-source visual programming environment for battle-testing prompts to LLMs.
BionicGPT is an on-premise replacement for ChatGPT, offering the advantages of Generative AI while maintaining strict data confidentiality
#大语言模型# The LLM's practical guide: From the fundamentals to deploying advanced LLM and RAG apps to AWS using LLMOps best practices
#大语言模型# The open-source LLMOps platform: prompt playground, prompt management, LLM evaluation, and LLM Observability all in one place.
#大语言模型# The Security Toolkit for LLM Interactions