Python bindings for llama.cpp
A Python-based web-assisted large language model (LLM) search assistant using Llama.cpp
#大语言模型#Streamlit + Langchain + LlamaCPP + Mistral + Rag
Tool for chatting with your codebase and docs using OpenAI, LlamaCpp, and GPT-4-All
cortex.llamacpp is a high-efficiency C++ inference engine for edge computing. It is a dynamic library that can be loaded by any server at runtime.
Jan is an open source alternative to ChatGPT that runs 100% offline on your computer
Vercel AI Provider for running Large Language Models locally using LLamaCpp
#大语言模型#Unified framework for building enterprise RAG pipelines with small, specialized models