llama-cpp

#大语言模型#A self-hosted, offline, ChatGPT-like chatbot. Powered by Llama 2. 100% private, with no data leaving your device. New: Code Llama support!

#大语言模型#A C#/.NET library to run LLM (🦙LLaMA/LLaVA) on your local device efficiently.

#安卓#Maid is a cross-platform Flutter app for interfacing with GGUF / llama.cpp models locally, and with Ollama and OpenAI models remotely.

#大语言模型#llama.go is like llama.cpp in pure Golang!

#大语言模型#Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema on the model output on the generation level

#大语言模型#Create characters in Unity with LLMs!

#大语言模型#Self-evaluating interview for AI coders

#大语言模型#Run AI ✨ assistant locally! with simple API for Node.js 🚀

#安卓#React Native binding of llama.cpp

#计算机科学#LLama.cpp rust bindings

This repo is to showcase how you can run a model locally and offline, free of OpenAI dependencies.

#自然语言处理#Local ML voice chat using high-end models.

#大语言模型#Run LLMs locally. A clojure wrapper for llama.cpp.

#大语言模型#Booster - open accelerator for LLM models. Better inference and debugging for AI hackers

#安卓#Making offline AI models accessible to all types of edge devices.

workbench for learing&practising AI tech in real scenario on Android device, powered by GGML(Georgi Gerganov Machine Learning) and FFmpeg

Review/Check GGUF files and estimate the memory usage and maximum tokens per second.

LLaMA Server combines the power of LLaMA C++ with the beauty of Chatbot UI.

#大语言模型#Your customized AI assistant - Personal assistants on any hardware! With llama.cpp, whisper.cpp, ggml, LLaMA-v2.

#大语言模型#Langport is a language model inference service