gguf · GitHub Topics

janhq / cortex.cpp

Local AI API Platform

gguf llamacpp onnx onnxruntime

C++ 2.55 k

13 小时前

Mobile-Artificial-Intelligence / maid

#安卓#Maid is a cross-platform Flutter app for interfacing with GGUF / llama.cpp models locally, and with Ollama and OpenAI models remotely.

Android 聊天机器人 ChatGPT Facebook Flutter gguf large-language-models llama llama-cpp llama2 llamacpp mistral openai local-ai ollama free-chatgpt

Dart 1.76 k

5 天前

heshengtao / comfyui_LLM_party

LLM Agent Framework in ComfyUI includes MCP sever, Omost,GPT-sovits, ChatTTS,GOT-OCR2.0, and FLUX prompt nodes,access to Feishu,discord,and adapts to all llms with similar openai / aisuite interfaces,...

comfyui openai workflow agent dify macOS graphrag gemini llama ollama o1 Linux flux gguf vlm OCR mcp

Python 1.46 k

2 天前

av / harbor

#大语言模型#Effortlessly run LLM backends, APIs, frontends, and services with one command.

命令行界面 Docker Docker Compose 大语言模型工具人工智能自托管 Bash container exl2 gguf local npm package pypi safetensors

Python 1.43 k

1 天前

withcatai / node-llama-cpp

#大语言模型#Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema on the model output on the generation level

人工智能 bindings llama llama-cpp 大语言模型 Node.js Parsing gguf CUDA metal JSON Schema cmake 自托管 embedding function-calling gpu vulkan

TypeScript 1.33 k

19 天前

datawhalechina / handy-ollama

#大语言模型#动手学Ollama，CPU玩转大模型部署，在线阅读地址：https://datawhalechina.github.io/handy-ollama/

large-language-models 大语言模型 ollama 教程 agent gguf langchain llamaindex rag

Jupyter Notebook 1.1 k

9 天前

edwko / OuteTTS

Interface for OuteTTS models.

gguf llama text-to-speech transformers tts

Python 943

1 个月前

sammcj / gollama

#大语言模型#Go manage your Ollama models

人工智能 gguf 大语言模型 ollama tui ggml Linux macOS models

Go 917

4 天前

jozu-ai / kitops

#数据仓库#An open source DevOps tool for packaging and versioning AI/ML models, datasets, code, and configuration into an OCI artifact.

Go 724

5 天前

mukel / llama3.java

#大语言模型#Practical Llama 3 inference in Java

Java llama llama3 大语言模型 llm-inference llms ChatGPT genai gguf huggingface llamacpp openai simd transformers

Java 656

2 个月前

eastriverlee / LLM.swift

#IOS#LLM.swift is a simple and readable library that allows you to interact with large language models locally with ease for macOS, iOS, watchOS, tvOS, and visionOS.

iOS 大语言模型 llm-inference macOS Swift tvOS visionOS watchOS gguf

Swift 524

23 天前

withcatai / catai

#大语言模型#Run AI ✨ assistant locally! with simple API for Node.js 🚀

ChatGPT 人工智能 dalai openai 聊天机器人 llama-cpp ai-assistant vicuna wizardlm 大语言模型 local-llm localai gguf Node.js

TypeScript 470

9 个月前

kelindar / search

#搜索#Go library for embedded vector search and semantic embeddings using llama.cpp

人工智能 bert embeddings gguf gpu llamacpp 搜索引擎 semantic-search simd vector-search

Go 390

5 天前

antirez / gguf-tools

#大语言模型#GGUF implementation in C as a library and a tools CLI program

人工智能 gguf 大语言模型机器学习

C 259

2 个月前

OE-LUCIFER / Webscout

Search for anything using Google, DuckDuckGo, phind.com, Contains AI models, can transcribe yt videos, temporary email and phone number generation, has TTS support, webai (terminal gpt and open interp...

人工智能免费 API 机器学习 Python YouTube youtube-api openai gguf llamacpp text-generation ollama

Python 198

6 天前

mgonzs13 / llama_ros

#大语言模型#llama.cpp (GGUF LLMs) and llava.cpp (GGUF VLMs) for ROS 2

C++gpt llama 大语言模型 ros2 ggml gguf llamacpp llava vlm langchain embeddings rerank reranking

C++ 193

8 天前

johnbean393 / Sidekick

#大语言模型#A native macOS app that allows users to chat with a local LLM that can respond with information from files, folders and websites on your Mac without installing any other software. Powered by llama.cpp...