”gguf“ 的搜索结果

GGUF Quantization support for native ComfyUI models

For GGUF support, see KoboldCPP: https://github.com/LostRuins/koboldcpp

GGUF implementation in C as a library and a tools CLI program

automatically quant GGUF models

llama.cpp (GGUF LLMs) and llava.cpp (GGUF VLMs) for ROS 2

Dagger functions to import Hugging Face GGUF models into a local ollama instance and optionally push them to ollama.com.

Local AI API Platform

GGUF Quantization of any LLM.

Go manage your Ollama models

一个基于 Gradio 的 Web UI，用于运行像 LLaMA、llama.cpp、GPT-J、Pythia、OPT 和 GALACTICA 这样的大型语言模型。

Maid is a cross-platform Flutter app for interfacing with GGUF / llama.cpp models locally, and with Ollama and OpenAI models remotely.

#大语言模型#:robot: The free, Open Source alternative to OpenAI, Claude and others. Self-hosted and local-first. Drop-in replacement for OpenAI, running on consumer-grade hardware. No GPU required. Runs gguf, tr...