ggml · GitHub Topics | GitHub 中文社区

llama.cpp

Georgi Gerganov@ggerganov

Facebook 的 LLaMA 模型在 C/C++ 中的移植

llama ggml

C++68.2 k

4 小时前

llm

@rustformers

#大语言模型# [Unmaintained, see README] An ecosystem of Rust libraries for working with large language models

ai ggml llm ml rust

Rust6.08 k

5 个月前

inference

@xorbitsai

#大语言模型# Replace OpenAI GPT with another LLM in your app by changing a single line of code. Xinference gives you the freedom to use any LLM you need. With Xinference, you're empowered to run inference with any...

ggml pytorch chatglm deployment flan-t5 llm wizardlm artificial-intelligence machine-learning whisper

Python5.38 k

9 天前

stable-diffusion.cpp

@leejet

Stable Diffusion and Flux in pure C/C++

ai cplusplus diffusion ggml image-generation latent-diffusion stable-diffusion text2image txt2img image2image

C++3.51 k

1 个月前

rwkv.cpp

@RWKV

#大语言模型# INT4/INT5/INT8 and FP16 inference on CPU for RWKV language model

deep-learning language-model llm machine-learning quantization rwkv ggml

C++1.43 k

4 个月前

gpu_poor

@RahulSChand

#大语言模型# Calculate token/s & GPU memory requirement for any LLM. Supports llama.cpp/ggml/bnb/QLoRA quantization

ggml huggingface llm quantization gpu language-model pytorch llama llama2 llamacpp

JavaScript1.15 k

21 天前

mpt-30B-inference

@abacaj

Run inference on MPT-30B using CPU

ctransformers ggml mpt-30b

Python573

1 年前

minigpt4.cpp

@Maknee

#计算机科学# Port of MiniGPT4 in C++ (4bit, 5bit, 6bit, 8bit, 16bit CPU inference with GGML)

c cpp deep-learning ggml machine-learning minigpt4 multimodal quantization

C++558

1 年前

LLaMA-Cult-and-More

@shm007g

#大语言模型# Large Language Models for All, 🦙 Cult and More, Stay in touch !

alpaca chatgpt gpt llama ggml gpt4 gptq vicuna pytorch tensorflow

HTML336

1 年前