mixtral · GitHub Topics

#大语言模型#Private chat with local GPT with document, images, video, etc. 100% private, Apache 2.0. Supports oLLaMa, Mixtral, llama.cpp, and more. Demo: https://gpt.h2o.ai/ https://gpt-docs.h2o.ai/

ChatGPT 大语言模型人工智能 embeddings generative gpt gpt4all pdf private privategpt vectorstore llama2 mixtral

Python 11.72 k

2 天前

bigscience-workshop / petals

#自然语言处理#🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading

bloom 深度学习 distributed-systems language-models large-language-models 机器学习 neural-networks PyTorch volunteer-computing pipeline-parallelism guanaco llama 聊天机器人 gpt transformer 自然语言处理 pretrained-models falcon mixtral

Python 9.49 k

6 个月前

yangjianxin1 / Firefly

#大语言模型#Firefly: 大模型训练工具，支持训练Qwen2.5、Qwen2、Yi1.5、Phi-3、Llama3、Gemma、MiniCPM、Yi、Deepseek、Orion、Xverse、Mixtral-8x7B、Zephyr、Mistral、Baichuan2、Llma2、Llama、Qwen、Baichuan、ChatGLM2、InternLM、Ziya2、Vicuna、Bloom等大模型

gpt alpaca 大语言模型 baichuan llama lora qlora peft llama2 internlm chatglm qwen mistral mixtral Zephyr RTOS minicpm gemma llama3 qwen2

Python 6.24 k

5 个月前

InternLM / xtuner

#大语言模型#An efficient, flexible and full-featured toolkit for fine-tuning LLM (InternLM2, Llama3, Phi3, Qwen, Mistral, ...)

baichuan chatglm2 internlm large-language-models llama2 大语言模型 llm-training peft qwen 聊天机器人 conversational-ai agent chatglm3 llava mixtral llama3 phi3

Python 4.36 k

3 天前

aandrew-me / tgpt

#大语言模型#AI Chatbots in terminal without needing API keys

ChatGPT 人工智能聊天机器人命令行界面 Go gpt3 Linux macOS 终端 Windows llama mixtral

Go 2.38 k

16 天前

darrenburns / elia

#大语言模型#A snappy, keyboard-centric terminal user interface for interacting with large language models. Chat with ChatGPT, Claude, Llama 3, Phi 3, Mistral, Gemma and more.

Python 人工智能 ChatGPT gpt 终端 tui claude large-language-models llama llama3 大语言模型 mistral mixtral ollama gemma ollama-client ollama-interface

Python 2.05 k

5 个月前

kevinhermawan / Ollamac

#大语言模型#Mac app for Ollama

人工智能大语言模型 llms ollama mistral macOS llama3 mixtral

Swift 1.68 k

7 天前

tenstorrent / tt-metal

#大语言模型#:metal: TT-NN operator library, and TT-Metalium low level kernel programming model.

机器学习 llama 大语言模型 low-level-programming metal mistral mixtral resnet stable-diffusion tenstorrent accelerator

C++ 661

2 天前

ymcui / Chinese-Mixtral

#自然语言处理#中文Mixtral混合专家大模型（Chinese Mixtral MoE LLMs）

large-language-models 大语言模型 mixtral mixture-of-experts moe 自然语言处理

Python 599

10 个月前

jianzhnie / LLamaTuner

#大语言模型#Easy and Efficient Finetuning LLMs. (Supported LLama, LLama2, LLama3, Qwen, Baichuan, GLM , Falcon) 大模型高效量化训练+部署.

llama ChatGPT dpo llama3 mixtral ppo qlora qwen rlhf

Python 595

2 个月前

helixml / helix

#大语言模型#🧬 Helix is a private GenAI stack for building AI applications with declarative pipelines, knowledge (RAG), API bindings, and first-class testing.

Go llama 大语言模型 mistral openai 自托管 mixtral sdxl stable-diffusion API finetuning function-calling llm-agent llm-serving OpenAPI Specification rag swagger helm Kubernetes

Go 435

7 天前

sozercan / aikit

#大语言模型#🏗️ Fine-tune, build, and deploy open-source LLMs easily!

buildkit large-language-models 大语言模型 Docker inference Kubernetes Nvidia 人工智能 llama ChatGPT localllama mistral mixtral gpt openai fine-tuning finetuning gemma open-llm

Go 430

2 天前

ModelTC / llmc

#大语言模型#[EMNLP 2024 Industry Track] This is the official PyTorch implementation of "LLMC: Benchmarking Large Language Model Quantization with a Versatile Compression Toolkit".

部署大语言模型 pruning quantization 工具 benchmark evaluation large-language-models internlm2 llama3 smoothquant post-training-quantization mixtral vllm

Python 426

3 天前

moritztng / fltr

#大语言模型#Like grep but for natural language questions. Based on Mistral 7B or Mixtral 8x7B.

大语言模型 Rust llama llama-2 localllama mistral mixtral mixtral-8x7b 命令行界面 grep 操作系统

Rust 381

1 年前

WangRongsheng / Aurora

#大语言模型#The official codes for "Aurora: Activating chinese chat capability for Mixtral-8x7B sparse Mixture-of-Experts through Instruction-Tuning"

mixtral-8x7b-instruct mixtral mixtral-8x7b instruction-tuning lora qlora fine-tuning large-language-models 大语言模型 gpt language-model 中文

Python 260

10 个月前

inferflow / inferflow

Inferflow is an efficient and highly configurable inference engine for large language models (LLMs).

llama2 llamacpp llm-inference model-quantization multi-gpu-inference mixture-of-experts moe gemma falcon minicpm mistral bloom deepseek internlm baichuan2 mixtral qwen

C++ 237

1 年前

empower-ai / empower-functions

#大语言模型#GPT-4 level function calling models for real-world tool using use cases

人工智能 function-calling llama3 大语言模型 mixtral

Python 229

5 个月前

gbaptista / ollama-ai

#大语言模型#A Ruby gem for interacting with Ollama's API that allows you to run open source AI LLMs (Large Language Models) locally.

人工智能 alpaca dolphin llama llama2 大语言模型 mistral mixtral ollama ollama-api vicuna llava

Ruby 220

8 个月前

expectedparrot / edsl

#大语言模型#Design, conduct and analyze results of AI-powered surveys and experiments. Simulate social science and market research with large numbers of AI agents and LLMs.

anthropic data-labeling domain-specific-language experiments llama2 大语言模型 llm-agent llm-framework llm-inference mixtral Open Source openai Python surveys synthetic-data

Python 219

11 小时前

Picovoice / picollm

#自然语言处理#On-device LLM Inference Powered by X-Bit Quantization

大语言模型 compression efficient-inference gemma generative-ai language-model language-models large-language-model llama llama2 llama3 llms mistral mixtral model-compression 自然语言处理 quantization 自托管 llm-inference

Python 216

21 天前