”llm-cpu“ 的搜索结果

#自然语言处理#Running Llama 2 and other Open-Source LLMs on CPU Inference Locally for Document Q&A

Data extraction with LLM on CPU

#自然语言处理#中文LLaMA&Alpaca大语言模型+本地CPU/GPU训练部署 (Chinese LLaMA & Alpaca LLMs)

Low-bit LLM inference on CPU with lookup table

Data extraction with LLM on CPU

Data extraction with LLM on CPU

Data extraction with LLM on CPU

Easy and Fast LLM finetuning on GPU or CPU.

Production ready LLM model compression/quantization toolkit with accelerated inference support for both cpu/gpu via HF, vLLM, and SGLang.

Facebook 的 LLaMA 模型在 C/C++ 中的移植

#大语言模型#The Memory layer for your AI apps

Universal and Transferable Attacks on Aligned Language Models

#大语言模型#LLM Frontend for Power Users.

the LLM vulnerability scanner

#大语言模型#LLM Finetuning with peft

#大语言模型#[ICML'24 Spotlight] LLM Maybe LongLM: Self-Extend LLM Context Window Without Tuning

The LLM Evaluation Framework

LLM as a Chatbot Service

#大语言模型#[Unmaintained, see README] An ecosystem of Rust libraries for working with large language models

#大语言模型#Accelerate local LLM inference and finetuning (LLaMA, Mistral, ChatGLM, Qwen, Mixtral, Gemma, Phi, MiniCPM, Qwen-VL, MiniCPM-V, etc.) on Intel XPU (e.g., local PC with iGPU and NPU, discrete GPU such ...

#大语言模型#LlamaIndex is a data framework for your LLM applications

#大语言模型#拖拉拽界面构建定制化的LLM流程

llm deploy project based mnn.

Numbers every LLM developer should know

Access large language models from the command-line

📖A curated list of Awesome LLM/VLM Inference Papers with codes, such as FlashAttention, PagedAttention, Parallelism, etc. 🎉🎉

Simple UI for LLM Model Finetuning

#计算机科学#Build LLM-powered applications in Ruby