”distributed-llm“ 的搜索结果

Distribute and run LLMs with a single file.

llm-d enables high-performance distributed LLM inference on Kubernetes

distributed trainer for LLMs

Distributed LLM and StableDiffusion inference for mobile, desktop and server.

#大语言模型#Distributed LLM inference. Connect home devices into a powerful cluster to accelerate LLM inference. More devices means faster inference.

KV cache store for distributed LLM inference

#大语言模型# Rill Flow is a high-performance, scalable workflow orchestration engine for distributed workloads and LLMs

Multipack distributed sampler for fast padding-free training of LLMs

Distributed Inference for mlx LLm

#自然语言处理#Tune efficiently any LLM model from HuggingFace using distributed training (multiple GPU) and DeepSpeed. Uses Ray AIR to orchestrate the training on multiple AWS GPU instances

Facebook 的 LLaMA 模型在 C/C++ 中的移植

A distributed task scheduler for Dask

分布式、可靠的KV数据存储服务器

open source training courses about distributed database and distributed systems

DeepEval 是大语言模型评估框架，专为评估和测试大语言模型系统而设计。它类似于 Pytest，但专注于对 LLM 输出进行单元测试。

#自然语言处理#LLM(😽)

#大语言模型#SillyTavern 为众多 LLM API 提供统一界面，允许您与文本生成 LLM、图像生成引擎和 TTS 语音模型进行交互

Universal and Transferable Attacks on Aligned Language Models

#大语言模型#Higher performance OpenAI LLM service than vLLM serve: A pure C++ high-performance OpenAI LLM service implemented with GPRS+TensorRT-LLM+Tokenizers.cpp, supporting chat and function call, AI agents, d...

Distributed scheduled job

#大语言模型#Structured data extraction and instruction calling with ML, LLM and Vision LLM

#大语言模型#Blazingly fast LLM inference.

the LLM vulnerability scanner

分布式任务队列

实时分布式消息队列

🔥 Klein is a Paxos based distributed collection tool library, including distributed ArrayList, distributed HashMap, distributed Cache, distributed Lock, etc..