multi-gpu-inference

Inferflow is an efficient and highly configurable inference engine for large language models (LLMs).

A script for PyTorch multi-GPU multi-process testing

#大语言模型#Distributed Reinforcement Learning for LLM Fine-Tuning with multi-GPU utilization